Open Internet by MindsNet
Speech To Speech
Repository: huggingface/speech-to-speech Stars: 10243 Forks: 1250 Primary language: Python Discovery sources: trending:daily Selection score: 79.69 Usefulness score: 9.7 Source confidence score: 3.5 Languages: Python, Dockerfile Topics: ai, assistant, language-model, machine-learning, python, speech, speech-synthesis, speech-to-text, speech-translation Summary: Build local voice agents with open-source models README excerpt: <div align="center"> <div> </div> <img src="https://raw.githubusercontent.com/huggingface/speech-to-speech/main/logo.png" width="600"/> # Speech To Speech: Build voice agents with open-source models [](https://pypi.org/project/speech-to-speech/) [](https://pypi.org/project/speech-to-speech/) [](./LICENSE) [](https://trendshift.io/repositories/20645) </div> A low-latency, fully modular voice-agent pipeline: **VAD -> STT -> LLM -> TTS**, exposed through an **OpenAI Realtime-compatible WebSocket API**. Every component is swappable. The LLM slot speaks OpenAI-compatible protocols, so you can point it at a hosted provider, at [HF Inference Providers](https://huggingface.co/inference-providers), or at a vLLM or llama.cpp server on your own hardware for a fully local, fully open stack. This pipeline runs in production as the conversation backend for thousands of [Reachy Mini](https://huggingface.co/blog/reachy-mini) robots. <p align="center"> <picture> <source media="(prefers-color-scheme: dark)" srcset="./docs/assets/endpoint-swap-dark.gif"> <source media="(prefers-color-scheme: light)" srcset="./docs/assets/endpoint-swap-light.gif"> <img src="./docs/assets/endpoint-swap-light.gif" alt="Switching an OpenAI Realtime client endpoint f
Computing & Technology, Computer Science, Artificial Intelligence