Category
Voice & audio
Agents that listen and speak: real-time voice assistants and phone agents, speech-to-text and transcription tools built on models such as Whisper, text-to-speech and voice cloning, and music and sound generation.
1,779 agents · 4 subcategories · mostly Python, Typescript, Javascript
Voice & audio by type
- pipecat · Open Source framework for voice agents, multimodal apps, and realtime AI. Mainta
- agents · A framework for building realtime voice AI agents 🤖🎙️📹
- speech-to-speech · Build voice agents with open-source models
- whisper · Robust Speech Recognition via Large-Scale Weak Supervision
- whisper.cpp · Port of OpenAI's Whisper model in C/C++
- faster-whisper · Faster Whisper transcription with CTranslate2
- bark · 🔊 Text-Prompted Generative Audio Model
- YuE · YuE2: frontier music generation with symbolic planning, zero-shot covers, and ag
- podcastfy · An Open Source Python alternative to NotebookLM's podcast feature: Transforming
- ChatTTS · A generative speech model for daily dialogue.
- CosyVoice · Multi-lingual large voice generation model, providing inference, training and de
- CosyVoice · Multi-lingual large voice generation model, providing inference, training and de
Every agent in Voice & audio, most starred first
Robust Speech Recognition via Large-Scale Weak Supervision
Port of OpenAI's Whisper model in C/C++
A generative speech model for daily dialogue.
🔊 Text-Prompted Generative Audio Model
Faster Whisper transcription with CTranslate2
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.
A framework for building realtime voice AI agents 🤖🎙️📹
A multi-voice TTS system trained with an emphasis on quality
Build voice agents with open-source models
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.
Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces
Open-source framework for conversational voice AI agents
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
Quickly build text, voice and video agents. Fast, Go based Agent backend with SDKs for every language. Sensible defaults for search, knowledge, skills, telephony, sandboxes, memory and persistence. Sovereign AI. Take control of your AI.
Transcribe on your own!
🤖 wukong-robot 是一个简单、灵活、优雅的中文语音对话机器人/智能音箱项目,支持ChatGPT多轮对话能力,还可能是首个支持脑机交互的开源智能音箱项目。
This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API.
An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI
Send a phone call from AI agent, in an API call. Or, directly call the bot from the configured phone number!
视频转字幕、字幕翻译、AI 配音与声音克隆、字幕烧录——免费开源的一站式桌面工具。基于 Whisper / FunASR 等本地模型离线语音转文字,批量处理 + 全平台 GPU 加速,跨 Windows / macOS / Linux。Free, open-source desktop app to generate, translate, dub & burn video subtitles — local Whisper speech-to-text, AI dubbing & voice cloning, offline, GPU-accelerated.
Ears for coding agents: let AI hear, review and make sound. CPU-only, open source.
The #1 open-source voice interface for desktop, mobile, and ESP32 chips.
A nearly-live implementation of OpenAI's Whisper.
🤖 Build voice-based LLM agents. Modular + open source.
React app for inspecting, building and debugging with the Realtime API
Instantly generate AI-powered subtitles on your device. Works standalone or connects to DaVinci Resolve.
Use API to call the music generation AI of suno.ai, and easily integrate it into agents like GPTs.
A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, MusicGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, and Bark!
A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents
Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.
faster_whisper GUI with PySide6
Open-source meeting transcription API for Google Meet, Microsoft Teams & Zoom. Auto-join bots, real-time WebSocket transcripts, MCP server for AI agents. Self-host or use hosted SaaS.
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
💬 SpeechGPT is a web application that enables you to converse with ChatGPT.
Voice AI SDK is a reusable Android library that gives any app a full voice-driven AI conversation pipeline in minutes. Voice Assistant + Android Voide AI + SDK + MVVM + Kotlin
Voice AI SDK is a reusable Android library that gives any app a full voice-driven AI conversation pipeline in minutes. Voice Assistant + Android Voide AI + SDK + MVVM + Kotlin
🔊 Awesome list for Whisper — an open-source AI-powered speech recognition system developed by OpenAI
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
Baresip is a modular SIP User-Agent with audio and video support
OpenVidu Platform: self-hosted real-time video and audio for your apps, built on LiveKit and mediasoup
Realtime Voice AI with 100+ Models on Arduino ESP32 with Secure Websockets & Edge Functions for AI Toys, Desk Companions and Devices
EPUB to audiobook converter, optimized for Audiobookshelf, WebUI included
Self hosted, real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.
The Self-Coding System for Your App — Alan AI SDK for iOS
百聆 是一个类似GPT-4o的语音对话机器人,通过ASR+LLM+TTS实现,集成DeepSeek R1等优秀大模型,接入openClaw,真正的个人语音助手,时延低至800ms,Mac等低配置也可运行,支持打断
一个基于小智、xiaozhi-server的Android、IOS语音对话应用,支持实时语音交互和文字对话。现在是flutter版本,打通IOS、Android端。请同志们动动小手,点点小星星,予以鼓励。
Personal internet radio: Agentic AI DJ
Real-time two-way speech translation for bilingual meetings — auto-detects the spoken language and translates both directions, cloud or fully offline on-device. Desktop (Windows · macOS · Linux) + browser extension (Chrome · Edge) for Zoom, Meet, Teams & any app.
Natural voice conversations with Claude Code
Using OpenAI's Whisper to automatically generate YouTube subtitles
An AI-powered interactive avatar engine using Live2D, LLM, ASR, TTS, and RVC. Ideal for VTubing, streaming, and virtual assistant applications.
Whisper command line client compatible with original OpenAI client based on CTranslate2.
ChatdollKit enables you to make your 3D model into a chatbot
An open-source AI Voice Agent that integrates with Asterisk/FreePBX using Audiosocket/RTP/Websocket technology https://demo.agent6789.com
Steno is the AI notepad for all your confidential conversations. On Windows & MacOS. Perfect for government, defence, legal and CXOs.
The Self-Coding System for Your App — Alan AI SDK for Cordova
AI Vtuber for Streaming on Youtube/Twitch
The open-source iOS app that's making quality voice transcription more accessible on mobile devices.
💬📝 A small dictation app using OpenAI's Whisper speech recognition model.
Build realtime AI voice agents using FastRTC for low-latency streaming, Superlinked for vector search, Twilio for live phone calls, and Runpod for scalable GPU deployment.
Open-source voice-AI SDK. The Vapi/Retell alternative for builders who want to own the stack. Give your AI agent a phone number in 4 lines — Python and TypeScript, MIT licensed, Twilio, Telnyx, and Plivo.
AI phone assistant | open-source
Open source voice dictation technology
Node.js + JavaScript reference client for the Realtime API (beta)
JARVIS — a voice assistant for Claude Code. Talk to your Mac and he brainstorms a project with you, builds it, and tells you out loud when a Claude Code session needs you. macOS, on your Claude subscription, no API key.
A complete voice AI frontend app for LiveKit Agents with Next.js
A talking LLM that runs on your own computer without needing the internet.
Open-source (Apache 2.0) voice tool for Claude Code and Codex on macOS that reads your coding agent's progress aloud. The voice runs locally with Kokoro, no account needed, or bring your own ElevenLabs or Speechify key. Hear a short spoken summary when your agent finishes, fails or needs approval.
Build realtime multimodal AI agents with Node.js
Open-source real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.
Build real time speech2text web apps using OpenAI's Whisper https://openai.com/blog/whisper/
Conversational voice AI agents
Command Your World with Voice
React Native binding of whisper.cpp.
Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
React hook for OpenAI Whisper with speech recorder, real-time transcription, and silence removal built-in
🎤 The easiest way to transcribe audio in Swift
Running speech to text model (whisper.cpp) in Unity3d on your local machine.
Rapida is an open-source, end-to-end voice AI orchestration platform for building real-time conversational voice agents with audio streaming, STT, TTS, VAD, multi-channel integration, agent state management, and observability.
Local AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.
TTSFM mirrors OpenAI's TTS service, providing a compatible interface for text-to-speech conversion with multiple voice options for free.
Self-hosted API-first AI call center: AI talks, code controls the call. AI agents answer every call; humans take over without dropping it. Runs on FreeSWITCH with your SIP trunk and realtime model (OpenAI, Grok, Qwen, Doubao, or any compatible gateway).
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, etc.)
Offline Speech Recognition with OpenAI Whisper and TensorFlow Lite for Android
Example scripts for AI agents created with the Alan AI Platform.
Multi-modal voice agent for your AI agents. Talk with Claude Code, Codex, and others by voice: answer their prompts, give instructions, ask what they did. Or just nod.
Real-time transcription using faster-whisper
Open Source Voice Agent Platform
A conversational, AI device + software framework for companionship, entertainment, education, healthcare, IoT applications, and DIY robotics. Built with Python, NextJS, Arduino, ESP32, LLMs (GPT-4o), Deepgram STT and Azure TTS 🤖
Effortlessly add AI-generated transcription subtitles to your videos
Pocket-sized AI chatbot built using a RPI Zero 2w / 5
Your own personal voice assistant: Voice to Text to LLM to Speech, displayed in a web interface
Mac compatible Ollama Voice
Open-source, self-hostable platform for building and operating AI phone agents.
Build AI phone agents on your own computer and test every change with an AI caller. Open source, runs free with no API keys, cents per call with your own keys. Imports Dialogflow CX.
Gemini Live provides multimodal realtime agent capabilities. Build voice agents that can process vision and text in realtime.
Questions
What makes a voice agent feel real-time?
Low latency at every hop: streaming speech recognition, a model that starts answering before the user finishes, and streaming speech synthesis. Most voice agent frameworks are built around that pipeline.
Is voice cloning allowed?
Laws differ by country and use. Only clone voices you have permission to use; several projects here ship consent checks or watermarking.