Speech and audio tools
Projects that work with sound, such as turning speech into text, reading text aloud, cloning voices or generating music. This page lists 34 speech, voice and audio projects; the latest additions are Handy, LFM3-Omni-2B and LFM3-Audio-2B. Open any project to see what it lets you do, what its creator says you need and its original source.
Projects to explore
- xiaozhi-esp32 build a talking AI voice assistant on a small ESP32 board
Flash firmware onto an ESP32 board and talk to an AI that can answer and control lights or servos.
- Hex Dictate by voice and paste text into any app
Hold a shortcut, speak, and have your words typed into whatever app you are using.
- r2d2-tv Add a voice assistant and private browser to webOS TVs
Add a local home screen, private browser and push-to-talk voice commands to a rooted webOS TV.
- OpenMontage Have your coding assistant research, edit and render a video
A set of pipelines that turn an AI coding assistant into a video production line: you describe the video you want in plain language and the agent researches the topic, writes a script, gathers or generates footage, cuts a timeline and renders the result.
- Handy Dictate into any text field with offline speech-to-text
Handy lets you press a shortcut, speak, and see your words appear in any text field, transcribed on your own computer.
- ComfyUI Build image, video and audio AI workflows by linking nodes
Build image, video, audio and 3D generation workflows by connecting blocks on a graph; for creators who want control, on Windows, Linux or macOS.
- VoiceStudio Clone your voice and dub a video, all on your own computer
VoiceStudio is a desktop app for generating speech in a chosen voice without sending anything to a company: give it a clean reference recording, type your text, and it generates the audio, with separate workspaces for dubbing video and for designing a brand-new voice from a written description instead of a sample.
- Transformers Load and run almost any open AI model from one Python library
The Python library that defines how open models are written down, covering text, images, audio, video and combinations of them, for both running a model and training one.
- Voicebox Clone a voice, dictate anywhere, and give agents a voice
A local voice studio that covers both halves of speech: going out and coming in.
- Concat Edit videos with auto captions and AI voices offline
Cut videos and add auto captions, voices and effects on your own computer.
- Audionaut Edit and record multitrack audio, and let an AI agent make the cuts
Audionaut is a free desktop audio editor for music, podcasts and multitrack recordings: cut audio into regions, arrange them in per-track playlists, add crossfades and export, without the weight of a full music studio app.
- Open Notebook Chat with, search and make podcasts from research
Collect PDFs, videos and web pages, then search, chat and make podcasts from them.
- MarkItDown Convert PDFs, Word files and slides into plain Markdown
Turn PDFs, Word files, slides, spreadsheets, images and audio into Markdown text that an AI model can read.
- YuE Generate a song, then edit its melody and chords before rendering
YuE2 is a music generation system that writes a song in two visible steps: given lyrics and a style description, it first produces a melody-and-chord plan in ordinary notation, then turns that plan into finished audio with vocals and backing.
- Whisper Transcribe or translate recorded speech
Turn recorded speech into transcripts, translated English text, or a spoken-language label.
- OpenWhispr Turn your voice into text with a hotkey
OpenWhispr lets you press a hotkey, speak, and see your words typed at your cursor, for people who dictate, take notes or transcribe meetings.
- AI Engineering Hub Learn AI by building example projects
Learn to build AI apps through example projects, from reading text in images to chatting with your documents.
- OpenMAIC Turn any topic into an interactive AI classroom
Turn a topic or document into slides, quizzes and discussions led by AI teachers.
- AutoClip Turn long videos into short, shareable highlight clips
AutoClip is a desktop app that watches a long video — a podcast, stream or lecture — and automatically finds and cuts the moments worth sharing, using an AI model you connect (you choose the provider in settings).
- Audio8-ASR-Infinite Transcribe speech live, continuously, with no length limit
Audio8 ASR Infinite is a speech-to-text model built for real-time, unlimited-length transcription rather than processing a finished audio file after the fact.
- drama-3 Generate multi-speaker audio (35B, 3B active)
Turn text into multi-speaker speech with voice cloning and continuation controls.
- EmbeddingGemma 2 Search text, images, audio and video in one shared space
A 740-million-parameter embedding model from Google DeepMind that turns text, code, images, video and audio into vectors in one shared 768-dimensional space.
- LTX-2.5 Generate video with matching sound from text or a photo
LTX-2.5 is a 22-billion-parameter open-weights model from Lightricks that generates video and sound together: describe a scene in words, or hand it a photo, and it produces a clip with a soundtrack in one pass, so picture and audio stay in sync.
- LFM3-Audio-2B Transcribe, speak and chat by voice (2B)
For developers building voice apps: LFM3-Audio-2B turns speech into text, text into speech, and answers spoken questions in text or voice.
- LFM3-Omni-2B Ask about photos, video and speech by voice (2.17B)
For developers building voice apps: LFM3-Omni-2B answers questions about photos, video and audio, and replies in text, speech or both.
- YuE2-3B Turn lyrics into a song with a score you can edit
Give it lyrics and a note about the style and it generates a song with vocals and backing.
- Muse-Spark-Open-816B-A42B Ask about screenshots, charts and code bugs
Send a screenshot, chart or document and get a written explanation, or hand it a bug to fix.
- MiniMax-H3 Make short videos with synced sound from text or images
Generate 4–15 second videos with built-in stereo sound from text, images, video or audio, through an online API, web app or desktop app.
- Nemotron-3-Diarization Label who spoke when in any audio recording
Nemotron-3-Diarization is an open-weight model from NVIDIA that does speaker diarization — working out "who spoke when" in a recording — for up to eight speakers.
- NVIDIA-Nemotron-3.5-Transcribe-30B-A4B Transcribe hour-long recordings (34B)
Transcribe recordings up to an hour long in 40 languages, with speaker labels and timestamps, or translate speech.
- MiMo-V2.6-Flash-RL Use Xiaomi MiMo-V2.6's efficiency-balanced model for agent work
Give one model text, images, video or audio, with up to a million tokens of context such as a whole code repository or a long tool log, and get text back for coding and agent work.
- MiMo-V2.6-Pro-RL A large model trained on coding, agents, vision and security tasks at once
MiMo-V2.6-Pro-RL is Xiaomi's flagship model in the MiMo-V2.6 family, reading and generating text, images, video and audio in one model with a 1-million-token context for handling large codebases or long multi-session agent work.
- yue2-hum-to-song Hum a tune for 30 seconds and get back a finished song
Hum to Song takes a hummed melody (10 to 30 seconds), plus a style line and lyrics you provide, and turns it into a produced song that keeps your original tune and builds a full structure around it.
- nemotron-diarization See who's speaking and when, live from your microphone
Live Speaker Diarization is Nvidia's browser demo for figuring out “who spoke when” in audio: start your microphone or upload a short recording, and it labels overlapping speaker turns in near-real time, showing speaker-activity lanes alongside a live transcript.
Keep exploring
- AI coding assistants
- Image and video generation tools
- Software projects
- AI models
- Assistant skills
- Learning resources
- Software libraries
- Workflow collections
- AI agents and agent tools
- MCP tools and integrations
- Text generation models and tools
- Image and document understanding
- Image generation tools
- Video generation tools
- Developer tools
- Command line tools
- Desktop apps
- Self-hosted tools
- Local-first tools
- Retrieval and search tools
- Machine learning resources and tools
- Automation tools and workflows
- Browser automation tools
- Security tools and resources
- Writing and editing tools
- Document tools
- Agent memory tools
- Code review tools
- Design tools, skills and resources
- Games and simulations
- 3D tools
- Model training tools and resources
- Model inference tools
- Research tools and resources
- Productivity tools
- Data and database tools
- Project collections
- AI projects, explained
- Decision models, explained
- Local AI models, explained
- Claude Code skills and plugins, explained
- Sell it as a service
- Trending AI projects this week, explained
- New on BuildTube by week
- New on BuildTube: 2026-45
- New on BuildTube: 2026-44
- New on BuildTube: 2026-43
- New on BuildTube: 2026-42
- New on BuildTube: 2026-41
- New on BuildTube: 2026-40
- New on BuildTube: 2026-39
- New on BuildTube: 2026-38
- AI projects added to BuildTube, week of 2 November 2026
- AI projects added to BuildTube, week of 26 October 2026
- AI projects added to BuildTube, week of 19 October 2026
- AI projects added to BuildTube, week of 12 October 2026
- AI projects added to BuildTube, week of 5 October 2026
- AI projects added to BuildTube, week of 28 September 2026
- AI projects added to BuildTube, week of 21 September 2026
- AI projects added to BuildTube, week of 14 September 2026
- Local language model runners
- Self-hosted AI chat alternatives
- Coding agent skills and add-ons
- AI coding agent workflows
- AI video creation tools
- Image generation and editing tools
- AI audio and music tools
- AI assistants that run locally
- Run image generation locally
- Memory tools for AI agents
- Tools for coordinating AI agents