OPEN SOURCE

Microsoft did it again!

Speech AI models have a major limitation.

They slice long recordings into tiny chunks, lose track of who's speaking, and forget all context halfway through.

This is exactly what Microsoft's VibeVoice solves.

It's an open-source family of frontier voice… pic.twitter.com/YaXz1O9IQw

— Akshay 🚀 (@akshay_pachaar) 29 mars 2026

Microsoft did it again! Speech AI models have a major limitation. They slice long recordings into tiny chunks, lose track of who's speaking, and forget all context halfway through. This is exactly what Microsoft's VibeVoice solves. It's an open-source family of frontier voice AI models for both speech recognition and speech generation. Here's what it can do: > VibeVoice-ASR processes up to 60 minutes of audio in a single pass. No chunking. It outputs structured transcriptions with who spoke, when they spoke, and what they said. > You can feed it custom hotwords like names, technical jargon, or domain-specific terms. The model uses them to significantly improve accuracy on specialized content. > VibeVoice-TTS generates up to 90 minutes of multi-speaker speech with up to 4 distinct speakers. Natural turn-taking, emotional expression, all in one pass. > VibeVoice-Realtime is a 0.5B streaming TTS model with ~300ms first-audio latency. Small enough to deploy practically anywhere. All of this is powered by continuous speech tokenizers running at just 7.5 Hz. This ultra-low frame rate preserves audio quality while making long sequences computationally feasible. I have shared the link to the GitHub repo in the replies!

→ View original post on X — @akshay_pachaar, 2026-03-29 13:11 UTC