Distill Whisper uses knowledge distillation to train a smaller model to achieve 99% accuracy of a larger one with 2% data, aiming for real-time AI voice applications without delays.

→ View original post on X — @whats_ai,