Audio LMs scene is heating up! 🔥 @FixieAI Ultravox 0.4.1 – 8B model approaching GPT4o level, pick any LLM, train an adapter with Whisper as Audio Encoder, profit 💥

Bonus: MIT licensed checkpoints

> Pre-trained on Llama3.1-8b/ 70b backbone as well as the encoder part of… pic.twitter.com/uB6FNJZvRb

— Vaibhav (VB) Srivastav (@reach_vb) 16 novembre 2024

Audio LMs scene is heating up! @FixieAI Ultravox 0.4.1 – 8B model approaching GPT4o level, pick any LLM, train an adapter with Whisper as Audio Encoder, profit Bonus: MIT licensed checkpoints > Pre-trained on Llama3.1-8b/ 70b backbone as well as the encoder part of

→ View original post on X — @reach_vb