10/ AudioPaLM – fuses text-based & speech-based LMs, PaLM-2 and AudioLM, into a multimodal architecture; outperforms existing systems for speech translation tasks and has zero-shot speech-to-text translation capabilities.

→ View original post on X — @dair_ai