check out whisper-turbo to speech to speech real-time here:
MULTIMODAL AI
-

Comprehensive AI Taxonomy and Classification Categories
By
–
Cela pourrait aider pas mal de personnes :
-
OpenAI Voice APIs Enable New Generation Speech Applications
By
–
AI needs UI, and OpenAI's impressive new voice APIs open up a lot of possibilities. Congrats @OpenAI team — we'll soon be seeing a whole new generation of speech applications!
-
OpenAI real-time speech API threatens 20 million call center jobs
By
–
OpenAI just announced a real-time speech API (advanced voice mode) at Dev Day. The “speech wrappers” are coming to replace 20 million global call center jobs…
-

Emu3: single model handles text, images, and videos
By
–
> Emu3: Next-token prediction conquers multimodal tasks This is the most important research in months: we’re now very close to having a single architecture to handle all modalities. The folks at BAAI just released Emu3, a single model that handles text, images, and videos all
-

Mistral AI Releases Pixtral-12B Multimodal Model
By
–
Pixtral-12B: Mistral AI’s First Multimodal Model: Introduction Mistral has released its very first multimodal model, namely the Pixtral-12B-2409. This… https://
analyticsvidhya.com/blog/2024/09/p
ixtral-12b/?utm_source=dlvr.it&utm_medium=twitter
… #DataAnalytics #DataScience #DataDriven #IoT #MachineLearning #ITManager #SaaS #ArtificialIntelligence -

Google DeepMind Showcases Imagen-3 Media Generation at ECCV2024
By
–
Today at 10:30am CEST at the #ECCV2024 Google booth, don’t miss a demo session on Google DeepMind’s media generation models. The demo will feature AI Test Kitchen, a tool that showcases experimental AI features. Learn more at: https://
deepmind.google/technologies/i
magen-3/
… -
NVIDIA NVLM-D-72B Model Release on Hugging Face
By
–
model: https://
huggingface.co/nvidia/NVLM-D-
72B
… -

Nvidia Releases NVLM-1.0-D-72B Multimodal Language Model
By
–
Nvidia releases NVLM-1.0-D-72B frontier-class multimodal LLM with decoder-only architecture SOTA results on vision-language and text-only tasks
-
Discussion on Advanced Voice Mode functionality
By
–
The widget is not but the Advanced voice mode part was