Incredible work, Aditya! Congrats to you and the Sora team for shipping something truly magical today. Stunning!
MULTIMODAL AI
-
Sora’s Video Generation Could Transform Computing Interfaces
By
–
Sora is amazing. If you extrapolate the scaling trend in video generation, in a decade using a computer will just be interacting with a sora model, which is crazy to even think about (not sure if it will come true) https://t.co/UNx7HX6muQ
— Jason Wei (@_jasonwei) 9 décembre 2024Sora is amazing. If you extrapolate the scaling trend in video generation, in a decade using a computer will just be interacting with a sora model, which is crazy to even think about (not sure if it will come true)
-
Early Video Generation Product Enables Compelling Collaborative Co-Creation
By
–
one of the most exciting things to me about this product is how easy it is to co-create with others; it feels like an interesting new thing! this is early–think of it like GPT-1 for video–but i already think the feed is so compelling.
-
OpenAI launches Sora tonight, but not in France
By
–
Well apparently @OpenAI is releasing #Sora tonight. But not in France… I'll try to get access after the keynote and if I succeed, I'll give you a demo!
-
Scaling Speech-Text Pre-Training with Synthetic Interleaved Data
By
–
Scaling Speech-Text Pre-Training with Synthetic Interleaved Data A method for scaling speech language models (SpeechLMs) by using synthetic speech-text interleaved data, bypassing the need for parallel speech-text datasets. Problem: Limited unsupervised speech and parallel
-
NVILA: Efficient Frontier Visual Language Models
By
–
NVILA: Efficient Frontier Visual Language Models A family of efficient and accurate visual language models that optimize processing high-resolution images and long videos. Problem: While VLMs have advanced in accuracy, their efficiency remains a significant challenge,
-
PaliGemma 2: Versatile Vision-Language Models for Transfer
By
–
PaliGemma 2: A Family of Versatile VLMs for Transfer An upgraded vision-language model family optimized for transfer tasks across various domains and resolutions. Problem: Previous VLMs lacked versatility in model size, resolution, and task-specific transfer capabilities,
-
Motion Prompting Framework for Precise Video Generation Control
By
–
Motion Prompting for Generation A flexible motion control framework for generating videos with precise spatio-temporal dynamics through motion prompts. Problem: Existing video generation models lack nuanced control over dynamic actions and temporal compositions,
-
Florence-VL: Enhanced Multimodal Vision-Language Model
By
–
Florence-VL A multimodal large language model (MLLM) that integrates enriched visual representations from Florence-2 for improved vision-language alignment. Problem: Existing vision-language models (VL) are limited by less versatile visual representations and the need for
-
FLOAT: Expressive Talking Portrait Generation from Audio
By
–
FLOAT A method for generating expressive, temporally consistent talking portrait videos from a single image and audio. Problem: Audio-driven talking portrait generation faces challenges in creating temporally consistent motion and efficient sampling while maintaining