The Dawn of Generation: Preliminary Explorations with SORA-like Models https://
arxiv.org/pdf/2410.05227 https://
ailab-cvc.github.io/VideoGen-Eval/
MULTIMODAL AI
-
SORA-like Video Generation Models: Preliminary Evaluation Framework
By
–
-
Molmo Authors Discussion Direct Engagement Opportunity Available
By
–
Discuss Molmo with the authors directly here: https://
alphaxiv.org/abs/2409.17146
v1
… -
Augmented Reality Supermarket Navigation Tool Guide
By
–
Cansado de dar vueltas en el supermercado buscando los productos que deseas comprar? Esta herramienta con realidad aumentada te guía dentro de la tienda para que encuentres eso que buscas.
— Juan Merodio (@juanmerodio) 15 octobre 2024
Sencillamente genial! pic.twitter.com/pYnSqdcri8Cansado de dar vueltas en el supermercado buscando los productos que deseas comprar? Esta herramienta con realidad aumentada te guía dentro de la tienda para que encuentres eso que buscas. Sencillamente genial!
-
Create talking avatars on Apob: step-by-step tutorial
By
–
Avatars parlants :
— Jouhatsu | AI Influence Operator (@Jouhatsu_ai) 14 octobre 2024
Vous pouvez également créer des avatars parlants sur Apob comme je l'ai fait ici.
Voici comment :https://t.co/kEWuDmubY2
1. Accédez à votre profil d'influenceur IA
2. Cliquez sur « Avatar parlant »
3. Sélectionnez une image que vous avez générée
4.… pic.twitter.com/rCdPO9qi4NTalking avatars: You can also create talking avatars on Apob as I did here. Here's how: http://
mega.apob.ai/Jouhatsu25 1. Access your AI influencer profile
2. Click on "Talking avatar"
3. Select an image you generated
4. -
Three-step face swap procedure
By
–
Pour effectuer l'échange de visage :
— Jouhatsu | AI Influence Operator (@Jouhatsu_ai) 14 octobre 2024
1. Créer un modèle de portrait
2. Cliquez pour télécharger l'image
3. Échange de visage vidéohttps://t.co/kEWuDmubY2 pic.twitter.com/fUWUYAeRJITo perform face swap: 1. Create a portrait model
2. Click to download the image
3. face swap http://mega.apob.ai/Jouhatsu25 -
LLaVA-Critic: Open-Source Multimodal Model Evaluator
By
–
LLaVA-Critic: Learning to Evaluate Multimodal Models https://
arxiv.org/abs/2410.02712 https://
llava-vl.github.io/blog/2024-10-0
3-llava-critic/
…
the first open-source large multimodal model (LMM) designed as a generalist evaluator to assess performance across a wide range of multimodal tasks. -
LlaMa-Omni: Real-time Speech LLM Model Rivals GPT-4o
By
–
Introducing LlaMa-Omni, a new model rivaling GPT-4o for real-time speech interaction with LLMs. This simultaneously generates text and speech directly from speech instructions, with a response latency as low as 226ms. Excited to have the author @Poeroz1204 discussing the work!
-
AI Rendering Optimization: 2-5x Speed Improvement via Upscaling
By
–
It already runs 10 fps, so I believe another speed up of 2-5x should be realistic. Also, maybe they car render it in lower resolution and with sparse pixels, and then use some fast upscaling and denosing to get to 4k. I think the biggest problem is consistency over longer time
-
Physics-Guided Diffusion Predicts Human Movement Nine Seconds Ahead
By
–
How far ahead can we predict a human's movements? We tokenize human poses over time and use physics-guided diffusion to predict a person's trajectory and location up to 9 seconds ahead. Paper: https://
arxiv.org/abs/2405.19528 -
Vision Language Model Achieves High Precision Emotion Recognition
By
–
Is emotion recognition in the wild possible? This is a hard problem, especially considering context. We fine-tuned a vision language model with 26 categories and found a very high precision, bringing it closer to use on robots. https://
arxiv.org/abs/2405.08992 https://
yasaman-etesam.github.io/Contextual-Emo
tion-Recognition/
…