Florence-VL A multimodal large language model (MLLM) that integrates enriched visual representations from Florence-2 for improved vision-language alignment. Problem: Existing vision-language models (VL) are limited by less versatile visual representations and the need for
RESEARCH
-
FLOAT: Expressive Talking Portrait Generation from Audio
By
–
FLOAT A method for generating expressive, temporally consistent talking portrait videos from a single image and audio. Problem: Audio-driven talking portrait generation faces challenges in creating temporally consistent motion and efficient sampling while maintaining
-
Navigation World Models: Video Generation for Autonomous Agent Planning
By
–
Navigation World Models A controllable video generation model that predicts future visual observations for navigation tasks based on past observations and actions. Problem: Visual-motor agents struggle with planning flexible navigation trajectories, especially in dynamic or
-
Open-Sora Plan: Open-Source High-Resolution Video Generation
By
–
Open-Sora Plan: Open-Source Large Generation Model An open-source framework for generating high-resolution, long-duration videos from diverse user inputs. Problem: Existing video generation models struggle with high-resolution, long-duration video outputs due to high
-
Latest AI Papers: Navigation Models and Video Generation
By
–
Trending AI papers on alphaXiv this week, featuring an incredible week for the computer vision and multimodal communities – Navigation World Models (discussion with author @_amirbar
)
– Open-Sora Plan: Open-Source Large Generation Model (discussion with author -
PhD Student Discovers Lost City Using LiDAR Dataset Analysis
By
–
I wouldn’t be surprised at all tbh. This PhD student bothered to look at a LiDAR dataset that had been sitting online since 2013 and found a lost city lmao https://t.co/3Zvj1UGSiL
— Bilawal Sidhu (@bilawalsidhu) 8 décembre 2024I wouldn’t be surprised at all tbh. This PhD student bothered to look at a LiDAR dataset that had been sitting online since 2013 and found a lost city lmao
-
From Skeptic to RL Enthusiast: A Two-Year Transformation
By
–
2022: I never wrote a RL paper or worked with a RL researcher. I didn’t think RL was crucial for AGI Now: I think about RL every day. My code is optimized for RL. The data I create is designed just for RL. I even view life through the lens of RL Crazy how quickly life changes
-
ARC Prize v2 announcement: From Davos 2022 to final release
By
–
The first time I publicly announced the v2 was actually… in May 2022 in Davos. Back then it was a joint effort with Lab42, now it's handled by the ARC Prize foundation. We certainly took a while to ship, but the results are worth the extra effort.
-
ARC Prize 2024 Technical Report Released
By
–
Link: https://
arcprize.org/media/arc-priz
e-2024-technical-report.pdf
… -
ARC Prize 2024 report and upcoming v2 benchmark for 2025
By
–
If you haven't read the ARC Prize 2024 technical report, check it out (link in next tweet). One important bit: we'll be releasing a v2 of the benchmark early next year (human testing is currently being finalized). Why? Because AGI progress in 2025 is going to need a better