MULTIMODAL AI

Tarsier2: Advanced Video Understanding with Large Vision-Language Models

By

–

18 January 2025 18h38

Tarsier2: Advancing Large Vision-Language Models from Detailed Description to Comprehensive Understanding Tarsier2 is a state-of-the-art large vision-language model (LVLM) that excels in video description and understanding, improved by scaling pre-training data,

Do Generative Video Models Learn Physical Principles

By

–

18 January 2025 18h38

Do generative video models learn physical principles from watching videos? This paper explores whether generative video models learn physical principles by analyzing their performance on the Physics-IQ benchmark, which tests understanding of laws like fluid dynamics, optics, and

LLaVA-ST: Multimodal LLM for Spatial-Temporal Video Understanding

By

–

18 January 2025 18h38

LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding LLaVA-ST is a multimodal large language model designed for spatial-temporal understanding in videos, addressing challenges in coordinate alignment and feature compression. Problem:

Diffusion Model for Portrait Animation: Joint Depth and Appearance Learning

By

–

18 January 2025 18h38

Joint Learning of Depth and Appearance for Portrait Image Animation This research presents a diffusion-based generative model for joint learning of depth and appearance in portrait image animation, enabling consistent visual and 3D outputs for various applications. Problem:

GPT-4o Advances Face Presentation Attack Detection Few-Shot Learning

By

–

18 January 2025 18h38

Exploring ChatGPT for Face Presentation Attack Detection in Zero and Few-Shot in-Context Learning The paper investigates GPT-4o for Face Presentation Attack Detection (PAD), showing strong performance in few-shot in-context learning, outperforming specialized PAD models in

Weekly AI Breakthroughs: Detection, ChatGPT, and Web Navigation

By

–

18 January 2025 18h38

From uncovering physical laws in videos to animating portraits and navigating the web, this week’s AI research has brought even more breakthroughs! – Exploring ChatGPT for Face Presentation Attack Detection in Zero and Few-Shot in-Context Learning
– WebWalker: Benchmarking