“TIPSv2: Advancing Vision-Language Pretraining with Enhanced Patch-Text Alignment” This paper propose a foundational image-text encoder with spatial awareness, as VLMs are usually good at describing an image but much worse at grounding where the concepts live. What they found

→ View original post on X — @askalphaxiv