7/ Red Teaming Visual Language Models – finds that 10 prominent open-sourced VLMs struggle with red teaming and have up to 31% performance gap with GPT-4V; applies red teaming alignment to LLaVA-v1.5 with SFT to improve performance by 10%.

→ View original post on X — @dair_ai