The NVLM paper is outstanding. It is full of remarkable findings: (1) "dataset quality and task diversity are more important than scale", (2) positive transfer from multimodal datasets to text-only on math benchmarks, (3) model and data ablations, etc. Congrats to the authors on
NVLM Paper Reveals Dataset Quality Matters More Than Scale
By
–
