Interestingly, VLMs perform better with plot alone compared to plot + data! This paper shows that GPT‑4.1 and Claude 3.5 excels at scatterplot analysis, and could often perform better only by looking at the plot, without reading the actual numerical data.
VLMs Outperform with Visual Data Alone Over Numerical
By
–
