AI Dynamics

Global AI News Aggregator

About

Artificial Analysis useful but index lacks real-world validity

I think artificial analysis fills a useful spot in the ecosystem for independent assessment, but the index has very little validity compared to real world tasks. It is just lucky that basically every measure is correlated so you can pick any set of benchmarks and they kinda work

→ View original post on X — @emollick