AI Dynamics

Global AI News Aggregator

About

Google’s Benchmark Tricks and Performance Loss to Competitors

Looks like Google was using some tricks again to push its benchmarks on chatbot arena. However, it's loosing on LiveBench against Sonnet 3.5 and o1-preview. Somehow I am not surprised. I somehow didn't expect it to beat o1 and Sonnet either. It seems to be at least a little bit

→ View original post on X — @kimmonismus