Looks like Google was using some tricks again to push its benchmarks on chatbot arena. However, it's loosing on LiveBench against Sonnet 3.5 and o1-preview. Somehow I am not surprised. I somehow didn't expect it to beat o1 and Sonnet either. It seems to be at least a little bit
Google’s Benchmark Tricks and Performance Loss to Competitors
By
–
