Are LLM leaderboards no longer trustworthy? @cohere
's deep dive reveals how Chatbot Arena scores can be gamed Providers test 10–27 private models & submit the best Proprietary models receive 2–3× more data Rankings may reflect overfitting Trending on alphaXiv
LLM Leaderboards Gaming: Chatbot Arena Scoring Integrity Questioned
By
–
