After benchmarking more than 80 LLMs, @zimmskal & team found that the best model isn't always a great match for your programming language. Google's Gemini Pro 1.5 worked well for Go, but not so much for Java & Ruby, for example. The best overall LLM was Anthropic’s Sonnet 3.5.

→ View original post on X — @mit_csail,