oh yea i just saw that. not sure what happened. but in general back at G we mainly looked at MMLU and Bigbench as key metrics. that said, i also don't have any access to investigate anything now as im not at G anymore.

→ View original post on X — @yitayml