4/ Diving further, we found yet another serious implementation for evaluating on the very same MMLU dataset: the code used in the HELM benchmark https://
crfm.stanford.edu from @StanfordCRFM
: https://
github.com/stanford-crfm/
helm
… Let's call it the "HELM implementation"

→ View original post on X — @thom_wolf,