Less publicized but highly awesome aspect of GPT-4 launch was that OpenAI open sourced an evals framework, allowing us to crowdsource model evaluations at scale . The repo is getting some very high quality PRs (rewarded with GPT-4 access). I <3 evals; `pip install evals` https://
x.com/kondrich2/stat
/kondrich2/status/1635687409668227072
…
OpenAI Open Sources Evals Framework for GPT-4 Model Evaluation
By
–