I have a write-up explaining BLEU, ROUGE, and BERTScore in Chapter 19 of my ML Q and AI book: https://
leanpub.com/machine-learni
ng-q-and-ai/
… Other than that, Lit-GPT has currently the Eleuther AI Evaluation Harness implemented: https://
github.com/Lightning-AI/l
it-gpt/blob/main/tutorials/evaluation.md
…

→ View original post on X — @rasbt,