(Except that GPT3 is not trained on C4 per se @Francis_YAO_ but it’s a small tweak)

→ View original post on X — @thom_wolf