Glad to see the level of interest. I figured tokenization was too boring for most! The results on 8xH100 will have to wait until tomorrow; with the latest nightly torchrun is crashing in DDP with exit code -11.

→ View original post on X — @alexjc