Looks good! Would love to play with this someday. Although I think it would be hard to dethrone t5x + seqio as the best LLM training framework.

→ View original post on X — @yitayml