IIUC the previous training code at xai was super inefficient. Perhaps the 10x is comparing to that? So it's not really "jax vs C" but "crappy jax impl vs less crappy C impl"?

→ View original post on X — @jeremyphoward