would you draw a wider conclusion such as "hardware portability"?
I read the paper and concluded "JAX + TPU is unbeatable". It's hard to conclude anything more general.
The paper doesn't cover any other set of hardware — AMD, Trainium, GraphCore, etc.

→ View original post on X — @soumithchintala,