Knowing all the development history, I'd say — JAX+XLA will be better on TPUs and slightly better on bf16 compatibility.
PyTorch will be better on NVIDIA and AMD GPUs, server-class and desktop-class CPUs, fp16 compat, vastly better on dynamic-shaped workloads.
They'll probably

→ View original post on X — @soumithchintala,