This demo produced by @google and @huggingface to showcase the capabilities of TPU v5e on Google Cloud. I guess TPUs are still currently the only option apart from NVIDIA that are proven to work at scale. Blog post:

→ View original post on X — @hardmaru,