This is already supported in the latest releases of Transformers and Accelerate, so you can try it today if you install PyTorch from the nightlies!

→ View original post on X — @huggingface