lol kind of. it was nontrivial for me to combine DDP, bf16, gradcache, and accelerate. maybe we could work together

→ View original post on X — @jxmnop