The Arxiv for the new Decoupled DiLoCo paper is now up:

→ View original post on X — @jeffdean,