"On the Surprising Effectiveness of a Single Global Merging in Decentralized Learning” This paper shows that in non-IID decentralized SGD, a single final global merge can substantially improve global test performance under severe communication constraints, even recovering much

→ View original post on X — @askalphaxiv,