"DeepSeek-V4 Technical Report" A 58 page paper with brand new attention techniques: Heavily Compressed Attention (HCA) & Compressed Sparse Attention (CSA). This hybrid attention setup enables V4 to hit 1 million context. DeepSeek-V4-Pro is now the largest OS model ever, with

→ View original post on X — @askalphaxiv,