This article from Minimax adds a small Index Branch to GQA that selects the k most relevant KV blocks per group, then executes an exact softmax only on these blocks, making sparsity native to the GPU, with an exp-free TopK and kernels.

→ View original post on X — @askalphaxiv