I'd say it's not standard MLA but like with MLA + DeepSeek Sparse Attention in V3.2 it's MLA but with CSA/HCA (i.e., not plain MLA but they do keep the latent KV representation)
LLMS
-
Open-Weight Model Release Status and API Availability
By
–
Yes, but I couldn't find the open-weight version yet. I don't think it's released, yet (except for the API version)?
-
Gemini Engine Room Achieves Full Speed for Best-in-Class Coding
By
–
the engine room is running at full speed to make Gemini best in class at coding, progress is all positive : )
-
Small AI models optimization challenges and improvements
By
–
We'll do a push for that soon, even small models work, but far trickier to make sth that gives good results.
-
Qwen 3.5 Architecture: DeltaNet Linear Attention Impact
By
–
Let's dive deeper Do you know that 75% of Qwen 3.5 27B layers are DeltaNet (linear attention) and not softmax / full attention? Because of that, FlashAttention is only able to accelerates ~1/4 of the model
-
Claude Code Resource Bible: Developer Guide Released
By
–
That's a wrap, folks! A BIG kudos to @charliejhills for creating this incredible Claude Code Resource Bible. If you enjoyed this, please share it so others can benefit too. Follow me → @datachaz for more insights on LLMs, AI agents, and data science!
-
Claude Code Builders: Ultimate Resource Guide for Developers
By
–
CLAUDE CODE BUILDERS Bookmark this immediately. You'll thank me later. THIS is the ultimate resource bible for Claude Code, and I’ve curated all the links for you in this ↓
-
Understanding Transformers: Capabilities and Limitations Unveiled
By
–
When we finally figure out what transformers are doing we’ll be both amazed at how much it is and disappointed at how little.
-
TRINITY: An Evolved LLM Coordinator System
By
–
TRINITY: An Evolved LLM Coordinator https://
arxiv.org/abs/2512.04695 -
TRINITY: Advanced LLM Coordinator Framework Unveiled
By
–
TRINITY: An Evolved LLM Coordinator Paper: https://
arxiv.org/abs/2512.04695
OpenReview: https://
openreview.net/forum?id=5HaRj
Xai12
…