Let's dive deeper Do you know that 75% of Qwen 3.5 27B layers are DeltaNet (linear attention) and not softmax / full attention? Because of that, FlashAttention is only able to accelerates ~1/4 of the model
RESEARCH
-
AI Model Blocked for Poor Causal Understanding
By
–
blocked for poor causal understanding of the world
-
DeepMind Transforms Artificial Intelligence: The Thinking Game
By
–
The Thinking Game – How DeepMind Transformed Artificial Intelligence
#AI #AIio #AIInnovation #ML #DataScience #Futureofwork @HaroldSinnott @fogoros @iainljbrown @NandoDF @katecrawford @drhassanrashidi @YuHelenYu -
General-Purpose Humanoid Robot: One Brain for Diverse Uses
By
–
"One Brain for Diverse Uses" General-Purpose Humanoid #Robot
— Ronald van Loon (@Ronald_vanLoon) 26 avril 2026
via @ZappyZappy7#Robotics #Tech #Engineering #Innovation #RPA pic.twitter.com/gbVN5sFf9z"One Brain for Diverse Uses" General-Purpose Humanoid #Robot
via @ZappyZappy7 #Robotics #Tech #Engineering #Innovation #RPA -
Understanding Transformers: Capabilities and Limitations Unveiled
By
–
When we finally figure out what transformers are doing we’ll be both amazed at how much it is and disappointed at how little.
-
TRINITY: An Evolved LLM Coordinator System
By
–
TRINITY: An Evolved LLM Coordinator https://
arxiv.org/abs/2512.04695 -
AI’s Role in Curating Memory, Identity and Legacy
By
–
#AI’s Role in Curating Memory, Identity and Legacy
by Liam Houghton @UniteAi Learn more: https://
bit.ly/4sM2fHL #ArtificialIntelligence #MachineLearning #ML -
TRINITY: Advanced LLM Coordinator Framework Unveiled
By
–
TRINITY: An Evolved LLM Coordinator Paper: https://
arxiv.org/abs/2512.04695
OpenReview: https://
openreview.net/forum?id=5HaRj
Xai12
… -
AI and Healthspan Interview with Leading Medical Experts
By
–
My interview on healthspan and AI with @mmlederman1 and @LCalabreseDO @paijournal transcript video https://
youtube.com/watch?v=QXga7d
pvmk8
… https://
paijournal.com/index.php/paij
ournal/article/view/1028
… -
Medical AI Lacks Evidence for Improving Patient Care
By
–
On the lack of compelling evidence that medical AI is improving patient care, and what to do about it, a @NatureMedicine editorial https://
nature.com/articles/s4159
1-026-04389-4
…