Another cool research on Looped Transformers They ask the question: "Can we loop a frozen, off-the-shelf checkpoint directly at inference time without any modifications?" So naive repetition pushes hidden states outside the distribution later layers expect, so performance
RESEARCH
-
Language Models Sleep: Context Replay for Deep Reasoning
By
–
"Language Models Need Sleep" Instead of thinking longer at answer time, this paper makes LLMs sleep before forgetting. They replay old context, write it into fast weights, clear the KV cache, and answer later at normal speed. More sleep improves deep reasoning over long and
-
New Method Significantly Reduces Compute Demands for One-Shot LLM Training
By
–
One-shot LLM training demands reliable scaling laws to predict model behavior, but current scaling techniques are compute-intensive. New research introduces a method that reduces training demands significantly, lowering the time and cost of scaling:
-
Frontier AI Models Struggle with Long-Horizon Legal Tasks, Study Finds
By
–
Initial LAB results from Harvey put a number on something we see across specialized AI work: under rigorous all-pass standards, frontier models complete fewer than 10% of long-horizon legal tasks, and no single model leads across practice areas. General capability isn't
-
ReLU Activation Function Gradient Flow Design
By
–
It is easy enough to make your own, but I think standard relu should have been defined as passing the value at zero, so gradients flow backward through it, allowing some things to be zero weight initialized when symmetry breaking isn’t an issue.
-
Constrained Generation and Memory Patterns in AI
By
–
That progression is a clean way to frame it. Constrained generation, constrained tool calling, constrained memory. Same pattern applied one layer deeper each time. The temporal piece is underrated. Most teams get to typed entities and stop, but fact invalidation is what keeps
-
MiniMax M3 Model Teased with Sparse Attention Architecture
By
–
MiniMax M3 has been teased > MiniMax M3 will be based on a new Sparse Attention architecture > MiniMax M3 is expected to be open source Soon?
-
Long-Horizon Agents: Attention Scaling and Sleep Mechanisms
By
–
// Language Models Need Sleep // Let your agents "sleep", folks. On a serious note, this is a fascinating paper on getting the most from long-horizon agents. Here is the problem with agents today: Attention scales badly with context length, so long-horizon agents keep paying a
-
Text Diffusion and Elastic Reasoning from Nemotron Labs
By
–
From the Lab: Text Diffusion and Elastic Reasoning | Nemotron Labs https://
x.com/i/broadcasts/1
dxYllaRLMLJX
… -
OpenResearch sneak peek: train VPO on ToolRL in one click
By
–
Here’s an early sneak peak of OpenResearch, our brand new feature for reproducing and experimenting on top of papers
— alphaXiv (@askalphaxiv) 26 mai 2026
We put together a template so you can train VPO on ToolRL in one click on a single gpu
Vector Policy Optimization trains models to generate diverse answer sets… pic.twitter.com/MEaGQ1HIYMHere’s an early sneak peak of OpenResearch, our brand new feature for reproducing and experimenting on top of papers We put together a template so you can train VPO on ToolRL in one click on a single gpu Vector Policy Optimization trains models to generate diverse answer sets