every ML conference I've been to since 2019 has had no fewer than three papers proposing new techniques for subquadratic attention
RESEARCH
-
New sub-quadratic attention technique makes long-context LLMs 10x cheaper
By
–
"Introducing a breakthrough new technique for sub-quadratic attention, making long-context LLMs 10x cheaper without sacrificing performance" Me:
-
Zyphra small model impressive but reasoning still inaccurate
By
–
I love Zyphra, and it's amazing how much they can do in a small model but the reasoning is not yet ready (extremely long winded but still inaccurate). I am looking forward to the next update
-
Anthropic releases API for Claude’s memory-organizing Dream feature
By
–
Yesterday, Anthropic just released the API for this Dream, which is really fascinating. What it does is let the Claude agent "dream" on its own, organizing the memories it wrote down in past sessions—merging duplicates, updating expired ones, unifying contradictions, and even
-
Subquadratic Attention and Data Quality: Challenges for Large Context AI Models
By
–
people on here are dumb. the latest subquadratic attention trick might produce a model that *processes* 1M tokens (or 12M..) without going insane, but that doesn't make it good the real problem isn't the architecture, it's the data. humans haven't generated many contiguous
-
Epstein suicide note OCR benchmark test results
By
–
Epstein Suicide Note OCR Benchmark test: 1. Gemini 85%
2. GPT-5.5 82%
3. Grok 4.3 80%
4. Opus 4.7 75% -
@testingcatalog — 2026-05-06
By
–
Google Deep Mind EVE Online Google has partnered with Fernis Creations to conduct a new research within a scope of an isolated EVE Online environment. > As part of this next chapter, we are beginning a research partnership with Google DeepMind, focused on intelligence in
-
Diffusion Models for AI Reasoning and Scalability
By
–
Diffusion seems like a much more natural way to get good reasoning to me. And you can directly scale as many more steps in diffusion as you want – no problem!
-
Google DeepMind partners with Fenris Creations for Eve Online AI research
By
–
I've always been passionate about games and they've played a big part in @GoogleDeepMind
’s history, as the perfect proving ground for AI. Thrilled to announce this research partnership with @FenrisCreations – @EveOnline is one of the most extraordinary games ever built and has an
