If I’ve talked about AGI being here soon, it’s only been in reference to others saying it. I’m in the boat that most people are overestimating how quickly we’ll reach this hypothetical, barely defined, goalpost-shifting milestone…
RESEARCH
-
Gemini Long Context Pre-Training: Scaling to Infinite Context
By
–
A deep conversation with @SavinovNikolay, the Gemini long context pre-training co-lead…
— Logan Kilpatrick (@OfficialLoganK) 3 mai 2025
We go from the basics to what is needed to scale to infinite context to long context best practices for devs:pic.twitter.com/UMk5Svw3qYA deep conversation with @SavinovNikolay
, the Gemini long context pre-training co-lead… We go from the basics to what is needed to scale to infinite context to long context best practices for devs: -

2025: The Year of AI Agents Explained
By
–
2025 is the year of agents. Here’s why We’ve hit the ceiling of what pretraining alone can do (what many experts think, but not all!). Scaling laws are flattening. Benchmarks are plateauing. LLMs are great, but they still face two fundamental limitations: 1. LLMS are passive;
-

Data AI Summit San Francisco: Expert Keynotes and Technical Sessions
By
–
Attend #DataAISummit in San Francisco to hear from experts across industries on how they’re applying the latest data and AI technologies in the real world. Register for access to: Keynotes from expert leaders on the latest advancements and technology trends 700+ technical
-

The Looming AI Collapse: Self-Referential Learning Risks
By
–
New on the Blog: The Looming AI Collapse: Navigating the Risks of Self-Referential Learning Stay ahead in the ever-evolving world of Digital Transformation. This article explores key insights into emerging technologies and their impact on today's business landscape.
-
Scaling non-scalable solutions: paradox or necessity?
By
–
Not for the first time, by the way, is “How do you do a thing that doesn’t scale?” answered by “Scale it.”
-

Contexture Theory: Understanding Foundation Model Representation Learning
By
–
Contextures: The Mechanism of Representation Learning This work introduces contexture theory, a unified mathematical framework that explains what foundation models actually learn during pretraining and why these learned representations generalize to diverse downstream tasks.
-

I-Con: Unified Framework Connects 23 Representation Learning Methods
By
–
I-Con: A Unifying Framework for Representation Learning I-Con introduces a single, unified information-theoretic framework that reveals a deep connection between over 23 different representation learning methods, showing they all minimize a form of KL divergence between
-

WebThinker: Deep Research Agent for Large Reasoning Models
By
–
WebThinker: Empowering Large Reasoning Models with Deep Research Capability WebThinker is a deep research agent that enhances large reasoning models (LRMs) by enabling them to autonomously search the web, navigate pages, and write research reports in real time—overcoming the
-

Prisma: Open Source Mechanistic Interpretability Toolkit for Vision
By
–
Prisma: An Open Source Toolkit for Mechanistic Interpretability in Vision and Prisma is an open-source toolkit that brings powerful mechanistic interpretability tools—previously focused on language models—into the vision and video domain, enabling large-scale analysis and