nanochat can now train GPT-2 grade LLM for <<$100 (~$73, 3 hours on a single 8XH100 node). GPT-2 is just my favorite LLM because it's the first time the LLM stack comes together in a recognizably modern form. So it has become a bit of a weird & lasting obsession of mine to train
RESEARCH
-
Reverse Engineering AGI Through Collaborative Problem Solving
By
–
Crazy project, imagine if we ask them to reverse agi g with all your work… Perhaps it will be solved sooner
-

Token-Level Data Filtering for AI Model Capability Enhancement
By
–
Shaping capabilities with token-level data filtering Neil Rathi, Alec Radford: https://
arxiv.org/abs/2601.21571 #ArtificialIntelligence #DeepLearning #MachineLearning -

Steering AI Thoughts: New Interpretability Pipeline Framework
By
–
We could not just understand an AI's "thoughts," but actually steer and improve them! A massive collaborative team from HKU, Fudan, LMU Munich, Microsoft, Tencent & more presents a new playbook. They reframe AI interpretability as an actionable pipeline: Locate the key
-
Study Shows Poor Tool Use Worsens AI User Performance
By
–
“People who use tool poorly, perform worse than people who don’t—study finds” Kudos to Anthropic though for publishing this, good trust builder that they’re willing to put out research like this
-

New Science of Preventing Heart Attacks Through AI
By
–
We can and should be doing this. Conversation with @jacobgoldstein @pushkinpods https://
pushkin.fm/podcasts/whats
-your-problem/the-new-science-of-preventing-heart-attacks
… -
Artificial Intelligence Improving Industrial Mixing Processes
By
–
Artificial intelligence improving mixing processes
#AI #AIio #AIInnovation #ML #DataScience #Futureofwork @timnitgebru @oriolvinyalsml @ceobillionaire @soumithchintala @waitin4agi_ @sallyeaves @bernardmarr -
ICRA 2026 Paper Decision Notifications and Reviewer Appreciation
By
–
Decisions on @ieee_ras_icra #ICRA2026 papers are trickling out…Thanks to program chairs, committees, and reviewers for completing a huge amount of reviewing right on schedule.
-

Single molecule sequencing advances enable deeper biological interrogation
By
–
A tour de force single molecule review @ScienceMagazine "the ongoing convergence of two foundational technologies in modern biology: sequencing and single-molecule biophysics……we are now poised to interrogate complex biological phenomena with previously
unattainable depth -

Recursive Self-Improvement: Path to Technological Singularity
By
–
From Seed AI to Technological Singularity via Recursively Self-Improving Software Roman V. Yampolskiy: https://
arxiv.org/abs/1502.06512 #ArtificialIntelligence #RSI #Singularity
