"Iterative Finetuning is Mostly Idempotent" If a model has a behavioral tendency and you train the next generation on its outputs, does the tendency snowball? This paper actually finds that it's mostly no. So they seed models with traits like sycophancy and misalignment, then
RESEARCH
-
Demystifying Manifold Constraints in LLM Pre-training
By
–
"Demystifying Manifold Constraints in LLM Pre-training" LLM pre-training depends on a stack of heuristic tricks, eg. normalization layers, weight decay, and optimizer tuning. This paper suggests that by constraining weight matrices to geometric manifolds like spectral or
-
The importance of benchmarks in evaluating AGI progress
By
–
few understand the gravity of the powerpoint benchmark for agi progress
-
Excitement for upcoming AI models: GPT 5.6, Opus 4.8, Kimi, GLM
By
–
Don’t know if I’m more excited for gpt 5.6, opus 4.8 a new Kimi or GLM model. What a freaking amazing time to be alive
-
Excitement for GPT-5.5 and next model hype
By
–
GPT-5.5 is the goat right now. Freaking excited for the next model. And Sama is great hyping it up 😉
-
Gary Marcus on AI progress by 2027
By
–
Ten of ten on this (and similar tasks) should be a lower bound: https://
garymarcus.substack.com/p/where-will-a
i-be-at-the-end-of-2027
… -
AI outperforms ER doctors; not consulting it unethical
By
–
It is unethical for a doctor not to consult an AI! A new study published in Science shows OpenAI's o1 model (not 5.5, but the over 1 year old o1!) outperformed ER physicians at diagnosing patients, identifying the correct or near-correct diagnosis 67% of the time versus 50–55%
-
Agent-World: A New Self-Evolving Training Arena for AI Agents
By
–
What if your AI agent could train itself by exploring thousands of real-world services and automatically finding its own weaknesses? Renmin University of China and ByteDance Seed introduce Agent-World, a self-evolving training arena. It works by having the agent discover new
-
AI Approach Used to Discover Dozens of Hidden Planets
By
–
Via University of Warwick: https://
warwick.ac.uk/news/pressrele
ases/ai-approach-uncovers-dozens-of-hidden-planets/
…