Small models don't just learn slower.
— AlphaSignal (@AlphaSignalAI) 9 juin 2026
They're structurally locked out of rare tasks forever.
No matter how long you train them, frequent task signals constantly overwrite rare ones.
Large models solve this by fully satisfying common tasks first, then dedicating leftover… https://t.co/9U0z5AIPgY pic.twitter.com/yhu439mdyo
Small models don't just learn slower. They're structurally locked out of rare tasks forever. No matter how long you train them, frequent task signals constantly overwrite rare ones. Large models solve this by fully satisfying common tasks first, then dedicating leftover