It feels dishonest to call it retconning when even the AI labs have been clear about diminishing returns. Some of them think that it won’t matter because they can still scale fast enough to AGI that the curve isn’t relevant. Or that other approaches like RL will boost scale.

→ View original post on X — @emollick,