An interesting point is that using very large base models like GPT-4.5 involves trade offs. Larger, slower, and more expensive models mean longer training loops, higher compute usage, and thus a reduced overall learning rate.

→ View original post on X — @petergostev,