No one ever thought you would get 10x return for 10x compute. You get 10-30% returns for 10x compute. But if that improvement is enough to increase model ability in an economically meaningful way, it can be worth the cost.

→ View original post on X — @emollick,