Also I like this post from @karpathy on same topic. "reaching top tier performance will include finetuning, especially in applications with concrete well-defined tasks where it is possible to collect a lot of data and 'practice' on it."

→ View original post on X — @jeande_d