3/ @scale_AI had started working on language models the year before on the very first RLHF experiments on GPT-2. But GPT-2 still felt very much like a toy at that time. GPT-3 was the first moment where it was obvious this would be the major theme of AI

→ View original post on X — @alexandr_wang