State of GPT – Andrej Karpathy at Microsoft Build Such awesome talk on state of GPT and other LLMs. Karpathy in his usual best teaching style talks about the training paradigms of large language models(pretraining, supervised finetuning, reward modelling, RLHF), prompting

→ View original post on X — @jeande_d,