This could also explain why so many people instantly assume that "fine-tuning" a model is the obvious right way to teach it new information, as opposed to using more effective but less obvious techniques like RAG (not helped by that being a pretty terrible acronym)

→ View original post on X — @simonw