That's not the same as believing that fine tuning can't teach a model new knowledge under any circumstances – but in practice many people I see who think they need to fine tune a model would be better off using RAG instead

→ View original post on X — @simonw