"It’s impossible to fine-tune effectively without an eval system which can lead to writing off fine-tuning if you haven't completed this prerequisite." That sounds spot-on to me. Eval systems still feel like a dark art, which would explain why I don't find fine-tuning attractive

→ View original post on X — @simonw,