prompt instructions in a fine tune mostly just sculpt completions outside the fine-tune distribution. i’d say only include a fixed prompt if you’re very constrained on examples (<~1k) and can swallow the inflated tuning and inference costs

→ View original post on X — @goodside