Instruction tuning makes this less essential a mental model than it used to be with pre-trained LLMs. You’re still “sculpting,” but you’re usually sculpting the data manifold RLHF-evaluated generations.
Instruction tuning changes sculpting metaphor to RLHF data manifold
By
–