I’ve never seen it work on anything other than RLHF-tuned GPT-3. I’ve wondered if you could k-shot a non-RLHF model with meta-examples of instruction templates followed by input/output pairs for each, but haven’t tried it.
By
–
I’ve never seen it work on anything other than RLHF-tuned GPT-3. I’ve wondered if you could k-shot a non-RLHF model with meta-examples of instruction templates followed by input/output pairs for each, but haven’t tried it.