Repeated sampling from instruction-tuned models can yield low-diversity, stereotyped output. For creative tasks, k-shot prompting base models will improve creativity (measured e.g. as vocabulary size), though generally with worse adherence to the (now implicit) instructions.
Repeated sampling and k-shot prompting affect creativity in instruction-tuned models
By
–