Re: 1, yes — see the parenthesis in the second screenshot. Re: 2, you get more diversity from pre-trained base LLMs than the RLHF/instruct-tuned LLMs most people know. You can also compensate by prompting with random dictionary words for inspiration, à la TinyStories.
Pre-trained base LLMs offer more diversity than instruct-tuned models
By
–