Summary of things: – turn up randomness and ban the most likely words (temperature + min-p + XTC sampling)
– ask for several different options at once, seed each with random constraints (verbalized sampling + entropy injection)
– give it a memory of what it's said and pick the
Techniques for randomness and diversity in language model outputs
By
–