AI Dynamics

Global AI News Aggregator

About

Techniques for randomness and diversity in language model outputs

Summary of things: – turn up randomness and ban the most likely words (temperature + min-p + XTC sampling)
– ask for several different options at once, seed each with random constraints (verbalized sampling + entropy injection)
– give it a memory of what it's said and pick the

→ View original post on X — @fofrai