Temperature makes unlikely tokens more likely. Not hard math, but TLDR:

temperature = 0 → always pick what the model says is most likely
temperature = 1 → sample from the distribution returned by the model
temperature = ∞ → ignore the model; pick entirely at random pic.twitter.com/dLSpyw0ha9

— Riley Goodside (@goodside) 16 mars 2023

Temperature makes unlikely tokens more likely. Not hard math, but TLDR: temperature = 0 → always pick what the model says is most likely
temperature = 1 → sample from the distribution returned by the model
temperature = ∞ → ignore the model; pick entirely at random

→ View original post on X — @goodside