New post: Sampling for Text Generation https://
huyenchip.com/2024/01/16/sam
pling.html
… Many challenges (and opportunities) in working with AI today stem from the way models sample their outputs. This post covers: 1. Sampling strategies and variables including temperature, top-k, and top-p.
2. How
Sampling Strategies for AI Text Generation: Temperature, Top-K, Top-P
By
–