Top-p and Min-p truncate candidate tokens by probability. But a high-probability token does not always bring new information — several high-probability tokens can be semantically near-identical, just different phrasings of the same generation path. Meanwhile, a slightly
Token Sampling Discussion Questions Probability Based Candidate Truncation
By
–
