How is it different from temperature? In a nutshell:
• Temperature – how to choose between tokens
• Top-k/top-p – how many tokens to choose from As a result, 
• Lower top-k/top-p = more predictable
• Higher top-k/top-p = more creative

→ View original post on X — @cohere