7 parameters that control every LLM response. An LLM produces one token at a time by sampling from a probability distribution over the whole vocabulary. These seven parameters are what decide how that sampling happens. 1) Max tokens A hard cap on how many tokens come back. It