Sonnet has thinking tokens, yes. We don't know if they used them to get the MMLU score here https://
anthropic.com/news/claude-3-
5-sonnet
… But if more and more API models do this, I'll have to add them at some point
Claude 3.5 Sonnet Thinking Tokens and MMLU Score Implications
By
–