At around 400k, sometimes much before, there's a degradation of the thought process. Costs increase a lot too due to frequency of calls and the 18.5% "tool call tax." Seriously thinking the default 200k limit is a sensible one… Setting it to 1M gives you flexibility only.
Thought process degrades at 400k tokens; tool call tax favors 200k limit
By
–