AI Dynamics

Global AI News Aggregator

About

Thought process degrades at 400k tokens; tool call tax favors 200k limit

At around 400k, sometimes much before, there's a degradation of the thought process. Costs increase a lot too due to frequency of calls and the 18.5% "tool call tax." Seriously thinking the default 200k limit is a sensible one… Setting it to 1M gives you flexibility only.

→ View original post on X — @alexjc