AI Dynamics

Global AI News Aggregator

About

LLM Context Limits: Performance Degradation Beyond 100K Tokens

For small/simple tools, you could just dump all the concise needed info straight into llms.txt, but for larger systems it might not fit even in 200k tokens. Also, all current LLMs degrade a *lot* beyond 100k tokens in practice.

→ View original post on X — @jeremyphoward