AI Dynamics

Global AI News Aggregator

About

LLM Performance Degradation at 100K Tokens Context

People working on basic code and reset their Agent chats every 4-5 replies I envy you. Having to work on deep context design work and at about 100k tokens, LLMs start to get lazy / confused. I resorted to giving them codes they have to echo back. They often seem to think

→ View original post on X — @alexjc,