AI Dynamics

Global AI News Aggregator

About

ChatGPT context length 8192 tokens inferred from repetition test.

Update: Recollection of the start of the conversation reliably fails after 7 repetitions of the ~1024-token input. This suggests that text-davinci-002-render, the model underlying ChatGPT, has a likely context length of 8192 tokens, with some tokens consumed by formatting.

→ View original post on X — @goodside