I’ve heard that you get rapidly diminishing returns after ~100,000 tokens though. Has it been consistent in your experience?
Token Context Limits: Diminishing Returns After 100k Tokens
By
–
By
–
I’ve heard that you get rapidly diminishing returns after ~100,000 tokens though. Has it been consistent in your experience?