I agree and I clarify below I’m only claiming to disprove the (common I think) misunderstanding that LLMs normally do count tokens well, just not letters as a special case
Clarifying LLM token counting behavior
By
–
By
–
I agree and I clarify below I’m only claiming to disprove the (common I think) misunderstanding that LLMs normally do count tokens well, just not letters as a special case