AI Dynamics

Global AI News Aggregator

About

LLM counting errors: ChatGPT-4o miscounts repeated tokens

Another clue: LLM counting errors occur even when counting words instead of letters. Here, ChatGPT 4o miscounts just 4 repetitions of “horse” in a 3-line text, despite care to ensure each “horse” maps consistently to the same single token (20998, “horse” with a leading space):

→ View original post on X — @goodside