AI Dynamics

Global AI News Aggregator

About

Tokenization makes exact repetition of tokens harder than counting

A few things:
– “aaaa…” is tokenized differently from “ a a a a…” in a way that makes it much easier to say (many a’s = 1 token)
– Counting “out loud” is easy, including FizzBuzz variants. What’s hard is making it say exactly 100 repetitions of a token sequence unnumbered

→ View original post on X — @goodside