Yes — and you can often achieve much more reliable counting by repeating an input a second time annotated with a running total, but that’s expensive and context-constrained; this paper is about limitations on counting directly in a single token inference
Paper on limitations of counting in single-token inference
By
–