My example using "A A A A" contains a mistake — 2048 tokens is actually longer than the per-cell maximum input length. The input is silently truncated when too long. You need to give it 7 or 8 repetitions of an input that contains ~1024 tokens.
By
–
My example using "A A A A" contains a mistake — 2048 tokens is actually longer than the per-cell maximum input length. The input is silently truncated when too long. You need to give it 7 or 8 repetitions of an input that contains ~1024 tokens.