That's a ridiculous argument. – all auto-regressive models diverge, whether they are generative (in input space) or not. – for discrete symbol sequences, the probability of correctness decreases exponentially with the sequence length, assuming independence of errors. – THAT

→ View original post on X — @ylecun,