AI Dynamics

Global AI News Aggregator

About

Error Recovery Impossibility in Autoregressive Models

You didn't understand either. Yes, the independence of errors is an assumption, which may or may not be reasonable. No, errors are NOT RECOVERABLE in an auto-regressive setting because the set of correct answers form a subtree in the tree of all possible sequences. Once you get

→ View original post on X — @ylecun,