No. Auto-regressive prediction produces a single path in the tree of possible sequences. At non-zero temperature (stochastic generation) the potential paths form a subtree of the full tree, or rather, a distribution over all paths in the tree. If you threshold all the paths
Autoregressive Prediction and Stochastic Generation in AI Models
By
–