The LLM parrots need not be stochastic. Long weekend thought motivated by a posting by @balazskegl : A few years ago @yutianc and @wellingmax introduced me to herding. It is a dynamical systems (deterministic) algorithm for producing samples for a multinomial discrete
Deterministic Algorithms for LLM Sampling Beyond Stochasticity
By
–
