LLaDA2.0, a new method that converts existing auto-regressive models into discrete diffusion models using a novel 3-phase training scheme. This approach preserves the model's learned knowledge while unlocking parallel decoding. The resulting models, LLaDA2.0-mini (16B) and
LLaDA2.0: Converting Auto-Regressive Models to Discrete Diffusion
By
–
