Diffusion Forcing found common ground between diffusion models & teacher forcing: they both use training schemes that involve predicting masked (noisy) tokens from unmasked ones. In the case of diffusion models, they gradually add noise to data, which can be viewed as fractional

→ View original post on X — @mit_csail