This model makes predictions in continuous representation space.
An LLM makes predictions in discrete input space.
Prediction in continuous representation space is done with a (non-generative) Joint Embedding Predictive Architecture, i.e what I've been advocating for about 5
Continuous vs Discrete Prediction Space in Modern AI Models
By
–