I agree with you that the distribution for generation can be on a latent space rather than on the observed space. A generative model can lead to the emergence of concepts without requiring an external target
Generative Models and Emergent Concepts in Latent Space
By
–