That's why GPLVM works so well on low data … low dim inputs. I don't think there's a "modern" Gen AI approach that competes in (very) low data regime. My favourite demonstration was @baxissimo's Latent Doodle Space paper.
GPLVM superiority in low data regime versus modern generative AI
By
–