To learn some causal concepts, which seems to be your concern, rich multimodal data can be enough, see eg https://
arxiv.org/abs/2110.10819 Either interventions or teacher corrections accelerate the process, but in some cases data (sensory streams, language) can be rich enough to remove

→ View original post on X — @nandodf,