LLMs obviously have *some* understanding of what they read and generate.
But this understanding is very limited and superficial. Otherwise, they wouldn't confabulate so much and wouldn't make mistakes that are contrary to common sense. I have argued, since at least 2016, that AI

→ View original post on X — @ylecun,