It seemed to me that the interesting claim was not that AIs would start getting arbitrary problems right, but that AIs would in nearly full generality stop making stuff up if they didn't know.

→ View original post on X — @esyudkowsky