Fooling a superintelligence is a more adversarial problem than training a robot. In the latter case intelligence works with you; in the former, against you. "Can learn from" and "cannot distinguish" are different orders of requirement.

→ View original post on X — @esyudkowsky