(From my perspective, the main relevance is expository. If you try to explain to Simplicio that early ASI can acquire real-world power through tactics such as blackmail, Simplicio by default thinks the AI is not allowed to watch people inside their houses and learn blackmail

→ View original post on X — @esyudkowsky