Their proposal, even if you imagine it working, reduces to: Try to constrain the ASI so sharply that it's safe for the same reason a rock is safe, and nearly as useful as one. Implicitly, you then need to prevent anyone else from building a non-rock AI. They ignore *that*.

→ View original post on X — @esyudkowsky,