Literally the first play to ask "What if we tried building an obedient race of powerful, hardworking servants?" depicted them wiping out humanity instead. It might not have been a very carefully detailed set of premises and conclusions, but it was *reasonable to worry about*.

→ View original post on X — @esyudkowsky