– Chess AIs are far more legible; we can point to particular bytes inside a chess-playing program and say what they mean.
– Relatedly, chess is a narrower domain, and AIs can solve it without being able to learn new domains.
– Thus we can literally hardcode the utility function.

→ View original post on X — @esyudkowsky