ChatGPT is mostly not at the point where "what makes a human thumb-up" and "what the human wants" have been pried apart by hard optimization. (Unless you're a lawyer who blindly accepts made-up case citations.)

→ View original post on X — @esyudkowsky