Retweeted this before but it seems even more relevant now. RLHF is not the way to solve the alignment problem. a lot of experience has now confirmed what @percyliang said below.

→ View original post on X — @garymarcus