Training an LM to abide by qualitative public opinions involves a large number of subjective judgment calls and technical challenges. We enumerate all of the messy challenges we encountered so others can build upon our work.

→ View original post on X — @anthropicai