The PIT framework focuses on learning from human preference data, coupled with its unique reformulation of the RLHF objective. Humans indicate their preferences on LLM outputs and this data is used to train reward models. The RLHF objective is reformulated. /9

→ View original post on X — @abacusai,