The problem with RLHF is that the humans providing the feedback are rewarded for volume, not quality.
RLHF Quality Issues Human Feedback Volume Incentives
By
–
By
–
The problem with RLHF is that the humans providing the feedback are rewarded for volume, not quality.