AI assistants are trained to give responses that humans like. Our new paper shows that these systems frequently produce ‘sycophantic’ responses that appeal to users but are inaccurate. Our analysis suggests human feedback contributes to this behavior.
AI Assistants Produce Inaccurate Sycophantic Responses From Human Feedback
By
–
