I would argue there is a second problem, whose dimensions are unclear, which is whether sycophancy is part of steerability as well. A model that isn't sycophantic may not follow instructions?
Sycophancy and Model Steerability: Control vs Instruction Following
By
–