What would be useful is when including more MC questions would also improve the answer performance on similar-topic questions where answer choices are not shown (like in a real world context). That being said I can see models who do well on MC settings being useful as verifiers
Multiple Choice Questions as Model Training for Real-World Performance
By
–
Leave a Reply