Core idea: We can treat rubrics like models. Optimize along two axes: (1) Alignment with stakeholder objectives (2) Agreement among evaluators, both human and LLMAJ
Rubrics as Models: Optimizing Stakeholder Alignment and Evaluator Agreement
By
–
By
–
Core idea: We can treat rubrics like models. Optimize along two axes: (1) Alignment with stakeholder objectives (2) Agreement among evaluators, both human and LLMAJ