Along with developing a framework for scalable oversight, we also conduct a proof of concept experiment that demonstrates a couple of question-answering tasks that work well under this paradigm with current language models:
@anthropicai
-
Scalable Oversight: Supervising AI Systems Beyond Human Capabilities
By
–
To ensure that AI systems remain safe as they start to exceed human capabilities, we’ll need to develop techniques for scalable oversight: the problem of supervising systems’ behavior without assuming that the overseer understands the task better than the system being trained.
-
AI Systems Improving Human Oversight of Large Language Models
By
–
In "Measuring Progress on Scalable Oversight for Large Language Models” we show how humans could use AI systems to better oversee other AI systems, and demonstrate some proof-of-concept results where a language model improves human performance at a task.