But aligning GPT-4 is a step, not the destination. Great progress (compare to early complaints about GPT-3), but will need to scale to problems where human can't even judge the outputs. GPT-4 itself already used a lot in our alignment, step towards this:
GPT-4 Alignment Progress: Scaling Beyond Human Judgment
By
–