Instead of manually doing thumbs up and thumbs down, we can programmatically annotate what makes something acceptable vs. not, and that data can be used to align a model or curate data for fine-tuning. More details in the Snorkel Blog:
Programmatic Data Annotation for Model Alignment and Curation
By
–