Under the hood, this is powered by @OpenPipeAI
's ART library. Their RULER technique made this possible, as it doesn't require labeled output data. With no need for labeled outputs, we can just sample a LLM to generate scenarios to RL against. Absolutely crazy!
OpenPipe’s RULER Enables LLM Training Without Labeled Data
By
–