We leveraged GRPO with a difficulty-aware reward formulation to address this issue. (More information about our custom GRPO flavor in the article.) We combined it with the following data mix after filtering out samples that do not yield a solve rate of 20-80% at 4k tokens.
GRPO with Difficulty-Aware Rewards for AI Model Training
By
–
