The pass@2 scores are actually reported in the blog post, but as mentioned in the parent tweet, the gap is ~ 10-15% below pass@250 levels. What I meant in my previous tweet is to narrow this gap in the future.
By
–
The pass@2 scores are actually reported in the blog post, but as mentioned in the parent tweet, the gap is ~ 10-15% below pass@250 levels. What I meant in my previous tweet is to narrow this gap in the future.