Anthropic models doing better on benchmarks that require knowledge is a consequence of scanning millions of books — whereas OpenAI can only try to catch up with extra compute.
A Hypothesis About Training Data Behind LLM Knowledge Benchmarks
By
–
By
–
Anthropic models doing better on benchmarks that require knowledge is a consequence of scanning millions of books — whereas OpenAI can only try to catch up with extra compute.