The problem is we still don't have any good benchmarks. And the time a benchmark dataset exists is strongly correlated with the rate of overfitting on these benchmarks. Plus, there are also little accidents like this: https://
x.com/Shahules786/st
atus/1695493641610133600?s=20
… 1/2

→ View original post on X — @rasbt,