Yes, there is an inverse correlation between task length and model performance — because model reasoning abilities decrease dramatically with context size, as has been demonstrated in many different domains with sequence-only data.

→ View original post on X — @fchollet