The system is out there. You can just interact with it and test the hypothesis by yourself! You see an immediate correlation between question familiarity & performance, and a fast break down of performance as the questions become more novel — independent of question complexity!

→ View original post on X — @fchollet,