This is also how you spot students who pass their exams purely by memorizing tons of previous tests without understanding the class materials (a pretty good analogy for AI): you test them on something they didn't expect, that requires thinking from first principles.

→ View original post on X — @fchollet,