As pointed out by @sirbayes
, this paper https://
starai.cs.ucla.edu/papers/ZhangIJ
CAI23.pdf
… has a formal investigation into the observation from the first tweet — that "my models were completely unable to learn to perform actual first-order logic — despite the fact that this ability was definitely part of

→ View original post on X — @fchollet,