Regardless how a human would do it, GPT-3 needs chain-of-thought to perform on these problems. Only skimmed the paper, but I don't see a specific deficit in ToM vs. known inability to do multi-hop inference without CoT.
GPT-3 Requires Chain-of-Thought for Problem Solving, Paper Analysis
By
–