I spent some time trying to solve this problem through CoT/scratchpads but there were often secondary hallucinations, e.g. over-skepticism of non-trick questions. Nothing seemed to work as well as the zero-shot above.

→ View original post on X — @goodside