Here’s an interesting paper (link in image/alt) that shows chain-of-thought (CoT) benefits in math and symbolic reasoning but only marginal benefits on other tasks. On MMLU, generating an answer without CoT leads to almost identical accuracy as CoT. The extra cost and time

→ View original post on X — @abacusai,