I feel like we need a unified theory of what LLMs can’t do. Most issues (calculation, string ops, grounding) can be patched (via tools, retrieval) so we see them as trivial, not as omens of subtler but similarly fundamental limits. But why is this true?
Exploring the Fundamental Limits and Patching Mechanisms of LLMs
By
–