5. Why language models / prompting works. We still don’t have a great understanding of how in-context learning works, or why chain-of-thought/reasoning works. We can learn a great deal by only looking at inputs and outputs (as do we do with humans in psychology).

→ View original post on X — @_jasonwei,