I don't have a great answer to "why emergence occurs", but here's a handwavy thought:
Many emergent abilities require multi-step reasoning, more knowledge, knowing how to do "tail-end" or rare tasks, and larger models are somewhat better at all of these things. With their

→ View original post on X — @_jasonwei