Finetuning is a great way to bring an ability to a smaller model. Emergence often occurs for an ability that is *not* explicitly trained for, just by increasing scale (compute/ model size).

→ View original post on X — @_jasonwei