i think even <base models have in-context learning ability if instruction tuned.

→ View original post on X — @yitayml