Inductive bias, data and other changes does influence the point where emergent abilities emerge. We showed this in UL2R paper: https://
arxiv.org/abs/2210.11399 I also wrote a blogpost:

→ View original post on X — @yitayml,