Reflecting back, these were the biggest technical lessons for me in AI in the past five years: 2020: you can cast any language task as sequence prediction and learn it via pretrain + finetune 2021: scaling to GPT-3 size enables doing arbitrary tasks specified via instructions

→ View original post on X — @_jasonwei,