Very clever paper to predict downstream performance of pre-trained models. – Take advantage of the fact that larger models being more sample-efficient and performant is equivalent to finetuning a smaller model on targeted data
– In principle this is hugely valuable because you

→ View original post on X — @_jasonwei,