Very clever paper to predict downstream performance of pre-trained models. – Take advantage of the fact that larger models being more sample-efficient and performant is equivalent to finetuning a smaller model on targeted data
– In principle this is hugely valuable because you
Predicting Pre-trained Model Performance Through Sample Efficiency Analysis
By
–
