this is great question! i think its an unexplored space. finetuning is much more heavy weight (error prone, hard to do, more data required, etc), so it will be interesting to see if you can achieve similar performance just by using examples
Fine-tuning vs. In-context Learning: Exploring Alternative Approaches
By
–