I agree actually, if a problem can be solved with ICL (in terms of cost, latency, etc. and not just accuracy), then it's perfect. But I want to point out that it also makes fine-tuning even more relevant in a lot of use cases.
ICL versus Fine-tuning: Cost-Latency Trade-offs in LLM Optimization
By
–