High alpha technique for fine-tuning LLMs: First, fine-tune your model on all your data Then, use AI to pick a smaller set of really good examples, and tune on them Finally, hand-pick and tune on a few hundred incredible examples >> Huge performance gains <<
Fine-tuning LLMs: Progressive Data Selection Strategy
By
–