Jason Fries discusses "distilling step-by-step." This method prompts an LLM to provide not just an answer, but also the reasoning behind it. This information is then used to train a smaller, model with similar performance. Watch here: https://
youtube.com/watch?v=TIqf4L
MNCjU
…
Distilling Step-by-Step: Training Smaller LLMs with Reasoning
By
–