Really useful! For a specific task, a synthetic dataset generated from a bigger model can be all you need to bring a smaller model all the way up to its bigger sibling's performance!
Synthetic data from large models boost small models to top performance
By
–
