I am less sure than you about whether distilling or “embodying” LLMs is the right or only approach. I would encourage you to go down that route (especially since it only takes 4 weeks) but I’m personally curious about a developmental perspective.
LLM Distillation vs Developmental Approaches: Strategic Considerations
By
–