Thanks for your interest in contributing. I unfortunately currently don’t have access to a computer until likely next week (long story) but off the top of my head and as far as I can tell right now, I think you can copy most code from the Alpaca or LIMA (
https://
github.com/Lightning-AI/l
itgpt/blob/main/litgpt/data/lima.py
…)

→ View original post on X — @rasbt,