If you are working on the NeurIPS LLM Efficiency Challenge, Dolly 15k support is now merged: https://
github.com/Lightning-AI/l
it-gpt/pull/430
… python scripts/prepare_dolly.py
python finetune/lora.py –data_dir data/dolly/

→ View original post on X — @rasbt,