Finally got around adding LIMA to Lit-GPT (upon popular request). You can use it now to finetune any of the supported LLMs (Llama 2, Falcon, LongChat, … you name it). More usage info here: https://
github.com/Lightning-AI/l
it-gpt/blob/main/tutorials/prepare_dataset.md#lima
…

→ View original post on X — @rasbt,