Here's the best config to orpo finetune llama3-8b on argilla capybara on a single 24GB home GPU! Github: https://
github.com/huggingface/au
totrain-advanced/blob/main/configs/llm_finetuning/llama3-8b-orpo.yml
…
You can run this config using AutoTrain: $ pip install -U autotrain-advanced
$ autotrain –config config.yaml/URL to raw config file

→ View original post on X — @abhi1thakur,