Define LoRA config We'll use LoRA for efficient fine-tuning. To do this, we use Unsloth's PEFT and specify:
– The model
– LoRA low-rank (r)
– Layers for fine-tuning (finetune_language_layers, finetune_attention_modules) Check this code

→ View original post on X — @akshay_pachaar