Lorablation is a simple two-step process: 1/ Extract a LoRA by comparing two models: a censored and an abliterated Llama 3.0 2/ Merge the LoRA with a censored Llama 3.1 to abliterate it It means that we directly applied a Llama 3 LoRA to a 3.1 model and it just works!
Lorablation: Two-Step LoRA Extraction for Model Abliteration
By
–
Leave a Reply