I wouldn't necessarily recommend ORPO in practice vs. SFT/DPO, but 3k samples is very small.
ORPO vs SFT/DPO: Training Technique Comparison Analysis
By
–
By
–
I wouldn't necessarily recommend ORPO in practice vs. SFT/DPO, but 3k samples is very small.