Introducing phi-2-dpo-7k! A Microsoft Phi-2, fine-tuned on a diverse cocktail of 7k chat interactions from @argilla_io
's latest DPO dataset, including orca pairs, ultra-feedback ratings, and capybara-dpo Runs ultra-fast on Apple Silicon, thanks to MLX

→ View original post on X — @skirano