That's great news! Have you tested it with peft *and* deepspeed zero3 together? If you, could you provide a complete example showing how to make that work?

→ View original post on X — @jeremyphoward