AI Dynamics

Global AI News Aggregator

QLoRA-style Quantization Added with BNB NF4 Support

By

@rasbt

–

Yes! Just added QLoRA-style quantization the other week, too. You can use it via –quantize "bnb.nf4" for example. I have some benchmarks here:

→ View original post on X — @rasbt,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *

MORE ARTICLES