The issue is the creation of the bnb quantised layers, not the adapters. (They are fast to init anyway since they're small.)
BNB Quantized Layers Initialization Performance Issues
By
–
By
–
The issue is the creation of the bnb quantised layers, not the adapters. (They are fast to init anyway since they're small.)