AI Dynamics

Global AI News Aggregator

About

BNB Quantized Layers Initialization Performance Issues

The issue is the creation of the bnb quantised layers, not the adapters. (They are fast to init anyway since they're small.)

→ View original post on X — @jeremyphoward