Depending on the hardware, and next to parameter-efficient finetuning, there are a bunch of memory-lowering techniques you can try. Summarized them here: https://
github.com/rasbt/pytorch-
memory-optim
…

→ View original post on X — @rasbt,