Yup. Other interesting tidbit: to run full finetuning without Adapter on 7B requires at least 8x A100s for comparison.
Full Fine-tuning Requires 8x A100s for 7B Models
By
–
By
–
Yup. Other interesting tidbit: to run full finetuning without Adapter on 7B requires at least 8x A100s for comparison.