5/ LOMO – proposes a new memory-efficient optimizer that combines gradient computation and parameter update in one step; enables tuning the full parameters of an LLM with limited resources.
LOMO: Memory-Efficient Optimizer for Full LLM Parameter Tuning
By
–
