10/ FlexGen – a high-throughput generation engine for running LLMs with limited GPU memory.
FlexGen: High-Throughput LLM Engine for Limited GPU Memory
By
–
By
–
10/ FlexGen – a high-throughput generation engine for running LLMs with limited GPU memory.