(5/12) High-Throughput Generative Inference of LLMs with a Single GPU
Authors: @ying11231
, @lm_zheng
, @Hades317
, @zhuohan123
, Max Ryabinin, @realDanFu
, Zhiqiang Xie, Beidi Chen, Clark Barrett, Joseph E. Gonzalez, @percyliang
, Christopher Ré @snorkelai
, Ion Stoica, Ce Zhang
Efficient LLM Inference: High-Throughput Generation on Single GPU
By
–
