Fast Inference of Mixture-of-Experts Language Models with Offloading Artyom Eliseev, Denis Mazur : https://
arxiv.org/abs/2312.17238 #ArtificialIntelligence #DeepLearning #MachineLearning
Fast Inference of Mixture-of-Experts Language Models with Offloading
By
–
