AI Dynamics

Global AI News Aggregator

About

MoE as Alternative to O(n) Complexity in LLMs

Not O(n) here IIUC: http://
arxiv.org/abs/2311.10770
(And in general MoE seems like a way around O(n))

→ View original post on X — @jeremyphoward