AI Dynamics

Global AI News Aggregator

About

Microsoft Releases GRIN MoE Mixture of Experts Model

Microsoft releases GRIN MoE GRadient-INformed MoE demo: https://
huggingface.co/spaces/GRIN-Mo
E-Demo/GRIN-MoE

model: https://
huggingface.co/microsoft/GRIN
-MoE

github: https://
github.com/microsoft/GRIN
-MoE
… With only 6.6B activate parameters, GRIN MoE achieves exceptionally good performance across a diverse set of tasks, particularly in

→ View original post on X — @_akhaliq,