AI Dynamics

Global AI News Aggregator

About

MoE model with 26B params, 3.8B active at inference

Efficiency note: 26 billion parameter mixture of experts, only 3.8 billion parameters active at inference. Which of your workflows are really editing problems dressed up as generation problems? Don't miss out on the latest AI advancements! Sign up here to stay informed!

→ View original post on X — @ronald_vanloon