MoE Training, Part 2 — in one tweet:
You start with random weights. By chance, one expert is slightly better at legal questions. Router notices, sends more its way. It gets better. Snowballs.
Same compounding loop that turns a slightly-talented 7-year-old into an IMO medalist.
—… pic.twitter.com/gXIjIRHlGZ

— Satya Mallick (@LearnOpenCV) 22 mai 2026

MoE Training, Part 2 — in one tweet:
You start with random weights. By chance, one expert is slightly better at legal questions. Router notices, sends more its way. It gets better. Snowballs.
Same compounding loop that turns a slightly-talented 7-year-old into an IMO medalist.
—

→ View original post on X — @learnopencv