Knowledge distillation is indeed one of the methods that can create expert child AIs. Regarding Graph Neural Networks (GNNs), they can be compared—though not identical—to approaches where the parent AI queries child AIs, which also resembles a Mixture of Experts (MoE) model.

→ View original post on X — @dfintelligence