New research from Meta FAIR: MoMa — Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts https://
go.fb.me/kz3b0c This paper introduces modality-aware sparse architectures for early fusion, mixed-modality foundation models and opens up several promising

→ View original post on X — @aiatmeta,