I agree that the integration is impressive, esp. early fusion of 3 modalities at scale. But multimodal emotion analysis and other kinds of fusion have been well studied, check out work by @lpmorency I also worked on this ~10 years ago using late fusion
Multimodal Emotion Analysis: Early Fusion Techniques and Historical Context
By
–
Leave a Reply