Multimodal sentiment analysis and emotion recognition endeavour to capture and interpret human affect through a synthesis of diverse sensory inputs, including textual, visual and acoustic modalities.

This study is led by Prof. Jianhua Tao(Department of Automation，Tsinghua University) . Affective computing is an important branch in the field of artificial intelligence. Multimodal emotion ...

Stage 1 captures the interaction between unimodal modalities; Stage 2 focuses on the potential adaptation between fusion representations, enhancing emotion prediction accuracy. Social media ...