Unity by Diversity: Improved Representation Learning in Multimodal VAEs

Published in arxiv, 2024

Recommended citation: TM Sutter, Y Meng, A Agostini, D Chopard, N Fortin, JE Vogt, B Shahbaba, S Mandt (2024) "Unity by Diversity: Improved Representation Learning in Multimodal VAEs." arxiv. https://arxiv.org/abs/2403.05300

We propose a novel multimodal VAE that enables multimodal capabilities by only soft-sharing of information between modalities.

Download paper here

Recommended citation: TM Sutter, Y Meng, A Agostini, D Chopard, N Fortin, JE Vogt, B Shahbaba, S Mandt. (2024) “Unity by Diversity: Improved Representation Learning in Multimodal VAEs.” arxiv.