no code implementations • 13 Nov 2023 • Dota Tianai Dong, Mariya Toneva
Using brain recordings of participants watching a popular TV show, we analyze the effects of multi-modal connections and interactions in a pre-trained multi-modal video transformer on the alignment with uni- and multi-modal brain regions.
