Search Results for author:
Found 6 papers, 5 papers with code
Speech inpainting: Context-based speech synthesis guided by video
Audio and visual modalities are inherently connected in speech signals: lip movements and facial expressions are correlated with speech sounds.
VocaLiST: An Audio-Visual Synchronisation Model for Lips and Voices
Finally, we use the frozen visual features learned by our lip synchronisation model in the singing voice separation task to outperform a baseline audio-visual model which was trained end-to-end.
VoViT: Low Latency Graph-based Audio-Visual Voice Separation Transformer
In a second stage, the predominant voice is enhanced with an audio-only network.
A cappella: Audio-visual Singing Voice Separation
The task of isolating a target singing voice in music videos has useful applications.
Solos: A Dataset for Audio-Visual Music Analysis
In this paper, we present a new dataset of music performance videos which can be used for training machine learning methods for multiple tasks such as audio-visual blind source separation and localization, cross-modal correspondences, cross-modal generation and, in general, any audio-visual selfsupervised task.
Audio Source Separation
Audio-Visual Synchronization
+1
Audio and Speech Processing
Databases
Sound
Multi-channel U-Net for Music Source Separation
However, Conditioned U-Net (C-U-Net) uses a control mechanism to train a single model for multi-source separation and attempts to achieve a performance comparable to that of the dedicated models.
