Search Results for author:
Found 7 papers, 3 papers with code
Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation
Drawing inspiration from state-of-the-art Text-to-Image (T2I) diffusion models, we introduce Auffusion, a TTA system adapting T2I model frameworks to TTA task, by effectively leveraging their inherent generative strengths and precise cross-modal alignment.
Ranked #5 on
Audio Generation
on AudioCaps
Frame-level emotional state alignment method for speech emotion recognition
To address this problem, we propose a frame-level emotional state alignment method for SER.
CONCSS: Contrastive-based Context Comprehension for Dialogue-appropriate Prosody in Conversational Speech Synthesis
In this paper, we introduce a contrastive learning-based CSS framework, CONCSS.
Rhythm-controllable Attention with High Robustness for Long Sentence Speech Synthesis
Regressive Text-to-Speech (TTS) system utilizes attention mechanism to generate alignment between text and acoustic feature sequence.
M2-CTTS: End-to-End Multi-scale Multi-modal Conversational Text-to-Speech Synthesis
However, it is still a challenge to comprehensively model the conversation, and a majority of conversational TTS systems only focus on extracting global information and omit local prosody features, which contain important fine-grained information like keywords and emphasis.
A Keypoint Based Enhancement Method for Audio Driven Free View Talking Head Synthesis
Then we used keypoint decomposition to extract video synthesis controlling parameters from the backend output and the source image.
ECAPA-TDNN for Multi-speaker Text-to-speech Synthesis
In recent years, neural network based methods for multi-speaker text-to-speech synthesis (TTS) have made significant progress.
