Search Results for author:
Found 31 papers, 7 papers with code
The Sogou-TIIC Speech Translation System for IWSLT 2018
Our final average result on speech translation is 31. 02 BLEU.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+5
DanceCamera3D: 3D Camera Movement Synthesis with Music and Dance
However, camera movement synthesis with music and dance remains an unsolved challenging problem due to the scarcity of paired data.
Siamese Meets Diffusion Network: SMDNet for Enhanced Change Detection in High-Resolution RS Imagery
This network combines the Siam-U2Net Feature Differential Encoder (SU-FDE) and the denoising diffusion implicit model to improve the accuracy of image edge change detection and enhance the model's robustness under environmental changes.
Grounding-Prompter: Prompting LLM with Multimodal Information for Temporal Sentence Grounding in Long Videos
To tackle these challenges, in this work we propose a Grounding-Prompter method, which is capable of conducting TSG in long videos through prompting LLM with multimodal information.
A Discourse-level Multi-scale Prosodic Model for Fine-grained Emotion Analysis
More interestingly, although we aim at the synthesis effect of the style transfer model, the synthesized speech by the proposed text prosodic analysis model is even better than the style transfer from the original speech in some user evaluation indicators.
Semantics2Hands: Transferring Hand Motion Semantics between Avatars
Human hands, the primary means of non-verbal communication, convey intricate semantics in various scenarios.
Versatile Face Animator: Driving Arbitrary 3D Facial Avatar in RGBD Space
Creating realistic 3D facial animation is crucial for various applications in the movie production and gaming industry, especially with the burgeoning demand in the metaverse.
Speech-Driven 3D Face Animation with Composite and Regional Facial Movements
This paper emphasizes the importance of considering both the composite and regional natures of facial movements in speech-driven 3D face animation.
Exploring the Spatiotemporal Features of Online Food Recommendation Service
Online Food Recommendation Service (OFRS) has remarkable spatiotemporal characteristics and the advantage of being able to conveniently satisfy users' needs in a timely manner.
Multi-Granularity Attention Model for Group Recommendation
Group recommendation provides personalized recommendations to a group of users based on their shared interests, preferences, and characteristics.
Mobile Supply: The Last Piece of Jigsaw of Recommender System
In order to address the problem of pagination trigger mechanism, we propose a completely new module in the pipeline of recommender system named Mobile Supply.
SDDM: Score-Decomposed Diffusion Models on Manifolds for Unpaired Image-to-Image Translation
Recent score-based diffusion models (SBDMs) show promising results in unpaired image-to-image translation (I2I).
ESMC: Entire Space Multi-Task Model for Post-Click Conversion Rate via Parameter Constraint
We propose a novel Entire Space Multi-Task Model for Post-Click Conversion Rate via Parameter Constraint (ESMC) and two alternatives: Entire Space Multi-Task Model with Siamese Network (ESMS) and Entire Space Multi-Task Model in Global Domain (ESMG) to address the PSC issue.
AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion
Large-scale pre-trained vision-language models allow for the zero-shot text-based generation of 3D avatars.
Shuffled Autoregression For Motion Interpolation
However, motion interpolation is a more complex problem that takes isolated poses (e. g., only one start pose and one end pose) as input.
MMFace4D: A Large-Scale Multi-Modal 4D Face Dataset for Audio-Driven 3D Face Animation
Upon MMFace4D, we construct a non-autoregressive framework for audio-driven 3D face animation.
BASM: A Bottom-up Adaptive Spatiotemporal Model for Online Food Ordering Service
Therefore, we address this challenge by proposing a Bottom-up Adaptive Spatiotemporal Model(BASM) to adaptively fit the spatiotemporal data distribution, which further improve the fitting capability of the model.
Spatiotemporal-Enhanced Network for Click-Through Rate Prediction in Location-based Services
In Location-Based Services(LBS), user behavior naturally has a strong dependence on the spatiotemporal information, i. e., in different geographical locations and at different times, user click behavior will change significantly.
Towards Cross-speaker Reading Style Transfer on Audiobook Dataset
This paper aims to introduce a chunk-wise multi-scale cross-speaker style model to capture both the global genre and the local prosody in audiobook speeches.
Imitating Arbitrary Talking Style for Realistic Audio-DrivenTalking Face Synthesis
Due to such huge differences between different styles, it is necessary to incorporate the talking style into audio-driven talking face synthesis framework.
Towards Multi-Scale Style Control for Expressive Speech Synthesis
This paper introduces a multi-scale speech style modeling method for end-to-end expressive speech synthesis.
ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unit
Meanwhile, human choreographers design dance motions from music in a two-stage manner: they firstly devise multiple choreographic dance units (CAUs), each with a series of dance motions, and then arrange the CAU sequence according to the rhythm, melody and emotion of the music.
Visual-speech Synthesis of Exaggerated Corrective Feedback
To provide more discriminative feedback for the second language (L2) learners to better identify their mispronunciation, we propose a method for exaggerated visual-speech feedback in computer-assisted pronunciation training (CAPT).
Speaker Independent and Multilingual/Mixlingual Speech-Driven Talking Head Generation Using Phonetic Posteriorgrams
Recent approaches mainly have following limitations: 1) most speaker-independent methods need handcrafted features that are time-consuming to design or unreliable; 2) there is no convincing method to support multilingual or mixlingual speech as input.
Mining Unfollow Behavior in Large-Scale Online Social Networks via Spatial-Temporal Interaction
Next, we define user's attributes as two categories: spatial attributes (e. g., social role of user) and temporal attributes (e. g., post content of user).
Improving Generalization of Transformer for Speech Recognition with Parallel Schedule Sampling and Relative Positional Embedding
Transformer has shown promising results in many sequence to sequence transformation tasks recently.
Automated segmentaiton and classification of arterioles and venules using Cascading Dilated Convolutional Neural Networks
The change of retinal vasculature is an early sign of many vascular and systematic diseases, such as diabetes and hypertension.
An Online Attention-based Model for Speech Recognition
In previous work, researchers have shown that such architectures can acquire comparable results to state-of-the-art ASR systems, especially when using a bidirectional encoder and global soft attention (GSA) mechanism.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Exploring RNN-Transducer for Chinese Speech Recognition
End-to-end approaches have drawn much attention recently for significantly simplifying the construction of an automatic speech recognition (ASR) system.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Modality Attention for End-to-End Audio-visual Speech Recognition
In this paper, we propose a novel multimodal attention based method for audio-visual speech recognition which could automatically learn the fused representation from both modalities based on their importance.
Audio-Visual Speech Recognition
Robust Speech Recognition
+2
Study on Feature Subspace of Archetypal Emotions for Speech Emotion Recognition
Hence, traditional methods may fail to distinguish some of the emotions with just one global feature subspace.
