Search Results for author:
Found 6 papers, 2 papers with code
META4: Semantically-Aligned Generation of Metaphoric Gestures Using Self-Supervised Text and Speech Representation
Our approach is the first method for generating speech driven metaphoric gestures while leveraging the potential of Image Schemas.
TranSTYLer: Multimodal Behavioral Style Transfer for Facial and Body Gestures Generation
Behavior expressivity style is viewed here as the qualitative properties of behaviors.
ZS-MSTM: Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding
In this study, we address the importance of modeling behavior style in virtual agents for personalized human-agent interaction.
AMII: Adaptive Multimodal Inter-personal and Intra-personal Model for Adapted Behavior Synthesis
We propose AMII, a novel approach to synthesize adaptive facial gestures for SIAs while interacting with Users and acting interchangeably as a speaker or as a listener.
Zero-Shot Style Transfer for Gesture Animation driven by Text and Speech using Adversarial Disentanglement of Multimodal Style Encoding
The third goal is to allow zero shot style transfer of speakers unseen during training without retraining the model.
Transformer Network for Semantically-Aware and Speech-Driven Upper-Face Generation
We propose a semantically-aware speech driven model to generate expressive and natural upper-facial and head motion for Embodied Conversational Agents (ECA).
