Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion

1 code implementation • 7 Dec 2023 • Kiran Chhatre, Radek Daněček, Nikos Athanasiou, Giorgio Becherini, Christopher Peters, Michael J. Black, Timo Bolkart

Once trained, AMUSE synthesizes 3D human gestures directly from speech with control over the expressed emotions and style by combining the content from the driving speech with the emotion and style of another speech sequence.

Emotional Speech-Driven Animation with Content-Emotion Disentanglement

no code implementations • 15 Jun 2023 • Radek Daněček, Kiran Chhatre, Shashank Tripathi, Yandong Wen, Michael J. Black, Timo Bolkart

While the best recent methods generate 3D animations that are synchronized with the input audio, they largely ignore the impact of emotions on facial expressions.

Disentanglement Lip Reading

Parallel Bayesian Optimization of Agent-based Transportation Simulation

1 code implementation • 11 Jul 2022 • Kiran Chhatre, Sidney Feygin, Colin Sheppard, Rashid Waraich

With our model, we could achieve a 25% L1 norm for a large-scale BEAM simulation in fully autonomous manner.

Bayesian Optimization