About

This task deals with lip-syncing a video (or) an image to the desired target speech. Approaches in this task work only for a specific (limited set) of identities, languages, speech/voice. See also: Unconstrained lip-synchronization - https://paperswithcode.com/task/lip-sync

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Latest papers without code

A Neural Lip-Sync Framework for Synthesizing Photorealistic Virtual News Anchors

20 Feb 2020

Lip sync has emerged as a promising technique for generating mouth movements from audio signals.

CONSTRAINED LIP-SYNCHRONIZATION IMAGE-TO-IMAGE TRANSLATION NEURAL RENDERING

Dynamic Temporal Alignment of Speech to Lips

19 Aug 2018

This alignment is based on deep audio-visual features, mapping the lips video and the speech signal to a shared representation.

CONSTRAINED LIP-SYNCHRONIZATION VIDEO ALIGNMENT

Speech-Driven Facial Reenactment Using Conditional Generative Adversarial Networks

20 Mar 2018

We present a novel approach to generating photo-realistic images of a face with accurate lip sync, given an audio input.

CONSTRAINED LIP-SYNCHRONIZATION