About

This task deals with lip-syncing a video (or) an image to the desired target speech. Approaches in this task work only for a specific (limited set) of identities, languages, speech/voice. See also: Unconstrained lip-synchronization - https://paperswithcode.com/task/lip-sync

Benchmarks

No evaluation results yet. Help compare methods by submit evaluation metrics.

Latest papers with code

Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization

29 May 2020abhinavdhall/deepfake

MDS is computed as an aggregate of dissimilarity scores between audio and visual segments in a video.

CONSTRAINED LIP-SYNCHRONIZATION DEEPFAKE DETECTION FACE SWAPPING

5
29 May 2020

Real-Time Lip Sync for Live 2D Animation

19 Oct 2019deepalianeja/CharacterLipSync2D

The emergence of commercial tools for real-time performance-based 2D animation has enabled 2D characters to appear on live broadcasts and streaming platforms.

CONSTRAINED LIP-SYNCHRONIZATION DATA AUGMENTATION

66
19 Oct 2019

DeepFakes: a New Threat to Face Recognition? Assessment and Detection

20 Dec 2018CatoGit/Comparing-the-Performance-of-Deepfake-Detection-Methods-on-Benchmark-Datasets

The best performing method, which is based on visual quality metrics and is often used in presentation attack detection domain, resulted in 8. 97% equal error rate on high quality Deepfakes.

CONSTRAINED LIP-SYNCHRONIZATION FACE RECOGNITION FACE SWAPPING

16
20 Dec 2018

Talking Face Generation by Conditional Recurrent Adversarial Network

13 Apr 2018susanqq/Talking_Face_Generation

Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial movement over the entire video clip.

CONSTRAINED LIP-SYNCHRONIZATION VIDEO GENERATION

40
13 Apr 2018

ObamaNet: Photo-realistic lip-sync from text

6 Dec 2017ung200/thats-what-obama-said

We present ObamaNet, the first architecture that generates both audio and synchronized photo-realistic lip-sync videos from any new text.

CONSTRAINED LIP-SYNCHRONIZATION

17
06 Dec 2017