Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism

1 code implementation • 11 Dec 2023 • Georgios Milis, Panagiotis P. Filntisis, Anastasios Roussos, Petros Maragos

Our method, which we call NEUral Text to ARticulate Talk (NEUTART), is a talking face generator that uses a joint audiovisual feature space, as well as speech-informed 3D facial reconstructions and a lip-reading loss for visual supervision.

Lip Reading Speech Synthesis +1