Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning

9 Jul 2019 • Yu Zhang • Ron J. Weiss • Heiga Zen • Yonghui Wu • Zhifeng Chen • RJ Skerry-Ryan • Ye Jia • Andrew Rosenberg • Bhuvana Ramabhadran

We present a multispeaker, multilingual text-to-speech (TTS) synthesis model based on Tacotron that is able to produce high quality speech in multiple languages. Moreover, the model is able to transfer voices across languages, e.g. synthesize fluent Spanish speech using an English speaker's voice, without training on any bilingual or parallel examples... (read more)

PDF Abstract

Results from the Paper

Edit

Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

METHOD	TYPE
Griffin-Lim Algorithm	Phase Reconstruction
Sigmoid Activation	Activation Functions
Highway Layer	Miscellaneous Components
Residual Connection	Skip Connections
Convolution	Convolutions
Batch Normalization	Normalization
Max Pooling	Pooling Operations
Residual GRU	Recurrent Neural Networks
BiGRU	Bidirectional Recurrent Neural Networks
Highway Network	Feedforward Networks
CBHG	Speech Synthesis Blocks
ReLU	Activation Functions
Dropout	Regularization
Dense Connections	Feedforward Networks
Tanh Activation	Activation Functions
Additive Attention	Attention Mechanisms
GRU	Recurrent Neural Networks
Tacotron	Text-to-Speech Models

METHOD

TYPE

Griffin-Lim Algorithm