Improved Noisy Student Training for Automatic Speech Recognition

19 May 2020Daniel S. ParkYu ZhangYe JiaWei HanChung-Cheng ChiuBo LiYonghui WuQuoc V. Le

Recently, a semi-supervised learning method known as "noisy student training" has been shown to improve image classification performance of deep networks significantly. Noisy student training is an iterative self-training method that leverages augmentation to improve network performance... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Results from the Paper


 Ranked #1 on Speech Recognition on LibriSpeech test-clean (using extra training data)

     Get a GitHub badge
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK USES EXTRA
TRAINING DATA
RESULT BENCHMARK
Speech Recognition LibriSpeech test-clean ContextNet + SpecAugment-based Noisy Student Training with Libri-Light Word Error Rate (WER) 1.7 # 1
Speech Recognition LibriSpeech test-other ContextNet + SpecAugment-based Noisy Student Training with Libri-Light Word Error Rate (WER) 3.4 # 1

Methods used in the Paper