Search Results for author:
Found 3 papers, 0 papers with code
Joint unsupervised and supervised learning for context-aware language identification
Language identification (LID) recognizes the language of a spoken utterance automatically.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models
Extending this supervised scheme further, we introduce a new type of teacher model for connectionist temporal classification (CTC)-based sequence models, namely Oracle Teacher, that leverages both the source inputs and the output labels as the teacher model's input.
TutorNet: Towards Flexible Knowledge Distillation for End-to-End Speech Recognition
To reduce this computational burden, knowledge distillation (KD), which is a popular model compression method, has been used to transfer knowledge from a deep and complex model (teacher) to a shallower and simpler model (student).
