In Neural Machine Translation, What Does Transfer Learning Transfer?

ACL 2020 Alham Fikri AjiNikolay BogoychevKenneth HeafieldRico Sennrich

Transfer learning improves quality for low-resource machine translation, but it is unclear what exactly it transfers. We perform several ablation studies that limit information transfer, then measure the quality impact across three language pairs to gain a black-box understanding of transfer learning... (read more)

PDF Abstract

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper