Search Results for author:
Found 6 papers, 0 papers with code
On the differences between BERT and MT encoder spaces and how to address them in translation tasks
Various studies show that pretrained language models such as BERT cannot straightforwardly replace encoders in neural machine translation despite their enormous success in other tasks.
The University of Helsinki Submission to the IWSLT2020 Offline SpeechTranslation Task
This paper describes the University of Helsinki Language Technology group{'}s participation in the IWSLT 2020 offline speech translation task, addressing the translation of English audio into German text.
A Systematic Study of Inner-Attention-Based Sentence Representations in Multilingual Neural Machine Translation
In particular, we show that larger intermediate layers not only improve translation quality, especially for long sentences, but also push the accuracy of trainable classification tasks.
The University of Helsinki Submissions to the WMT19 Similar Language Translation Task
This paper describes the University of Helsinki Language Technology group{'}s participation in the WMT 2019 similar language translation task.
An Evaluation of Language-Agnostic Inner-Attention-Based Representations in Machine Translation
In this paper, we explore a multilingual translation model with a cross-lingually shared layer that can be used as fixed-size sentence representation in different downstream tasks.
The University of Helsinki Submission to the WMT19 Parallel Corpus Filtering Task
This paper describes the University of Helsinki Language Technology group{'}s participation in the WMT 2019 parallel corpus filtering task.
