Cross-Lingual Transfer

62 papers with code · Natural Language Processing
Subtask of Cross-Lingual

Benchmarks

You can find evaluation results in the subtasks. You can also submitting evaluation metrics for this task.

Greatest papers with code

Unsupervised Cross-lingual Representation Learning at Scale

ACL 2020 huggingface/transformers

We also present a detailed empirical analysis of the key factors that are required to achieve these gains, including the trade-offs between (1) positive transfer and capacity dilution and (2) the performance of high and low resource languages at scale.

CROSS-LINGUAL TRANSFER LANGUAGE MODELLING REPRESENTATION LEARNING

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

15 Jul 2020microsoft/unilm

In this work, we formulate cross-lingual language model pre-training as maximizing mutual information between multilingual-multi-granularity texts.

CONTRASTIVE LEARNING CROSS-LINGUAL TRANSFER LANGUAGE MODELLING

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation

ICML 2020 google-research/xtreme

However, these broad-coverage benchmarks have been mostly limited to English, and despite an increasing interest in multilingual models, a benchmark that enables the comprehensive evaluation of such methods on a diverse range of languages and tasks is still missing.

CROSS-LINGUAL TRANSFER

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

24 Mar 2020google-research/xtreme

However, these broad-coverage benchmarks have been mostly limited to English, and despite an increasing interest in multilingual models, a benchmark that enables the comprehensive evaluation of such methods on a diverse range of languages and tasks is still missing.

CROSS-LINGUAL TRANSFER

Don't Just Scratch the Surface: Enhancing Word Representations for Korean with Hanja

IJCNLP 2019 shin285/KOMORAN

We propose a simple yet effective approach for improving Korean word representations using additional linguistic annotation (i. e. Hanja).

CROSS-LINGUAL TRANSFER TRANSFER LEARNING

Cross-Lingual Natural Language Generation via Pre-Training

23 Sep 2019CZWin32768/xnlg

In this work we focus on transferring supervision signals of natural language generation (NLG) tasks between multiple languages.

ABSTRACTIVE TEXT SUMMARIZATION CROSS-LINGUAL TRANSFER MACHINE TRANSLATION QUESTION GENERATION TEXT GENERATION

Multi-Source Cross-Lingual Model Transfer: Learning What to Share

ACL 2019 microsoft/Multilingual-Model-Transfer

In this work, we focus on the multilingual transfer setting where training data in multiple source languages is leveraged to further boost target language performance.

CROSS-LINGUAL NER TEXT CLASSIFICATION TRANSFER LEARNING

Massively Multilingual Transfer for NER

ACL 2019 afshinrahimi/mmner

In cross-lingual transfer, NLP models over one or more source languages are applied to a low-resource target language.

CROSS-LINGUAL TRANSFER FEW-SHOT LEARNING LOW RESOURCE NAMED ENTITY RECOGNITION NAMED ENTITY RECOGNITION

Choosing Transfer Languages for Cross-Lingual Learning

ACL 2019 neulab/langrank

Cross-lingual transfer, where a high-resource transfer language is used to improve the accuracy of a low-resource task language, is now an invaluable tool for improving performance of natural language processing (NLP) on low-resource languages.

CROSS-LINGUAL TRANSFER