mt5 is a multilingual variant of T5 that was pre-trained on a new Common Crawl-based dataset covering $101$ languages.
Source: mT5: A massively multilingual pre-trained text-to-text transformerPaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Language Modelling | 15 | 7.89% |
Translation | 12 | 6.32% |
Question Answering | 12 | 6.32% |
Machine Translation | 11 | 5.79% |
Natural Language Understanding | 9 | 4.74% |
Cross-Lingual Transfer | 9 | 4.74% |
XLM-R | 8 | 4.21% |
Abstractive Text Summarization | 7 | 3.68% |
Text Generation | 5 | 2.63% |