Datasets

9,500 machine learning datasets
Filter by Task (clear)
Word Embeddings Language Modelling 5 Language Identification 3 Machine Translation 3 Question Answering 3 Cross-Lingual Question Answering 2 Image Retrieval 2 Language Acquisition 2 Multilingual NLP 2 Reading Comprehension 2 Audio Source Separation 1 Automatic Speech Recognition 1 Automatic Speech Recognition (ASR) 1 Chinese Reading Comprehension 1 Chinese Sentence Pair Classification 1 Classification 1 Coreference Resolution 1 Cross-Lingual Document Classification 1 Cross-Lingual NER 1 Cross-Lingual Natural Language Inference 1 Cross-Lingual Sentiment Classification 1 Cross-Lingual Transfer 1 Dependency Parsing 1 FLUE 1 Image Captioning 1 Knowledge Base Question Answering 1 Large Language Model 1 Machine Reading Comprehension 1 Morphological Tagging 1 Multilingual Image-Text Classification 1 Multilingual Machine Comprehension in English Hindi 1 Multilingual text classification 1 Multimodal Deep Learning 1 Multiple-choice 1 Named Entity Recognition 1 Named Entity Recognition (NER) 1 Natural Language Inference 1 Natural Language Understanding 1 Natural Questions 1 Optical Character Recognition (OCR) 1 Paraphrase Generation 1 Part-Of-Speech Tagging 1 Predicate Detection 1 Pretrained Multilingual Language Models 1 Question Generation 1 Reading Comprehension (Few-Shot) 1 Reading Comprehension (One-Shot) 1 Reading Comprehension (Zero-Shot) 1 Semantic Role Labeling 1 Semantic Role Labeling (predicted predicates) 1 Sentence segmentation 1 Sequential sentence segmentation 1 Speaker Verification 1 Speech Recognition 1 Speech Separation 1 Talking Head Generation 1 Text Classification 1 Text Generation 1 Text Segmentation 1 Text-to-Image Generation 1 Token Classification 1 Translation 1 Translation afr-deu 1 Translation afr-eng 1 Translation ara-cat 1 Translation ara-dan 1 Translation ara-eng 1 Translation ara-fra 1 Translation ara-glg 1 Translation ara-ita 1 Translation ara-nob 1 Translation ara-por 1 Translation ara-ron 1 Translation ara-spa 1 Translation ara-swe 1 Translation ast-cat 1 Translation ast-fra 1 Translation ast-glg 1 Translation ast-ita 1 Translation ast-oci 1 Translation ast-por 1 Translation ast-ron 1 Translation ast-spa 1 Translation bel-cat 1 Translation bel-fra 1 Translation bel-glg 1 Translation bel-ita 1 Translation bel-por 1 Translation bel-ron 1 Translation bel-spa 1 Translation bul-deu 1 Translation bul-eng 1 Translation bul-fra 1 Translation bul-ita 1 Translation bul-por 1 Translation bul-ron 1 Translation bul-rus 1 Translation bul-spa 1 Translation bul-ukr 1 Translation cat-ara 1 Translation cat-ast 1 Translation cat-eng 1 Translation cat-fra 1 Translation cat-glg 1 Translation cat-heb 1 Translation cat-ita 1 Translation cat-lav 1 Translation cat-lit 1 Translation cat-oci 1 Translation cat-por 1 Translation cat-ron 1 Translation cat-spa 1 Translation cat-tur 1 Translation ces-eng 1 Translation ces-rus 1 Translation ces-ukr 1 Translation cym-eng 1 Translation dan-ara 1 Translation dan-cat 1 Translation dan-ces 1 Translation dan-eng 1 Translation dan-fra 1 Translation dan-glg 1 Translation dan-heb 1 Translation dan-isl 1 Translation dan-ita 1 Translation dan-nob 1 Translation dan-pol 1 Translation dan-por 1 Translation dan-ron 1 Translation dan-rus 1 Translation dan-spa 1 Translation dan-swe 1 Translation dan-tur 1 Translation dan-ukr 1 Translation deu-afr 1 Translation deu-dan 1 Translation deu-eng 1 Translation deu-isl 1 Translation deu-nob 1 Translation deu-rus 1 Translation deu-spa 1 Translation deu-swe 1 Translation deu-ukr 1 Translation ell-eng 1 Translation eng-afr 1 Translation eng-ara 1 Translation eng-bul 1 Translation eng-cat 1 Translation eng-ces 1 Translation eng-dan 1 Translation eng-deu 1 Translation eng-ell 1 Translation eng-est 1 Translation eng-fin 1 Translation eng-fra 1 Translation eng-hrv 1 Translation eng-hun 1 Translation eng-isl 1 Translation eng-ita 1 Translation eng-kor 1 Translation eng-lav 1 Translation eng-lit 1 Translation eng-nld 1 Translation eng-nob 1 Translation eng-oci 1 Translation eng-por 1 Translation eng-ron 1 Translation eng-rus 1 Translation eng-slk 1 Translation eng-spa 1 Translation eng-srp_Cyrl 1 Translation eng-swe 1 Translation eng-tur 1 Translation eng-ukr 1 Translation est-eng 1 Translation fas-dan 1 Translation fas-fra 1 Translation fas-ita 1 Translation fas-por 1 Translation fas-ron 1 Translation fas-spa 1 Translation fin-bul 1 Translation fin-eng 1 Translation fin-hrv 1 Translation fin-rus 1 Translation fin-slv 1 Translation fin-srp_Cyrl 1 Translation fin-ukr 1 Translation fra-ara 1 Translation fra-ast 1 Translation fra-cat 1 Translation fra-eng 1 Translation fra-glg 1 Translation fra-heb 1 Translation fra-ita 1 Translation fra-lav 1 Translation fra-lit 1 Translation fra-oci 1 Translation fra-por 1 Translation fra-ron 1 Translation fra-rus 1 Translation fra-spa 1 Translation fra-tur 1 Translation fra-ukr 1 Translation gle-eng 1 Translation glg-ara 1 Translation glg-ast 1 Translation glg-cat 1 Translation glg-fra 1 Translation glg-heb 1 Translation glg-ita 1 Translation glg-lav 1 Translation glg-lit 1 Translation glg-oci 1 Translation glg-por 1 Translation glg-ron 1 Translation glg-spa 1 Translation glg-tur 1 Translation heb-cat 1 Translation heb-dan 1 Translation heb-eng 1 Translation heb-fra 1 Translation heb-glg 1 Translation heb-isl 1 Translation heb-ita 1 Translation heb-nob 1 Translation heb-por 1 Translation heb-ron 1 Translation heb-spa 1 Translation heb-swe 1 Translation hrv-deu 1 Translation hrv-eng 1 Translation hrv-fra 1 Translation hrv-ita 1 Translation hrv-por 1 Translation hrv-ron 1 Translation hrv-rus 1 Translation hrv-spa 1 Translation hrv-ukr 1 Translation hun-eng 1 Translation isl-cat 1 Translation isl-ces 1 Translation isl-dan 1 Translation isl-eng 1 Translation isl-fra 1 Translation isl-glg 1 Translation isl-heb 1 Translation isl-ita 1 Translation isl-nob 1 Translation isl-pol 1 Translation isl-por 1 Translation isl-ron 1 Translation isl-spa 1 Translation isl-swe 1 Translation ita-ara 1 Translation ita-ast 1 Translation ita-cat 1 Translation ita-eng 1 Translation ita-fra 1 Translation ita-glg 1 Translation ita-heb 1 Translation ita-lav 1 Translation ita-lit 1 Translation ita-oci 1 Translation ita-por 1 Translation ita-ron 1 Translation ita-rus 1 Translation ita-spa 1 Translation ita-tur 1 Translation kor-eng 1 Translation lav-eng 1 Translation lav-rus 1 Translation lit-eng 1 Translation lit-rus 1 Translation mkd-deu 1 Translation mkd-eng 1 Translation mkd-fra 1 Translation mkd-ita 1 Translation mkd-por 1 Translation mkd-ron 1 Translation mkd-rus 1 Translation mkd-spa 1 Translation mkd-ukr 1 Translation nld-eng 1 Translation nob-ara 1 Translation nob-cat 1 Translation nob-ces 1 Translation nob-dan 1 Translation nob-eng 1 Translation nob-fra 1 Translation nob-glg 1 Translation nob-heb 1 Translation nob-isl 1 Translation nob-ita 1 Translation nob-pol 1 Translation nob-por 1 Translation nob-ron 1 Translation nob-rus 1 Translation nob-spa 1 Translation nob-swe 1 Translation nob-tur 1 Translation nob-ukr 1 Translation oci-ast 1 Translation oci-cat 1 Translation oci-eng 1 Translation oci-fra 1 Translation oci-glg 1 Translation oci-ita 1 Translation oci-por 1 Translation oci-ron 1 Translation oci-spa 1 Translation oci-tur 1 Translation pol-eng 1 Translation pol-rus 1 Translation por-ara 1 Translation por-ast 1 Translation por-cat 1 Translation por-fra 1 Translation por-glg 1 Translation por-heb 1 Translation por-ita 1 Translation por-lav 1 Translation por-lit 1 Translation por-oci 1 Translation por-ron 1 Translation por-rus 1 Translation por-spa 1 Translation por-tur 1 Translation por-ukr 1 Translation ron-ara 1 Translation ron-ast 1 Translation ron-cat 1 Translation ron-fra 1 Translation ron-glg 1 Translation ron-heb 1 Translation ron-ita 1 Translation ron-oci 1 Translation ron-por 1 Translation ron-spa 1 Translation ron-tur 1 Translation ron-ukr 1 Translation rus-ast 1 Translation rus-bul 1 Translation rus-cat 1 Translation rus-ces 1 Translation rus-dan 1 Translation rus-deu 1 Translation rus-eng 1 Translation rus-fin 1 Translation rus-fra 1 Translation rus-glg 1 Translation rus-hrv 1 Translation rus-ita 1 Translation rus-lav 1 Translation rus-lit 1 Translation rus-mkd 1 Translation rus-nob 1 Translation rus-oci 1 Translation rus-por 1 Translation rus-ron 1 Translation rus-slv 1 Translation rus-spa 1 Translation rus-srp_Cyrl 1 Translation rus-swe 1 Translation rus-ukr 1 Translation slk-eng 1 Translation slk-ukr 1 Translation slv-deu 1 Translation slv-eng 1 Translation slv-fra 1 Translation slv-ita 1 Translation slv-por 1 Translation slv-ron 1 Translation slv-rus 1 Translation slv-spa 1 Translation slv-ukr 1 Translation spa-ara 1 Translation spa-ast 1 Translation spa-cat 1 Translation spa-eng 1 Translation spa-fra 1 Translation spa-glg 1 Translation spa-heb 1 Translation spa-ita 1 Translation spa-lav 1 Translation spa-lit 1 Translation spa-oci 1 Translation spa-por 1 Translation spa-ron 1 Translation spa-rus 1 Translation spa-tur 1 Translation srp_Cyrl-deu 1 Translation srp_Cyrl-eng 1 Translation srp_Cyrl-fra 1 Translation srp_Cyrl-ita 1 Translation srp_Cyrl-por 1 Translation srp_Cyrl-ron 1 Translation srp_Cyrl-rus 1 Translation srp_Cyrl-spa 1 Translation srp_Cyrl-ukr 1 Translation swe-ara 1 Translation swe-cat 1 Translation swe-ces 1 Translation swe-dan 1 Translation swe-eng 1 Translation swe-fra 1 Translation swe-glg 1 Translation swe-heb 1 Translation swe-isl 1 Translation swe-ita 1 Translation swe-nob 1 Translation swe-pol 1 Translation swe-por 1 Translation swe-ron 1 Translation swe-rus 1 Translation swe-spa 1 Translation swe-tur 1 Translation swe-ukr 1 Translation tur-eng 1 Translation ukr-ast 1 Translation ukr-bul 1 Translation ukr-cat 1 Translation ukr-ces 1 Translation ukr-dan 1 Translation ukr-deu 1 Translation ukr-eng 1 Translation ukr-fin 1 Translation ukr-fra 1 Translation ukr-glg 1 Translation ukr-hrv 1 Translation ukr-hun 1 Translation ukr-ita 1 Translation ukr-lav 1 Translation ukr-lit 1 Translation ukr-mkd 1 Translation ukr-nob 1 Translation ukr-oci 1 Translation ukr-por 1 Translation ukr-ron 1 Translation ukr-rus 1 Translation ukr-slk 1 Translation ukr-slv 1 Translation ukr-spa 1 Translation ukr-srp_Cyrl 1 Translation ukr-swe 1 Translation ukr-tur 1 Vietnamese Machine Reading Comprehension 1 Visual Question Answering (VQA) 1 XLM-R 1 Zero-shot Image Retrieval 1 Zero-shot Text Retrieval 1 speech-recognition 1
Filter by Language (clear)
Multilingual English 18 Spanish 7 Bengali 5 Chinese 5 German 5 French 4 Dutch 3 Italian 3 Japanese 3 Russian 3 Arabic 2 Aragonese 2 Armenian 2 Assamese 2 Bavarian 2 Bishnupriya 2 Breton 2 Chechen 2 Egyptian Arabic 2 Gujarati 2 Indonesian 2 Kannada 2 Malayalam 2 Marathi 2 Oriya (macrolanguage) 2 Polish 2 Portuguese 2 South Azerbaijani 2 Tamil 2 Tatar 2 Telugu 2 Turkish 2 Abkhazian 1 Achinese 1 Adyghe 1 Afar 1 Afrikaans 1 Akan 1 Albanian 1 Amharic 1 Arpitan 1 Asturian 1 Avaric 1 Aymara 1 Azerbaijani 1 Bambara 1 Banjar 1 Bashkir 1 Basque 1 Belarusian 1 Bislama 1 Bosnian 1 Buginese 1 Bulgarian 1 Burmese 1 Catalan 1 Cebuano 1 Central Bikol 1 Central Khmer 1 Central Kurdish 1 Chamorro 1 Cherokee 1 Cheyenne 1 Choctaw 1 Church Slavic 1 Chuvash 1 Cornish 1 Corsican 1 Cree 1 Creek 1 Crimean Tatar 1 Croatian 1 Czech 1 Danish 1 Dhivehi 1 Dimli (individual language) 1 Dzongkha 1 Eastern Mari 1 Erzya 1 Esperanto 1 Estonian 1 Ewe 1 Extremaduran 1 Faroese 1 Fiji Hindi 1 Fijian 1 Finnish 1 Friulian 1 Fulah 1 Gagauz 1 Galician 1 Gan Chinese 1 Ganda 1 Georgian 1 Gilaki 1 Goan Konkani 1 Gothic 1 Guarani 1 Haitian 1 Hakka Chinese 1 Hausa 1 Hawaiian 1 Hebrew 1 Herero 1 Hindi 1 Hiri Motu 1 Hungarian 1 Icelandic 1 Ido 1 Igbo 1 Iloko 1 Interlingua (International Auxiliary Language Association) 1 Interlingue 1 Inuktitut 1 Inupiaq 1 Irish 1 Jamaican Creole English 1 Javanese 1 Kabardian 1 Kabyle 1 Kalaallisut 1 Kalmyk 1 Kanuri 1 Kara-Kalpak 1 Karachay-Balkar 1 Kashmiri 1 Kashubian 1 Kazakh 1 Kikuyu 1 Kinyarwanda 1 Kirghiz 1 Komi 1 Komi-Permyak 1 Kongo 1 Korean 1 Kuanyama 1 Kurdish 1 Kölsch 1 Ladino 1 Lak 1 Lao 1 Latgalian 1 Latin 1 Latvian 1 Lezghian 1 Ligurian 1 Limburgan 1 Lingala 1 Lithuanian 1 Livvi 1 Lojban 1 Lombard 1 Low German 1 Lower Sorbian 1 Luxembourgish 1 Macedonian 1 Maithili 1 Malagasy 1 Malay (macrolanguage) 1 Maltese 1 Manx 1 Maori 1 Marshallese 1 Mazanderani 1 Min Dong Chinese 1 Minangkabau 1 Mingrelian 1 Mirandese 1 Modern Greek (1453-) 1 Moksha 1 Mongolian 1 Narom 1 Nauru 1 Navajo 1 Ndonga 1 Neapolitan 1 Nepali (macrolanguage) 1 Newari 1 Northern Frisian 1 Northern Luri 1 Northern Sami 1 Norwegian 1 Norwegian Nynorsk 1 Novial 1 Nyanja 1 Occitan (post 1500) 1 Official Aramaic (700-300 BCE) 1 Old English (ca. 450-1100) 1 Oromo 1 Ossetian 1 Pali 1 Pampanga 1 Pangasinan 1 Papiamento 1 Pedi 1 Pennsylvania German 1 Persian 1 Pfaelzisch 1 Picard 1 Piemontese 1 Pitcairn-Norfolk 1 Pontic 1 Punjabi 1 Pushto 1 Quechua 1 Romanian 1 Romansh 1 Rundi 1 Russia Buriat 1 Rusyn 1 Samoan 1 Sango 1 Sanskrit 1 Sardinian 1 Saterfriesisch 1 Scots 1 Scottish Gaelic 1 Serbian 1 Serbo-Croatian 1 Shona 1 Sichuan Yi 1 Sicilian 1 Silesian 1 Sindhi 1 Sinhala 1 Slovak 1 Slovenian 1 Somali 1 Southern Sotho 1 Sranan Tongo 1 Sundanese 1 Swahili (macrolanguage) 1 Swati 1 Swedish 1 Tagalog 1 Tahitian 1 Tajik 1 Tetum 1 Thai 1 Tibetan 1 Tigrinya 1 Tok Pisin 1 Tonga (Tonga Islands) 1 Tosk Albanian 1 Tsonga 1 Tswana 1 Tulu 1 Tumbuka 1 Turkmen 1 Tuvinian 1 Twi 1 Udmurt 1 Uighur 1 Ukrainian 1 Upper Sorbian 1 Urdu 1 Uzbek 1 Venda 1 Venetian 1 Veps 1 Vietnamese 1 Vlaams 1 Vlax Romani 1 Volapük 1 Walloon 1 Waray (Philippines) 1 Welsh 1 Western Frisian 1 Western Mari 1 Western Panjabi 1 Wolof 1 Wu Chinese 1 Xhosa 1 Yakut 1 Yiddish 1 Yoruba 1 Zeeuws 1 Zhuang 1 Zulu 1 Akkadian 0 Akuntsu 0 American Sign Language 0 Ancient Greek 0 Ancient Hebrew 0 Apurinã 0 Argentine Sign Language 0 Assyrian Neo-Aramaic 0 Bangala 0 Bangladeshi Sign Language 0 Bemba (Zambia) 0 Bhojpuri 0 Bodo (India) 0 Central Pashto 0 Chavacano 0 Chukot 0 Congo Swahili 0 Coptic 0 Dogri (individual language) 0 Dogri (macrolanguage) 0 Filipino 0 Fon 0 Geez 0 German Sign Language 0 Greek 0 Greek Sign Language 0 Gulf Arabic 0 Hakha Chin 0 Halh Mongolian 0 Iranian Persian 0 Jejueo 0 Kabuverdianu 0 Kachin 0 Karelian 0 Khunsari 0 Komi-Zyrian 0 Krio 0 Literary Chinese 0 Lozi 0 Lunda 0 Luo (Cameroon) 0 Luo (Kenya and Tanzania) 0 Lushai 0 Malay (individual language) 0 Mandarin Chinese 0 Manipuri 0 Mbyá Guaraní 0 Mesopotamian Arabic 0 Modern Greek 0 Moroccan Arabic 0 Mundurukú 0 Najdi Arabic 0 Naxi 0 Nayini 0 Nepali (individual language) 0 Nigerian Fulfulde 0 Nigerian Pidgin 0 North Azerbaijani 0 North Levantine Arabic 0 Northern Huishui Hmong 0 Northern Kurdish 0 Northern Uzbek 0 Norwegian Bokmål 0 Odia 0 Old French 0 Old Russian 0 Old Turkish 0 Plateau Malagasy 0 Portuguse 0 Rajasthani 0 Saidi Arabic 0 Santali 0 Shan 0 Skolt Sami 0 Soi 0 South Levantine Arabic 0 Southern Pashto 0 Standard Arabic 0 Standard Latvian 0 Swahili 0 Swedish Sign Language 0 Swiss German 0 Swiss-German Sign Language 0 Tai 0 Tonga (Zambia) 0 Tunisian Arabic 0 Tupinambá 0 Turkish Sign Language 0 Votic 0 Warlpiri 0 West Central Oromo 0 Yue Chinese 0 Zaza 0