UNER v1 (Universal NER v1)

Introduced by Mayhew et al. in Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark

UNER v1 adds an NER annotation layer to 18 datasets (primarily treebanks from UD) and covers 12 geneologically and ty- pologically diverse languages: Cebuano, Danish, German, English, Croatian, Portuguese, Russian, Slovak, Serbian, Swedish, Tagalog, and Chinese4. Overall, UNER v1 contains nine full datasets with training, development, and test splits over eight languages, three evaluation sets for lower-resource languages (TL and CEB), and a parallel evaluation benchmark spanning six languages.

Homepage

Benchmarks

Add a new result Link an existing benchmark

Task	Dataset Variant	Best Model
Named Entity Recognition (NER)	UNER v1 (Danish)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (English)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Croatian)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Portuguese)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Slovak)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Serbian)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Swedish)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Chinese)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 (Chinese Simplified)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 - PUD (English)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 - PUD (Portuguese)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 - PUD (Swedish)	UNER XML-R
Named Entity Recognition (NER)	UNER v1 - PUD (Chinese)	UNER XML-R
Cross-Lingual NER	UNER v1 - PUD (Chinese)	UNER XML-R
Cross-Lingual NER	UNER v1 (Danish)	UNER XML-R
Cross-Lingual NER	UNER v1 (English)	UNER XML-R
Cross-Lingual NER	UNER v1 (Croatian)	UNER XML-R
Cross-Lingual NER	UNER v1 (Portuguese)	UNER XML-R
Cross-Lingual NER	UNER v1 (Slovak)	UNER XML-R
Cross-Lingual NER	UNER v1 (Serbian)	UNER XML-R
Cross-Lingual NER	UNER v1 (Swedish)	UNER XML-R
Cross-Lingual NER	UNER v1 (Chinese)	UNER XML-R
Cross-Lingual NER	UNER v1 (Chinese Simplified)	UNER XML-R
Cross-Lingual NER	UNER v1 - PUD (German)	UNER XML-R
Cross-Lingual NER	UNER v1 - PUD (English)	UNER XML-R
Cross-Lingual NER	UNER v1 - PUD (Portuguese)	UNER XML-R
Cross-Lingual NER	UNER v1 - PUD (Russian)	UNER XML-R
Cross-Lingual NER	UNER v1 - PUD (Swedish)	UNER XML-R
Cross-Lingual NER	UNER v1 (Cebuano)	UNER XML-R
Cross-Lingual NER	UNER v1 (Tagalog U)	UNER XML-R
Cross-Lingual NER	UNER v1 (Tagalog T)	UNER XML-R