UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task

CONLL 2018  ·  Milan Straka ·

UDPipe is a trainable pipeline which performs sentence segmentation, tokenization, POS tagging, lemmatization and dependency parsing. We present a prototype for UDPipe 2.0 and evaluate it in the CoNLL 2018 UD Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, which employs three metrics for submission ranking. Out of 26 participants, the prototype placed first in the MLAS ranking, third in the LAS ranking and third in the BLEX ranking. In extrinsic parser evaluation EPE 2018, the system ranked first in the overall score.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Dependency Parsing Universal Dependencies UDPipe 2.0 LAS 73.11 # 6
UAS 61.25 # 4
BLEX 64.49 # 3

Methods


No methods listed for this paper. Add relevant methods here