ÚFAL at MRP 2020: Permutation-invariant Semantic Parsing in PERIN

2 Nov 2020  ·  David Samuel, Milan Straka ·

We present PERIN, a novel permutation-invariant approach to sentence-to-graph semantic parsing. PERIN is a versatile, cross-framework and language independent architecture for universal modeling of semantic structures. Our system participated in the CoNLL 2020 shared task, Cross-Framework Meaning Representation Parsing (MRP 2020), where it was evaluated on five different frameworks (AMR, DRG, EDS, PTG and UCCA) across four languages. PERIN was one of the winners of the shared task. The source code and pretrained models are available at https://github.com/ufal/perin.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semantic Parsing AMR (chinese, MRP 2020) PERIN F1 80.52 # 1
Semantic Parsing AMR (english, MRP 2020) PERIN F1 80.23 # 1
Semantic Parsing DRG (english, MRP 2020) PERIN F1 94.16 # 1
Semantic Parsing DRG (german, MRP 2020) PERIN F1 89.83 # 1
Semantic Parsing EDS (english, MRP 2020) PERIN F1 92.73 # 1
Semantic Parsing PTG (czech, MRP 2020) PERIN F1 92.24 # 2
Semantic Parsing PTG (english, MRP 2020) PERIN F1 89.19 # 1
Semantic Parsing UCCA (english, MRP 2020) PERIN F1 76.4 # 1
Semantic Parsing UCCA (german, MRP 2020) PERIN F1 81.01 # 1

Methods


No methods listed for this paper. Add relevant methods here