Dataset for Automatic Summarization of Russian News

19 Jun 2020  ·  Ilya Gusev ·

Automatic text summarization has been studied in a variety of domains and languages. However, this does not hold for the Russian language. To overcome this issue, we present Gazeta, the first dataset for summarization of Russian news. We describe the properties of this dataset and benchmark several extractive and abstractive models. We demonstrate that the dataset is a valid task for methods of text summarization for Russian. Additionally, we prove the pretrained mBART model to be useful for Russian text summarization.

PDF Abstract

Datasets


Introduced in the Paper:

Gazeta

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Text Summarization Gazeta Finetuned mBART ROUGE-1 32.1 # 1
ROUGE-2 14.2 # 1
ROUGE-L 27.9 # 1
BLEU 12.4 # 1
Meteor 25.7 # 1

Methods