JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension

3 Feb 2022  ·  ByungHoon So, Kyuhong Byun, Kyungwon Kang, Seongjin Cho ·

Question Answering (QA) is a task in which a machine understands a given document and a question to find an answer. Despite impressive progress in the NLP area, QA is still a challenging problem, especially for non-English languages due to the lack of annotated datasets. In this paper, we present the Japanese Question Answering Dataset, JaQuAD, which is annotated by humans. JaQuAD consists of 39,696 extractive question-answer pairs on Japanese Wikipedia articles. We finetuned a baseline model which achieves 78.92% for F1 score and 63.38% for EM on test set. The dataset and our experiments are available at https://github.com/SkelterLabsInc/JaQuAD.

PDF Abstract

Datasets


Introduced in the Paper:

JaQuAD

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Question Answering JaQuAD BERT-Japanese F1 78.92 # 1
Exact Match 63.38 # 1

Methods


No methods listed for this paper. Add relevant methods here