Retrospective Reader for Machine Reading Comprehension

27 Jan 2020 Zhuosheng Zhang Junjie Yang Hai Zhao

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no answer is available according to the given passage and then tactfully abstain from answering... (read more)

PDF Abstract

Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Question Answering SQuAD2.0 Retro-Reader on ALBERT (ensemble) EM 90.115 # 9
F1 92.580 # 8
Question Answering SQuAD2.0 Retro-Reader on ALBERT (single model) EM 88.107 # 39
F1 91.419 # 26
Question Answering SQuAD2.0 Retro-Reader on ELECTRA (single model) EM 89.562 # 14
F1 92.052 # 17
Question Answering SQuAD2.0 Retro-Reader (ensemble) EM 90.578 # 3
F1 92.978 # 2

Methods used in the Paper