Teaching Machines to Read and Comprehend

Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale training and test datasets have been missing for this type of evaluation. In this work we define a new methodology that resolves this bottleneck and provides large scale supervised reading comprehension data. This allows us to develop a class of attention based deep neural networks that learn to read real documents and answer complex questions with minimal prior knowledge of language structure.

PDF Abstract NeurIPS 2015 PDF NeurIPS 2015 Abstract

Datasets


Introduced in the Paper:

DMQA

Used in the Paper:

CNN/Daily Mail
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Question Answering CNN / Daily Mail MemNNs (ensemble) CNN 69.4 # 13
Question Answering CNN / Daily Mail Attentive Reader CNN 63 # 16
Daily Mail 69 # 8
Question Answering CNN / Daily Mail Impatient Reader CNN 63.8 # 15
Daily Mail 68.0 # 10

Methods