Distractor Generation for Multiple-Choice Questions: A Survey of Methods, Datasets, and Evaluation
Distractors are important in learning evaluation. This paper surveys distractor generation tasks using English multiple-choice question datasets for textual and multimodal contexts. In particular, this paper presents a thorough literature review of the recent studies on distractor generation tasks, discusses multiple choice components and their characteristics, analyzes the related datasets, and summarizes the evaluation metrics of distractor generation. Our investigation reveals that more than half of datasets are human-generated from educational sources in specific domains such as Science and English, which are largely text-based, with a lack of open domain and multimodal datasets.
PDF Abstract
ConceptNet
RACE
OpenBookQA
CommonsenseQA
MCTest
QASC
Visual7W
CBT
CosmosQA
SciQ
MovieQA
ReClor
DREAM
MedMCQA
TQA
Worldtree
RecipeQA
CLOTH
SCDE
Results from the Paper
Submit
results from this paper
to get state-of-the-art GitHub badges and help the
community compare results to other papers.
Methods
No methods listed for this paper. Add
relevant methods here
