ExpMRC
Introduced by Cui et al. in ExpMRC: Explainability Evaluation for Machine Reading Comprehension
ExpMRC is a benchmark for the Explainability evaluation of Machine Reading Comprehension. ExpMRC contains four subsets of popular MRC datasets with additionally annotated evidences, including SQuAD, CMRC 2018, RACE+ (similar to RACE), and C3, covering span-extraction and multiple-choice questions MRC tasks in both English and Chinese.
Benchmarks
| Trend | Task | Dataset Variant | Best Model | Paper | Code |
|---|---|---|---|---|---|
|
ExpMRC - SQuAD (test)
|
BERT-large + PA Sent.
|
|||
|
ExpMRC - CMRC (test)
|
Human Performance
|
|||
|
ExpMRC - RACE+ (test)
|
Human Performance
|
|||
|
ExpMRC - C3 (test)
|
Human Performance
|
Papers
| Paper | Code | Results | Date | Stars |
|---|
Dataset Loaders
No data loaders found. You can
submit your data loader here.
No data loaders found. You can
submit your data loader here.
