``Going on a vacation'' takes longer than ``Going for a walk'': A Study of Temporal Commonsense Understanding

IJCNLP 2019  ·  Ben Zhou, Daniel Khashabi, Qiang Ning, Dan Roth ·

Understanding time is crucial for understanding events expressed in natural language. Because people rarely say the obvious, it is often necessary to have commonsense knowledge about various temporal aspects of events, such as duration, frequency, and temporal order. However, this important problem has so far received limited attention. This paper systematically studies this temporal commonsense problem. Specifically, we define five classes of temporal commonsense, and use crowdsourcing to develop a new dataset, MCTACO, that serves as a test set for this task. We find that the best current methods used on MCTACO are still far behind human performance, by about 20{\%}, and discuss several directions for improvement. We hope that the new dataset and our study here can foster more future research on this topic.

PDF Abstract
No code implementations yet. Submit your code now

Tasks


Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods