Effective Crowd-Annotation of Participants, Interventions, and Outcomes in the Text of Clinical Trial Reports

2 code implementations • Findings of the Association for Computational Linguistics 2020 • Markus Zlabinger, Marta Sabou, Sebastian Hofst{\"a}tter, Allan Hanbury

Obtaining such a corpus from crowdworkers, however, has been shown to be ineffective since (i) workers usually lack domain-specific expertise to conduct the task with sufficient quality, and (ii) the standard approach of annotating entire abstracts of trial reports as one task-instance (i. e. HIT) leads to an uneven distribution in task effort.

Sentence text similarity