Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble

This paper describes the TOKOFOU system, an ensemble model for misinformation detection tasks based on six different transformer-based pre-trained encoders, implemented in the context of the COVID-19 Infodemic Shared Task for English. We fine tune each model on each of the task's questions and aggregate their prediction scores using a majority voting approach. TOKOFOU obtains an overall F1 score of 89.7%, ranking first.

PDF Abstract NAACL (NLP4IF) 2021 PDF NAACL (NLP4IF) 2021 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Misinformation NLP4IF-2021--Fighting the COVID-19 Infodemic TOKOFOU Average F1 89.7 # 1

Methods