Open-Source Large Language Models Outperform Crowd Workers and Approach ChatGPT in Text-Annotation Tasks

no code implementations • 5 Jul 2023 • Meysam Alizadeh, Maël Kubli, Zeynab Samei, Shirin Dehghani, Juan Diego Bermeo, Maria Korobeynikova, Fabrizio Gilardi

This study examines the performance of open-source Large Language Models (LLMs) in text annotation tasks and compares it with proprietary models like ChatGPT and human-based services such as MTurk.

text annotation

ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks

1 code implementation • 27 Mar 2023 • Fabrizio Gilardi, Meysam Alizadeh, Maël Kubli

Many NLP applications require manual data annotations for a variety of tasks, notably to train classifiers or evaluate the performance of unsupervised models.

text annotation Text Classification

Psychological and Personality Profiles of Political Extremists

no code implementations • 1 Apr 2017 • Meysam Alizadeh, Ingmar Weber, Claudio Cioffi-Revilla, Santo Fortunato, Michael Macy

Global recruitment into radical Islamic movements has spurred renewed interest in the appeal of political extremism.