Treating Crowdsourcing as Examination: How to Score Tasks and Online Workers?

no code implementations • 26 Apr 2022 • Guangyang Han, Sufang Li, Runmin Wang, Chunming Wu

Thus, we first score workers' ability mainly on the medium difficult tasks, then reducing the weight of answers from sloppy workers and modifying the answers from spammers when inferring the tasks' ground truth.

Crowdsourcing with Meta-Workers: A New Way to Save the Budget

no code implementations • 7 Nov 2021 • Guangyang Han, Guoxian Yu, Lizhen Cui, Carlotta Domeniconi, Xiangliang Zhang

Due to the unreliability of Internet workers, it's difficult to complete a crowdsourcing project satisfactorily, especially when the tasks are multiple and the budget is limited.

Few-Shot Learning Image Classification

Open-Set Crowdsourcing using Multiple-Source Transfer Learning

no code implementations • 7 Nov 2021 • Guangyang Han, Guoxian Yu, Lei Liu, Lizhen Cui, Carlotta Domeniconi, Xiangliang Zhang

First, OSCrowd integrates crowd theme related datasets into a large source domain to facilitate partial transfer learning to approximate the label space inference of these tasks.

Transfer Learning