Links

Tools

Export citation

Search in Google Scholar

Variational Inference for Crowdsourcing

Journal article published in 2012 by Qiang Liu, Jian Peng ORCID, Alexander Ihler
This paper was not found in any repository; the policy of its publisher is unknown or unclear.
This paper was not found in any repository; the policy of its publisher is unknown or unclear.

Full text: Unavailable

Question mark in circle
Preprint: policy unknown
Question mark in circle
Postprint: policy unknown
Question mark in circle
Published version: policy unknown

Abstract

Crowdsourcing has become a popular paradigm for labeling large datasets. How-ever, it has given rise to the computational task of aggregating the crowdsourced labels provided by a collection of unreliable annotators. We approach this prob-lem by transforming it into a standard inference problem in graphical models, and applying approximate variational methods, including belief propagation (BP) and mean field (MF). We show that our BP algorithm generalizes both major-ity voting and a recent algorithm by Karger et al. [1], while our MF method is closely related to a commonly used EM algorithm. In both cases, we find that the performance of the algorithms critically depends on the choice of a prior distribu-tion on the workers' reliability; by choosing the prior properly, both BP and MF (and EM) perform surprisingly well on both simulated and real-world datasets, competitive with state-of-the-art algorithms based on more complicated modeling assumptions.