Crowd Guilds Article Swipe
YOU?
·
· 2017
· Open Access
·
· DOI: https://doi.org/10.1145/2998181.2998234
· OA: W4297685397
Crowd workers are distributed and decentralized. While decentralization is\ndesigned to utilize independent judgment to promote high-quality results, it\nparadoxically undercuts behaviors and institutions that are critical to\nhigh-quality work. Reputation is one central example: crowdsourcing systems\ndepend on reputation scores from decentralized workers and requesters, but\nthese scores are notoriously inflated and uninformative. In this paper, we draw\ninspiration from historical worker guilds (e.g., in the silk trade) to design\nand implement crowd guilds: centralized groups of crowd workers who\ncollectively certify each other's quality through double-blind peer assessment.\nA two-week field experiment compared crowd guilds to a traditional\ndecentralized crowd work model. Crowd guilds produced reputation signals more\nstrongly correlated with ground-truth worker quality than signals available on\ncurrent crowd working platforms, and more accurate than in the traditional\nmodel.\n
