Back to Search Start Over

Qrowdsmith: Enhancing Paid Microtask Crowdsourcing with Gamification and Furtherance Incentives.

Authors :
MADDALENA, EDDY
IBÁÑEZ, LUIS-DANIEL
REEVES, NEAL
SIMPERL, ELENA
Source :
ACM Transactions on Intelligent Systems & Technology. Oct2023, Vol. 14 Issue 5, p1-26. 26p.
Publication Year :
2023

Abstract

Microtask crowdsourcing platforms are social intelligence systems in which volunteers, called crowdworkers, complete small, repetitive tasks in return for a small fee. Beyond payments, task requesters are considering non-monetary incentives such as points, badges, and other gamified elements to increase performance and improve crowdworker experience. In this article, we present Qrowdsmith, a platform for gamifying microtask crowdsourcing. To design the system, we explore empirically a range of gamified and financial incentives and analyse their impact on how efficient, effective, and reliable the results are. To maintain participation over time and save costs, we propose furtherance incentives, which are offered to crowdworkers to encourage additional contributions in addition to the fee agreed upfront. In a series of controlled experiments, we find that while gamification can work as furtherance incentives, it impacts negatively on crowdworkers' performance, both in terms of the quantity and quality of work, as compared to a baseline where they can continue to contribute voluntarily. Gamified incentives are also less effective than paid bonus equivalents. Our results contribute to the understanding of how best to encourage engagement in microtask crowdsourcing activities and design better crowd intelligence systems. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
21576904
Volume :
14
Issue :
5
Database :
Academic Search Index
Journal :
ACM Transactions on Intelligent Systems & Technology
Publication Type :
Academic Journal
Accession number :
172992557
Full Text :
https://doi.org/10.1145/3604940