ul Hassan, Umair and Curry, Edward (2013) A capability requirements approach for predicting worker performance in crowdsourcing. In: 9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, 20-23 October 2013, Austin, TX, USA.
Preview
UuH_a capability.pdf
Download (318kB) | Preview
Abstract
Assigning heterogeneous tasks to workers is an
important challenge of crowdsourcing platforms. Current approaches to task assignment have primarily focused on content-based approaches, qualifications, or work history. We propose an
alternative and complementary approach that focuses on what
capabilities workers employ to perform tasks. First, we model
various tasks according to the human capabilities required to
perform them. Second, we capture the capability traces of the
crowd workers performance on existing tasks. Third, we predict
performance of workers on new tasks to make task routing
decisions, with the help of capability traces. We evaluate the effectiveness of our approach on three different tasks including fact
verification, image comparison, and information extraction. The
results demonstrate that we can predict worker’s performance
based on worker capabilities. We also highlight limitations and
extensions of the proposed approach.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Keywords: | microtask; taxonomy; crowdsourcing; performance; |
Academic Unit: | Faculty of Social Sciences > School of Business |
Item ID: | 16016 |
Depositing User: | Souleiman Hasan |
Date Deposited: | 30 May 2022 13:50 |
Refereed: | Yes |
URI: | https://mural.maynoothuniversity.ie/id/eprint/16016 |
Use Licence: | This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here |
Repository Staff Only (login required)
Downloads
Downloads per month over past year