MURAL - Maynooth University Research Archive Library



    A capability requirements approach for predicting worker performance in crowdsourcing


    ul Hassan, Umair and Curry, Edward (2013) A capability requirements approach for predicting worker performance in crowdsourcing. In: 9th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, 20-23 October 2013, Austin, TX, USA.

    [thumbnail of UuH_a capability.pdf]
    Preview
    Text
    UuH_a capability.pdf

    Download (318kB) | Preview

    Abstract

    Assigning heterogeneous tasks to workers is an important challenge of crowdsourcing platforms. Current approaches to task assignment have primarily focused on content-based approaches, qualifications, or work history. We propose an alternative and complementary approach that focuses on what capabilities workers employ to perform tasks. First, we model various tasks according to the human capabilities required to perform them. Second, we capture the capability traces of the crowd workers performance on existing tasks. Third, we predict performance of workers on new tasks to make task routing decisions, with the help of capability traces. We evaluate the effectiveness of our approach on three different tasks including fact verification, image comparison, and information extraction. The results demonstrate that we can predict worker’s performance based on worker capabilities. We also highlight limitations and extensions of the proposed approach.
    Item Type: Conference or Workshop Item (Paper)
    Keywords: microtask; taxonomy; crowdsourcing; performance;
    Academic Unit: Faculty of Social Sciences > School of Business
    Item ID: 16016
    Depositing User: Souleiman Hasan
    Date Deposited: 30 May 2022 13:50
    Refereed: Yes
    URI: https://mural.maynoothuniversity.ie/id/eprint/16016
    Use Licence: This item is available under a Creative Commons Attribution Non Commercial Share Alike Licence (CC BY-NC-SA). Details of this licence are available here

    Repository Staff Only (login required)

    Item control page
    Item control page

    Downloads

    Downloads per month over past year

    Origin of downloads