BudgetFix : Budget Limited Crowdsourcing for Interdependent Task Allocation with Quality Guarantees

  • Tran-Thanh L
  • Huynh T
  • Rosenfeld A
 et al. 
  • 37


    Mendeley users who have this article in their library.
  • 18


    Citations of this article.


Crowdsourcing is a multi-agent task allocation paradigm that involves up to millions of workers, of varying reliability and availability, performing large numbers of micro-tasks. A key challenge is to crowdsource, at minimal cost and with predictable accuracy, complex tasks that involve different types of interdependent microtasks structured into complex workflows. In this paper, we propose the first crowdsourcing algorithm that solves this problem. Our algorithm, called BudgetFix, determines the number of interdependent microtasks and the price to pay for each task given budget constraints. Moreover, BudgetFix provides quality guarantees on the accuracy of the output of each phase of a given workflow. BudgetFix is empirically evaluated on a well known crowdsourcingbased text correction workflow using Amazon Mechanical Turk, and is shown that BudgetFix can provide similar accuracy, compared to the state-of-the-art algorithm for this workflow, but is on average 32% cheaper.

Author-supplied keywords

  • budgeted task allocation
  • crowdsourcing
  • find-fix-verify
  • performance

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document

  • SGR: 84910155070
  • PUI: 600536448
  • SCOPUS: 2-s2.0-84910155070
  • ISBN: 9781634391313


  • Long Tran-Thanh

  • Trung Dong Huynh

  • Avi Rosenfeld

  • Sarvapali Ramchurn

  • Nicholas Jennings

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free