Abstract
This paper proposes a new budget allocation method for crowdsourced sequential tasks. Sequential tasks mean that an output of a task becomes an input to another task, and the quality of the final artifact depends on the qualities of the preceding tasks. In crowdsourcing, the abilities of workers are often difficult to learn in advance. Thus, the fixed budget allocation to the component tasks cannot respond to the realized situation. Also, the requester is often difficult to evaluate the quality of intermediate artifacts accurately, which results in misallocating the budget and wasting a budget. To overcome these difficulties, we have developed a contingent budget allocation method, i.e., generating a conditional plan given uncertainty about the intermediate states and action effects, by formalized a problem as POMDP and introducing a quality evaluation action. The experimental results show that the proposed method can find a solution in a reasonable time and improve the quality of the final artifact.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ambati, V., Vogel, S., Carbonell, J.: Collaborative workflow for crowdsourcing translation. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, CSCW 2012, pp. 1191–1194 (2012)
Bernstein, M.S., et al.: Soylent: a word processor with a crowd inside. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 313–322 (2010)
Dai, P., Lin, C.H., Weld, D.S.: Pomdp-based control of workflows for crowdsourcing. Artif. Intell. 202, 52–85 (2013)
Tran-Thanh, L., Huynh, T.D., Rosenfeld, A., Ramchurn, S.D., Jennings, N.R.: Budgetfix: budget limited crowdsourcing for interdependent task allocation with quality guarantees. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS 2014, pp. 477–484 (2014)
Tran-Thanh, L., Huynh, T.D., Rosenfeld, A., Ramchurn, S.D., Jennings, N.R.: Crowdsourcing complex workflows under budget constraints. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, AAAI 2015, pp. 1298–1304 (2015)
Acknowledgments
This research was partially supported by a Grant-in-Aid for Scientific Research (A) (17H00759, 2017-2020) from Japan Society for the Promotion of Science (JSPS).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Itoh, Y., Matsubara, S. (2018). Adaptive Budget Allocation for Sequential Tasks in Crowdsourcing. In: Miller, T., Oren, N., Sakurai, Y., Noda, I., Savarimuthu, B.T.R., Cao Son, T. (eds) PRIMA 2018: Principles and Practice of Multi-Agent Systems. PRIMA 2018. Lecture Notes in Computer Science(), vol 11224. Springer, Cham. https://doi.org/10.1007/978-3-030-03098-8_35
Download citation
DOI: https://doi.org/10.1007/978-3-030-03098-8_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03097-1
Online ISBN: 978-3-030-03098-8
eBook Packages: Computer ScienceComputer Science (R0)