Skip to main content
SpringerLink
Log in

Activity Matching with Human Intelligence

  • Conference paper
  • First Online:
Business Process Management Forum (BPM 2016)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 260))

Included in the following conference series:

Abstract

Effective matching of activities is the first step toward successful process model matching and search. The problem is nontrivial and has led to a variety of computational similarity metrics and matching approaches, however all still with low performance in terms of precision and recall. In this paper, instead, we study how to leverage on human intelligence to identify matches among activities and show that the problem is not as straightforward as most computational approaches assume. We access human intelligence (i) by crowdsourcing the activity matching problem to generic workers and (ii) by eliciting ground truth matches from experts. The precision and recall we achieve and the qualitative analysis of the results testify huge potential for a human-based activity matching that contemplates disagreement and interpretation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Allahbakhsh, M., Benatallah, B., Ignjatovic, A., Motahari-Nezhad, H., Bertino, E., Dustdar, S.: Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput. 17(2), 76–81 (2013)

    Article  Google Scholar 

  2. Antunes, G., et al.: The process model matching contest 2015. In: EMISA (2015)

    Google Scholar 

  3. Castelo Branco, M., Troya, J., Czarnecki, K., Küster, J., Völzer, H.: Matching business process workflows across abstraction levels. In: France, R.B., Kazmeier, J., Breu, R., Atkinson, C. (eds.) MODELS 2012. LNCS, vol. 7590, pp. 626–641. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  4. Cavallo, R., Jain, S.: Efficient crowdsourcing contests. Proc. AAMAS 2, 677–686 (2012)

    Google Scholar 

  5. Cayoglu, U. et al.: The process model matching contest 2013. In: PMC-MR (2013)

    Google Scholar 

  6. Dijkman, R., Dumas, M., García-Bañuelos, L.: Graph matching algorithms for business process model similarity search. In: Dayal, U., Eder, J., Koehler, J., Reijers, H.A. (eds.) BPM 2009. LNCS, vol. 5701, pp. 48–63. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  7. Dijkman, R., Dumas, M., Garcia-Banuelos, L., Kaarik, R.: Aligning business process models. In: EDOC 2009, pp. 45–53 (2009)

    Google Scholar 

  8. Dijkman, R., Dumas, M., van Dongen, B., Käärik, R., Mendling, J.: Similarity of business process models: metrics and evaluation. Inf. Syst. 36(2), 498–516 (2011)

    Article  Google Scholar 

  9. Dumas, M., García-Bañuelos, L., Dijkman, R.M.: Similarity search of business process models. IEEE Data Eng. Bull. 32(3), 23–28 (2009)

    Google Scholar 

  10. Ekanayake, C.C., Dumas, M., García-Bañuelos, L., La Rosa, M., ter Hofstede, A.H.M.: Approximate clone detection in repositories of business process models. In: Barros, A., Gal, A., Kindler, E. (eds.) BPM 2012. LNCS, vol. 7481, pp. 302–318. Springer, Heidelberg (2012)

    Google Scholar 

  11. Euzenat, J., Shvaiko, P.: Ontology Matching. Springer, Secaucus (2007)

    MATH  Google Scholar 

  12. Grigori, D., Corrales, J.C., Bouzeghoub, M.: Behavioral matchmaking for service retrieval. In: IEEE ICWS, pp. 145–152 (2006)

    Google Scholar 

  13. Howe, J.: Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business, 1st edn. Crown Publishing Group, New York (2008)

    Google Scholar 

  14. Ipeirotis, P.G.: Analyzing the amazon mechanical turk marketplace. XRDS 17(2), 16–21 (2010)

    Article  Google Scholar 

  15. Jin, T., Wang, J., Rosa, M.L., ter Hofstede, A.H., Wen, L.: Efficient querying of large process model repositories. Comput. Ind. 64(1), 41–49 (2013)

    Article  Google Scholar 

  16. Klinkmüller, C., Leopold, H., Weber, I., Mendling, J., Ludwig, A.: Listen to me: improving process model matching through user feedback. In: Sadiq, S., Soffer, P., Völzer, H. (eds.) BPM 2014. LNCS, vol. 8659, pp. 84–100. Springer, Heidelberg (2014)

    Google Scholar 

  17. Klinkmüller, C., Weber, I., Mendling, J., Leopold, H., Ludwig, A.: Increasing recall of process model matching by improved activity label matching. In: Daniel, F., Wang, J., Weber, B. (eds.) BPM 2013. LNCS, vol. 8094, pp. 211–218. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  18. Koschmider, A., Blanchard, E.: User assistance for business process model decomposition. In: IEEE RCIS, pp. 445–454 (2007)

    Google Scholar 

  19. Kunze, M., Weidlich, M., Weske, M.: Behavioral similarity – a proper metric. In: Rinderle-Ma, S., Toumani, F., Wolf, K. (eds.) BPM 2011. LNCS, vol. 6896, pp. 166–181. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  20. Leopold, H., Niepert, M., Weidlich, M., Mendling, J., Dijkman, R., Stuckenschmidt, H.: Probabilistic optimization of semantic process model matching. In: Barros, A., Gal, A., Kindler, E. (eds.) BPM 2012. LNCS, vol. 7481, pp. 319–334. Springer, Heidelberg (2012)

    Google Scholar 

  21. Sakr, S., Awad, A., Kunze, M.: Querying process models repositories by aggregated graph search. In: Rosa, M., Soffer, P. (eds.) BPM Workshops 2012. LNBIP, vol. 132, pp. 573–585. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  22. Satzger, B., Psaier, H., Schall, D., Dustdar, S.: Auction-based crowdsourcing supporting skill management. Inf. Syst. 38(4), 547–560 (2013)

    Article  Google Scholar 

  23. Weidlich, M., Dijkman, R., Mendling, J.: The ICoP framework: identification of correspondences between process models. In: Pernici, B. (ed.) CAiSE 2010. LNCS, vol. 6051, pp. 483–498. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  24. Weidlich, M., Sagi, T., Leopold, H., Gal, A., Mendling, J.: Predicting the quality of process model matching. In: Daniel, F., Wang, J., Weber, B. (eds.) BPM 2013. LNCS, vol. 8094, pp. 203–210. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  25. Weidlich, M., Sheetrit, E., Branco, M.C., Gal, A.: Matching business process models using positional passage-based language models. In: ER 2013, pp. 130–137 (2013)

    Google Scholar 

  26. Zha, H., Wang, J., Wen, L., Wang, C., Sun, J.: A workflow net similarity measure based on transition adjacency relations. Comput. Ind. 61(5), 463–471 (2010)

    Article  Google Scholar 

Download references

Acknowledgement

We would like to thank M. Vitali, G. Meroni, P. Plebani (Politecnico di Milano) and S. Tranquillini and J. Stevovic (Chino, Trento) for their help with the creation of the ground truth matchings for the experiments.

Author information

Authors and Affiliations

  1. University of Trento, Via Sommarive 9, 38123, Povo, TN, Italy

    Carlos Rodríguez & Fabio Casati

  2. Department of Computing, Macquarie University, Sydney, Australia

    Christopher Klinkmüller

  3. Data61, CSIRO, Sydney, Australia

    Christopher Klinkmüller & Ingo Weber

  4. University of New South Wales, Sydney, Australia

    Ingo Weber

  5. Politecnico di Milano, Via Ponzio 34/5, 20133, Milano, Italy

    Florian Daniel

Authors
  1. Carlos Rodríguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christopher Klinkmüller
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ingo Weber
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Florian Daniel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fabio Casati
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carlos Rodríguez .

Editor information

Editors and Affiliations

  1. Queensland University of Technology , Brisbane, Queensland, Australia

    Marcello La Rosa

  2. DFKI, Universität des Saarlandes, Saarbrücken, Saarland, Germany

    Peter Loos

  3. Universidad Politècnica de Valencia , Valencia, Spain

    Oscar Pastor

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Rodríguez, C., Klinkmüller, C., Weber, I., Daniel, F., Casati, F. (2016). Activity Matching with Human Intelligence. In: La Rosa, M., Loos, P., Pastor, O. (eds) Business Process Management Forum. BPM 2016. Lecture Notes in Business Information Processing, vol 260. Springer, Cham. https://doi.org/10.1007/978-3-319-45468-9_8

Download citation

Publish with us

Policies and ethics

Search

Navigation