Skip to main content

A Universal Significant Reference Model Set for Process Mining Evaluation Framework

  • Conference paper

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 181))

Abstract

Process mining has caught the attention of researchers and practioners. Because a wide variety of process mining techniques have been proposed, it is difficult to choose a suitable process mining algorithm for a given enterprise or application domain. Model rediscoverability of process mining algorithms has been proposed as a benchmark to address this issue. Given a process model (we call it original model) and its corresponding event log, the model rediscoverability is to measure how similar between the original model and the process model mined by the process mining algorithm. As evaluating available process mining algorithms against a large set of business process models is computationally expensive, some recent works have been done to accelerate the evaluation by only evaluating a portion of process models (the so-called reference models) and recommending the others via a regression model. The effect of the recommendation is highly dependent on the quality of the reference models. Nevertheless, choosing the significant reference models from a given model set is also time-consuming and ineffective. This paper generalizes a universal significant reference model set. Furthermore, this paper also proposes a selection of process model features to increase the accuracy of recommending process mining algorithm. Experiments using artificial and real-life datasets show that our proposed reference model set and selected features are practical and outperform the traditional ones.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   34.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wang, J., Wong, R.K., Ding, J., Guo, Q., Wen, L.: Efficient Selection of Process Mining Algorithms. IEEE Transactions on Services Computing 6(4), 484–496 (2013), doi:10.1109/TSC.2012.20

    Article  Google Scholar 

  2. Wang, J., Jin, T., Wong, R.K., Wen, L.: Querying business process model repositories - A survey of current approaches and issues. World Wide Web 17(3), 427–454 (2014)

    Article  Google Scholar 

  3. Wang, J., Tan, S., Wen, L., Wong, R.K., Guo, Q.: An empirical evaluation of process mining algorithms based on structural and behavioral similarities. In: Proceedings of the 27th Annual ACM Symposium on Applied Computing, pp. 211–213. ACM (2012)

    Google Scholar 

  4. Wang, J., Wong, R.K., Ding, J., Guo, Q., Wen, L.: On recommendation of process mining algorithms. In: IEEE 19th International Conference on Web Services (ICWS), pp. 311–318. IEEE (2012)

    Google Scholar 

  5. Mendling, J.: Metrics for process models. LNBIP, vol. 6. Springer, Heidelberg (2008)

    Google Scholar 

  6. de Medeiros, A.A., Gnther, C.W., Weijters, A.J.M.M., van der Aalst, W.M.: Towards an evaluation framework for process mining algorithms. Beta, Research School for Operations Management and Logistics (2007)

    Google Scholar 

  7. Van der Aalst, W., Weijters, T., Maruster, L.: Workflow mining: Discovering process models from event logs. IEEE Transactions on Knowledge and Data Engineering 16(9), 1128–1142 (2004)

    Article  Google Scholar 

  8. Van der Aalst, W.M., Weijters, A.J.M.M.: Process mining: A research agenda. Computers in Industry 53(3), 231–244 (2004)

    Article  Google Scholar 

  9. Jin, T., Wang, J., Wu, N., La Rosa, M., ter Hofstede, A.H.M.: Efficient and accurate retrieval of business process models through indexing. In: Meersman, R., Dillon, T.S., Herrero, P. (eds.) OTM 2010. LNCS, vol. 6426, pp. 402–409. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  10. Wang, J., He, T., Wen, L., Wu, N., ter Hofstede, A.H.M., Su, J.: A behavioral similarity measure between labeled Petri nets based on principal transition sequences. In: Meersman, R., Dillon, T.S., Herrero, P. (eds.) OTM 2010. LNCS, vol. 6426, pp. 394–401. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  11. Wen, L., van der Aalst, W.M., Wang, J., Sun, J.: Mining process models with non-free-choice constructs. Data Mining and Knowledge Discovery 15(2), 145–180 (2007)

    Article  MathSciNet  Google Scholar 

  12. Wen, L., Wang, J., van der Aalst, W.M., Huang, B., Sun, J.: Mining process models with prime invisible tasks. Data & Knowledge Engineering 69(10), 999–1021 (2010)

    Article  Google Scholar 

  13. de Medeiros, A.K.A., Weijters, A.J., van der Aalst, W.M.: Genetic process mining: An experimental evaluation. Data Mining and Knowledge Discovery 14(2), 245–304 (2007)

    Article  MathSciNet  Google Scholar 

  14. Weijters, A.J.M.M., van der Aalst, W.M., De Medeiros, A.A.: Process mining with the heuristics miner-algorithm. Technische Universiteit Eindhoven, Tech. Rep. WP, 166 (2006)

    Google Scholar 

  15. Van der Aalst, W.M., Rubin, V., van Dongen, B.F., Kindler, E., Gnther, C.W.: Process mining: A two-step approach using transition systems and regions. BPM Center Report BPM-06-30, BPMcenter. org. (2006)

    Google Scholar 

  16. Dijkman, R., Dumas, M., García-Bañuelos, L.: Graph matching algorithms for business process model similarity search. In: Dayal, U., Eder, J., Koehler, J., Reijers, H.A. (eds.) BPM 2009. LNCS, vol. 5701, pp. 48–63. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  17. Zha, H., Wang, J., Wen, L., Wang, C., Sun, J.: A workflow net similarity measure based on transition adjacency relations. Computers in Industry 61(5), 463–471 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Guo, Q., Wen, L., Wang, J., Ding, Z., Lv, C. (2014). A Universal Significant Reference Model Set for Process Mining Evaluation Framework. In: Ouyang, C., Jung, JY. (eds) Asia Pacific Business Process Management. AP-BPM 2014. Lecture Notes in Business Information Processing, vol 181. Springer, Cham. https://doi.org/10.1007/978-3-319-08222-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08222-6_2

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08221-9

  • Online ISBN: 978-3-319-08222-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics