Skip to main content

Counterfactual Reasoning for Process Optimization Using Structural Causal Models

  • Conference paper
  • First Online:
Business Process Management Forum (BPM 2019)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 360))

Included in the following conference series:

Abstract

Business processes are complex and involve the execution of various steps using different resources that can be shared across various tasks. Processes require analysis and process owners need to constantly look for methods to improve process performance indicators. It is non-trivial to quantify the improvement of a proposed change, without implementing or conducting randomized controlled trials. In several cases, the cost and time for implementing and evaluating the benefits of these changes are high. To address this, we propose a principled framework using Structural Causal Models which formally codify existing cause-effect assumptions about the process, control confounding and answer “what if” questions with observational data. We formally define an end to end methodology which takes process execution logs and specified BPMN model as inputs for structural causal model discovery and for performing counterfactual reasoning. We show that exploiting the process specification for causal discovery automatically ensures the inclusion of subject matter expertise, and also provides an effective computational methodology. We illustrate the effectiveness of our approach by answering intervention and counterfactual questions on example process models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    GitHub - https://github.com/bpmn-miwg/bpmn-miwg-test-suite.

  2. 2.

    Although there are several open datasets for business processes, to verify the correctness of a causal model, intervention data is required. To the best of our knowledge, there is no existing dataset which documents the effect of multiple interventions in the business process domain. Hence, we use simulated data to showcase the feasibility of our approach.

  3. 3.

    We tried three variants of linear regression - without regularization, and with L1 and L2 regularization. Empirically, the statistical model without regularization gave the best performance.

References

  1. Athey, S., Imbens, G.W.: Machine learning methods for estimating heterogeneous causal effects. Stat 1050(5) (2015)

    Google Scholar 

  2. Baker, J., Song, J., Jones, D.R.: Closing the loop: an empirical investigation of causality in it business value (2017)

    Google Scholar 

  3. Borboudakis, G., Tsamardinos, I.: Towards robust and versatile causal discovery for business applications. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1435–1444. ACM (2016)

    Google Scholar 

  4. Bottou, L., et al.: Counterfactual reasoning and learning systems: the example of computational advertising. J. Mach. Learn. Res. 14(1), 3207–3260 (2013)

    MathSciNet  MATH  Google Scholar 

  5. Bühlmann, P., Peters, J., Ernest, J., et al.: Cam: causal additive models, high-dimensional order search and penalized regression. Ann. Stat. 42(6), 2526–2556 (2014)

    Article  MathSciNet  Google Scholar 

  6. Colombo, D., Maathuis, M.H.: Order-independent constraint-based causal structure learning. J. Mach. Learn. Res. 15(1), 3741–3782 (2014)

    MathSciNet  MATH  Google Scholar 

  7. Finch, S.R.: Mathematical Constants, vol. 93. Cambridge University Press, Cambridge (2003)

    MATH  Google Scholar 

  8. Freitas, A.P., Pereira, J.L.M.: Process simulation support in BPM tools: the case of BPMN (2015)

    Google Scholar 

  9. Greco, G., Guzzo, A., Lupia, F., Pontieri, L.: Process discovery under precedence constraints. ACM Trans. Knowl. Discov. Data (TKDD) 9(4), 32 (2015)

    Google Scholar 

  10. Hernán, M.A., Lanoy, E., Costagliola, D., Robins, J.M.: Comparison of dynamic treatment regimes via inverse probability weighting. Basic Clin. Pharmacol. Toxicol. 98(3), 237–242 (2006)

    Article  Google Scholar 

  11. Hompes, B.F.A., Maaradji, A., La Rosa, M., Dumas, M., Buijs, J.C.A.M., van der Aalst, W.M.P.: Discovering causal factors explaining business process performance variation. In: Dubois, E., Pohl, K. (eds.) CAiSE 2017. LNCS, vol. 10253, pp. 177–192. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59536-8_12

    Chapter  Google Scholar 

  12. Van der Laan, M.J., Rose, S.: Targeted Learning: Causal Inference for Observational and Experimental Data. Springer, New York (2011). https://doi.org/10.1007/978-1-4419-9782-1

    Book  Google Scholar 

  13. Limam Mansar, S., Reijers, H.A.: Best practices in business process redesign: use and impact. Bus. Process Manag. J. 13(2), 193–213 (2007)

    Article  Google Scholar 

  14. Lohrmann, M., Reichert, M.: Effective application of process improvement patterns to business processes. Softw. Syst. Model. 15(2), 353–375 (2016)

    Article  Google Scholar 

  15. Margaritis, D.: Learning Bayesian network model structure from data. Technical report. Carnegie-Mellon Univ Pittsburgh Pa School of Computer Science (2003)

    Google Scholar 

  16. zur Muehlen, M., Ho, D.T.: Service process innovation: a case study of BPMN in practice. In: Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008), pp. 372–372. IEEE (2008)

    Google Scholar 

  17. Pearl, J.: Causality. Cambridge University Press, Cambridge (2009)

    Book  Google Scholar 

  18. Pearl, J.: The eight pillars of causal wisdom. Lecture Notes for the UCLA WCE (2017)

    Google Scholar 

  19. Pearl, J.: Theoretical impediments to machine learning with seven sparks from the causal revolution. arXiv preprint arXiv:1801.04016 (2018)

  20. Peters, J., Janzing, D., Schölkopf, B.: Elements of Causal Inference: Foundations and Learning Algorithms. MIT Press, Cambridge (2017)

    MATH  Google Scholar 

  21. Petersen, M.L., van der Laan, M.J.: Causal models and learning from data: integrating causal modeling and statistical estimation. Epidemiology (Cambridge, Mass.) 25(3), 418 (2014)

    Article  Google Scholar 

  22. Robins, J.M., Rotnitzky, A., Zhao, L.P.: Estimation of regression coefficients when some regressors are not always observed. J. Am. Stat. Assoc. 89(427), 846–866 (1994)

    Article  MathSciNet  Google Scholar 

  23. Rosenbaum, P.R., Rubin, D.B.: The central role of the propensity score in observational studies for causal effects. Biometrika 70(1), 41–55 (1983)

    Article  MathSciNet  Google Scholar 

  24. Satyal, S., Weber, I., Paik, H., Di Ciccio, C., Mendling, J.: AB-BPM: performance-driven instance routing for business process improvement. In: Carmona, J., Engels, G., Kumar, A. (eds.) BPM 2017. LNCS, vol. 10445, pp. 113–129. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65000-5_7

    Chapter  Google Scholar 

  25. Scharfstein, D.O., Rotnitzky, A., Robins, J.M.: Adjusting for nonignorable drop-out using semiparametric nonresponse models. J. Am. Stat. Assoc. 94(448), 1096–1120 (1999)

    Article  MathSciNet  Google Scholar 

  26. Shook, C.L., Ketchen Jr., D.J., Hult, G.T.M., Kacmar, K.M.: An assessment of the use of structural equation modeling in strategic management research. Strateg. Manag. J. 25(4), 397–404 (2004)

    Article  Google Scholar 

  27. Teyssier, M., Koller, D.: Ordering-based search: a simple and effective algorithm for learning Bayesian networks. arXiv preprint arXiv:1207.1429 (2012)

  28. Tsamardinos, I., Aliferis, C.F., Statnikov, A.: Time and sample efficient discovery of Markov blankets and direct causal relations. In: Proceedings of the ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 673–678. ACM (2003)

    Google Scholar 

  29. Tsamardinos, I., Aliferis, C.F., Statnikov, A.R., Statnikov, E.: Algorithms for large scale Markov blanket discovery. In: FLAIRS Conference, vol. 2, pp. 376–380 (2003)

    Google Scholar 

  30. Van Der Aalst, W.: Process Mining: Discovery, Conformance and Enhancement of Business Processes, vol. 2. Springer, Heidelberg (2011)

    Book  Google Scholar 

  31. van der Aalst, W.M.P., ter Hofstede, A.H.M., Weske, M.: Business process management: a survey. In: van der Aalst, W.M.P., Weske, M. (eds.) BPM 2003. LNCS, vol. 2678, pp. 1–12. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-44895-0_1

    Chapter  MATH  Google Scholar 

  32. Wang, Y., Liang, D., Charlin, L., Blei, D.M.: The deconfounded recommender: a causal inference approach to recommendation. arXiv preprint arXiv:1808.06581 (2018)

  33. Wu, Y., Zhang, L., Wu, X.: On discrimination discovery and removal in ranked data using causal graph. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2536–2544. ACM (2018)

    Google Scholar 

  34. Yusof, Z., Yusoff, W.F.W., Maarof, F.: Causality analysis in business performance measurement system using system dynamics methodology. In: AIP Conference Proceedings, vol. 1605, pp. 1201–1206. AIP (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Prerna Agarwal .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Narendra, T., Agarwal, P., Gupta, M., Dechu, S. (2019). Counterfactual Reasoning for Process Optimization Using Structural Causal Models. In: Hildebrandt, T., van Dongen, B., Röglinger, M., Mendling, J. (eds) Business Process Management Forum. BPM 2019. Lecture Notes in Business Information Processing, vol 360. Springer, Cham. https://doi.org/10.1007/978-3-030-26643-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26643-1_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26642-4

  • Online ISBN: 978-3-030-26643-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics