Advertisement

A Method for Assessing Influence Relationships among KPIs of Service Systems

  • Yedendra Babu Shrinivasan
  • Gargi Banerjee Dasgupta
  • Nirmit Desai
  • Jayan Nallacherry
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7636)

Abstract

The operational performance of service systems is commonly measured with key performance indicators (KPIs), e.g., time-to-resolve, SLA compliance, and workload balance. The assumption is that healthy KPIs lead to healthy business outcomes such as customer satisfaction, cost savings, and service quality. Although the domain experts have an intuitive understanding of the causal relationships among the KPIs, the degree of influence a cause KPI has on the effect KPI is difficult to estimate based on intuition. Also, the intuitive understanding could be wrong. Further, we show how the causal relationships are intricate with aspects such as the rate of influence and conditionality in measurements. As a result, although crucial, it is nontrivial to estimate the degree of influence. Without the degree of influence, prediction of business outcomes and decisions based on them tend to be ad hoc. This paper presents a novel method for validating the intuitive direction and the polarity of a causal relationship provided by domain experts. Further, the method also estimates the degree of influence based on the measure of Pearson’s correlation. Using the degree of influence and least squares regression, the method predicts values of effect KPIs. The method is evaluated by applying it on 10 widely used KPIs from 29 real-life service systems. We find that the method validates 8 of the 15 intuitive relationships and estimates the degree of influence for each of the validated relationships. Further, based on the degrees of influence and the regression model learned from the 29 service systems, the method could estimate the values of the effect KPIs with an average root-mean-squared error (RMSE) of 1.2%, in 9 additional service systems.

Keywords

Business Process Service System Domain Expert Service Domain Business Outcome 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Alter, S.: Service system fundamentals: Work system, value chain, and life cycle. IBM Systems Journal 47(1), 71–85 (2008)CrossRefGoogle Scholar
  2. 2.
    Apte, U.M., Goh, C.H.: Applying lean manufacturing principles to information intensive services (2004)Google Scholar
  3. 3.
    Banerjee, D., Dasgupta, G., Desai, N.: Simulation-based evaluation of dispatching policies in service systems. In: Winter Simulation Conference (2011)Google Scholar
  4. 4.
    Cardoso, J., Sheth, A.P., Miller, J.A., Arnold, J., Kochut, K.: Quality of service for workflows and web service processes. Journal of Web Semantics 1(3), 281–308 (2004)CrossRefGoogle Scholar
  5. 5.
    Diao, Y., Heching, A.: Staffing optimization in complex service delivery systems. In: CNSM, pp. 1–9 (2011)Google Scholar
  6. 6.
    Elbashir, M.Z., Collier, P.A., Davern, M.J.: Measuring the effects of business intelligence systems: The relationship between business process and organizational performance. International Journal of Accounting Information Systems 9(3), 135–153 (2008)CrossRefGoogle Scholar
  7. 7.
    Grembergen, W.V., Haes, S.D.: Cobit’s management guidelines revisited: The kgis/kpis cascade. Information Systems Control Journal 6(1), 1–3 (2005)Google Scholar
  8. 8.
    Han, K.H., Kang, J.G., Song, M.: Two-stage process analysis using the process-based performance measurement framework and business process simulation. Expert Systems with Applications 36(3, Part 2), 7080–7086 (2009)CrossRefGoogle Scholar
  9. 9.
    Lepmets, M., Ras, E., Renault, A.: A quality measurement framework for it services by marion lepmets. In: SRII Global Conference (2011)Google Scholar
  10. 10.
    Lin, S.P., Chen, L.F., Chan, Y.H.: What is the valuable service quality gap for improving customer satisfaction? In: ICSSSM, pp. 242–247 (2009)Google Scholar
  11. 11.
    Linard, K., Fleming, C., Dvorsky, L.: System dynamics as the link between corporate vision and key performance indicators. In: System Dynamics Conference, pp. 1–13 (2002)Google Scholar
  12. 12.
    Motta, G., Pignatelli, G., Barroero, T., Longo, A.: Service level analysis method - SLAM. In: Proceedings of ICCSIT, pp. 460–466 (2010)Google Scholar
  13. 13.
    Nor, R., Nor, H., Alias, R.A., Rahman, A.A.: The ICTSQ-PM model in the context of mus: consideration of KPI and CFS. In: UTM Postgraduate Annual Research Seminar, pp. 1–5 (2008)Google Scholar
  14. 14.
    Prashanth, L.A., Prasad, H.L., Desai, N., Bhatnagar, S., Dasgupta, G.: Stochastic Optimization for Adaptive Labor Staffing in Service Systems. In: Kappel, G., Maamar, Z., Motahari-Nezhad, H.R. (eds.) ICSOC 2011. LNCS, vol. 7084, pp. 487–494. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  15. 15.
    Ramaswamy, L., Banavar, G.: A formal model of service delivery. In: SCC, pp. 517–520 (2008)Google Scholar
  16. 16.
    Schneider, B., White, S.S.: Service Quality: Research Perspectives (Foundations for Organizational Science). Sage Publications (2003)Google Scholar
  17. 17.
    Silverstein, C., Brin, S., Motwani, R., Ullman, J.: Scalable techniques for mining causal structures. Data Mining and Knowledge Discovery 4, 163–192 (2000)CrossRefGoogle Scholar
  18. 18.
    Spohrer, J., Maglio, P., Bailey, J., Gruhl, D.: Steps toward a science of service systems. Computer 40(1), 71–77 (2007)CrossRefGoogle Scholar
  19. 19.
    Strasunskas, D., Tomasgard, A.: A method to assess value of integrated operations. In: AMCIS, p. 459 (2010)Google Scholar
  20. 20.
    Wetzstein, B., Leitner, P., Rosenberg, F., Brandic, I., Dustdar, S., Leymann, F.: Monitoring and analyzing influential factors of business process performance. In: Proceedings of EDOC. IEEE Computer Society (2009)Google Scholar
  21. 21.
    Wetzstein, B., Zengin, A., Kazhamiakin, R., Marconi, A., Pistore, M., Karastoyanova, D., Leymann, F.: Preventing kpi violations in business processes based on decision tree learning and proactive runtime adaptation. Journal of Systems Integration 3(1), 3–18 (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Yedendra Babu Shrinivasan
    • 1
  • Gargi Banerjee Dasgupta
    • 1
  • Nirmit Desai
    • 1
  • Jayan Nallacherry
    • 1
  1. 1.IBM ResearchBangaloreIndia

Personalised recommendations