Evaluating Cloud Services Using a Multiple Criteria Decision Analysis Approach

  • Pedro Costa
  • João Carlos Lourenço
  • Miguel Mira da Silva
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8274)


The potential of Cloud services for cost reduction and other benefits has been capturing the attention of organizations. However, a difficult decision arises when an IT manager has to select a Cloud services provider because there are no established guidelines to help make that decision. In order to address this problem, we propose a multi-criteria model to evaluate Cloud services using the MACBETH method. The proposed method was demonstrated in a City Council in Portugal to evaluate and compare two Cloud services: Google Apps and Microsoft Office 365.


Cloud Services IT Services Multiple Criteria Decision Analysis MACBETH Service Quality 


  1. 1.
    Willcocks, L., Lacity, M.: The New IT Outsourcing Landscape – From Innovation to Cloud Services. Palgrave Macmillan, Basingstoke (2012)Google Scholar
  2. 2.
    McAfee, A.: What Every CEO Needs to Know About the Cloud. Harv. Bus. Rev. 89, 124–132 (2011)Google Scholar
  3. 3.
    IDC Portugal: Situação Actual e Tendências de Adopção de Serviços Cloud Computing em Portugal (in Portuguese), IDC Survey (2012) Google Scholar
  4. 4.
    Conway, G., Curry, E.: Managing Cloud Computing: A Life Cycle Approach. In: 2nd International Conference on Cloud Computing and Services Science (CLOSER), Porto, Portugal (2012)Google Scholar
  5. 5.
    Belton, V., Stewart, T.J.: Multiple Criteria Decision Analysis: An Integrated Approach. Kluwer Academic Publishers, Boston (2002)CrossRefGoogle Scholar
  6. 6.
    Bana e Costa, C.A., Vansnick, J.C.: The MACBETH approach: Basic Ideas, Software, and an Application. In: Meskens, N., Roubens, M.R. (eds.) Advances in Decision Analysis, vol. 4, pp. 131–157. Kluwer Academic Publishers, Dordrecht (1999)CrossRefGoogle Scholar
  7. 7.
    Bana e Costa, C.A., De Corte, J.M., Vansnick, J.C.: MACBETH. Int. J. Inf. Technol. Decis. Mak. 11, 359–387 (2012)CrossRefGoogle Scholar
  8. 8.
    Keeney, R.L., Raiffa, H.: Decisions with Multiple Objectives: Preferences and Value Tradeoffs. John Wiley & Sons, New York (1976)Google Scholar
  9. 9.
    von Winterfeldt, D., Edwards, W.: Decision Analysis and Behavioral Research. Cambridge University Press, Cambridge (1986)Google Scholar
  10. 10.
    Moody, D.L., Shanks, G.G.: Improving the Quality of Data Models: Empirical Validation of a Quality Management Framework. Inf. Syst. 28, 619–650 (2003)CrossRefzbMATHGoogle Scholar
  11. 11.
    Hevner, A.R., March, S.T., Park, J.: Design Science in Information Systems Research. MIS Q. 28, 75–105 (2004)Google Scholar
  12. 12.
    Peffers, K., Tuunamen, T., Rothenberger, M.A., Chatterjee, S.: A Design Science Re-search Methodology for Information Systems Research. J. Manage. Inf. Syst. 24, 45–77 (2008)CrossRefGoogle Scholar
  13. 13.
    Saaty, T.L.: The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation. McGraw-Hill (1980)Google Scholar
  14. 14.
    Bana e Costa, C.A., De Corte, J.M., Vansnick, J.C: M-MACBETH Version 1.1 User’s Guide (2005), (retrieved)
  15. 15.
    Bana e Costa, C.A., Vansnick, J.C.: A Critical Analysis of the Eigenvalue Method used to Derive Priorities in AHP. Eur. J. Oper. Res. 187, 1422–1428 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Dyer, J.S.: Remarks on the Analytic Hierarchy Process. Manage. Sci. 36, 249–258 (1990)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Costa, P., Santos, J., Mira da Silva, M.: Evaluation Criteria for Cloud Services. In: IEEE 6th International Conference on Cloud Computing, Santa Clara Marriott, CA, USA (2013)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Pedro Costa
    • 1
  • João Carlos Lourenço
    • 2
  • Miguel Mira da Silva
    • 1
  1. 1.Department of Computer Science and Engineering, Instituto Superior TécnicoUniversidade de LisboaLisbonPortugal
  2. 2.Centre for Management Studies of IST (CEG-IST), Instituto Superior TécnicoUniversidade de LisboaLisbonPortugal

Personalised recommendations