Skip to main content

The Evaluation Aspect of Digital Business Model Innovation

A Literature Review on Tools and Methodologies

  • Chapter
  • First Online:

Part of the book series: Progress in IS ((PROIS))

Abstract

Despite the increasing importance of business model innovation (BMI), a lack of understanding on the evaluation aspect still exists within research. Thereby, the development of tools and methodologies for BMI lacks sufficient consideration in both theory and practice. This paper contributes by systematically reviewing present literature with an explicit focus on the applicability in digital BMI projects. The authors elaborate a categorization of tools and methodologies concerning two major logics of evaluation: analytical/effectual and quantitative/qualitative. This sheds light upon the dominant mode of evaluation within different stages of digital BMI processes.

Previously published in proceedings of the Twenty-Fifth European Conference on Information Systems (ECIS), Guimares, Portugal, 2017.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Abdelkafi, N., Makhotin, S., & Posselt, T. (2013). Business model innovations for electric mobility—What can be learned from existing business model patterns? International Journal of Innovation Management, 17(1), 1–41.

    Google Scholar 

  • Al-Debei, M., Al-Lozi, E., & Al-Hujran, O. (2015). Critical design and evaluation factors of mobile business models. Journal of Enterprise Information Management, 28(5), 698–717.

    Article  Google Scholar 

  • Ali, A. (2015). An Mcdm approach towards m-payment business models evaluation. International Journal of the Analytic Hierarchy Process, 7(2), 273–294.

    Article  Google Scholar 

  • Amshoff, B., Dülme, C., Echterfeld, J., & Gausemeier, J. (2015). Business model patterns for disruptive technologies. International Journal of Innovation Management, 19, 1–22.

    Article  Google Scholar 

  • Bereznoi, A. (2015). Business model innovation in corporate competitive strategy. Problems of Economic Transition, 57(8), 14–33.

    Article  Google Scholar 

  • Bettis, R. A., Gambardella, A., Helfat, C., & Mitchell, W. (2015). Qualitative empirical research in strategic management. Strategic Management Journal, 36(5), 637–639.

    Article  Google Scholar 

  • Bouwman, H., Reuver, M. de, Solaimani, S., Daas, D., Haaker, T., Janssen, W., Iske, P., & Walenkamp, B. (2012). Business models tooling and a research agenda. In Bled eConference, Vol. 25.

    Google Scholar 

  • Brea-Solís, H., Casadesus-Masanell, R., & Grifell-Tatjé, E. (2015). Business model evaluation: Quantifying Walmart’s sources of advantage. Strategic Entrepreneurship Journal, 9(1), 12–33.

    Article  Google Scholar 

  • Bredmar, K. (2015). Transforming environmental uncertainty to risk—Managing risk and management control. Global Business and Management Research, 7(3), 44–54.

    Google Scholar 

  • Breuer, H. (2013). Lean venturing: Learning to create new business through exploration, elaboration, evaluation, experimentation, and evolution. International Journal of Innovation Management, 17(03), 1–22.

    Article  Google Scholar 

  • Broadbent, J., Gill, J., & Laughlin, R. (2008). Identifying and controlling risk. The problem of uncertainty in the private Finance initiative in the UK’s national health service. Critical Perspectives on Accounting, 19(1), 40–78.

    Article  Google Scholar 

  • Bucherer, E., & Uckelmann, D. (2011). Business models for the internet of things. In Architecting the internet of things (pp. 253–277). Berlin: Springer.

    Chapter  Google Scholar 

  • Burkhart, T., Krumeich, J., Werth, D., & Loos, P. (2011). Analyzing the business model concept—A comprehensive classification of literature. ICIS 2011 Proceedings, Shanghai, CHN, 12, 1–19.

    Google Scholar 

  • Cannon, S., & Summers, L. H. (2014). How Uber and the sharing economy can win over regulators. Harvard Business Review, 10(13), 24–28.

    Google Scholar 

  • Casadesus-Masanell, R., & Ricart, J. E. (2007). Competing through business models. IESE Business School, D/713, 1–28.

    Google Scholar 

  • Casadesus-Masanell, R., & Ricart, J. E. (2010). From strategy to business models and onto tactics. Long Range Planning, 43(2–3), 195–215.

    Article  Google Scholar 

  • Cavalcante, S. A. (2014). Designing business model change. International Journal of Innovation Management, 18(02), 1–22.

    Article  Google Scholar 

  • Chandler, G. N., DeTienne, D. R., McKelvie, A., & Mumford, T. V. (2011). Causation and effectuation processes. A validation study. Journal of Business Venturing, 26(3), 375–390.

    Article  Google Scholar 

  • Chesbrough, H. (2007). Business model innovation: It’s not just about technology anymore. Strategy and Leadership, 35(6), 12–17.

    Article  Google Scholar 

  • Chesbrough, H. (2010). Business model innovation: Opportunities and barriers. Long Range Planning, 43(2–3), 354–363.

    Article  Google Scholar 

  • Cooper, R. G. (1990). Stage-gate systems: A new tool for managing new products. Business Horizons, 5(6), 44–54.

    Article  Google Scholar 

  • Daas, D., Hurkmans, T., Overbeek, S., & Bouwman, H. (2013). Developing a decision support system for business model design. Electronic Markets, 23(3), 251–265.

    Article  Google Scholar 

  • De Reuver, M., Bouwman, H., & Haaker, T. (2013). Business model roadmapping: A practical approach to come from an existing to a desired business model. International Journal of Innovation Management, 17(01), 1–18.

    Article  Google Scholar 

  • de Reuver, M., Bouwman, H., & Maclnnes, I. (2009). Business model dynamics: A case survey. Journal of Theoretical and Applied Electronic Commerce Research, 4(1), 1–11.

    Article  Google Scholar 

  • Demil, B., & Lecocq, X. (2010). Business model evolution: In search of dynamic consistency. Long Range Planning, 43(2–3), 227–246.

    Article  Google Scholar 

  • Dew, N., Read, S., Sarasvathy, S. D., & Wiltbank, R. (2009). Effectual versus predictive logics in entrepreneurial decision-making. Differences between experts and novices. Journal of Business Venturing, 24(4), 287–309.

    Article  Google Scholar 

  • Doz, Y. L., & Kosonen, M. (2010). Embedding strategic agility: A leadership agenda for accelerating business model renewal. Long Range Planning, 43(2–3), 370–382.

    Article  Google Scholar 

  • D’Souza, A., Wortmann, H., Huitema, G. B., & Velthuijsen, H. (2015). A business model design framework for viability; A business ecosystem approach. Journal of Business Models, 3(2), 1–29.

    Google Scholar 

  • Eiselt, H. A., & Marianov, V. (2014). Multicriteria decision making under uncertainty. A visual approach. International Transactions in Operational Research, 21(4), 525–540.

    Article  Google Scholar 

  • Eisenhardt, K. M. (1989). Building Theories from case study research. Academy of Management Review, 14(4), 532–550.

    Google Scholar 

  • El Sawy, O. A., & Pereira, F. (2013). Business modelling in the dynamic digital space: An ecosystem approach, Springer Briefs in digital spaces. Berlin, New York: Springer.

    Book  Google Scholar 

  • Fichman, R. G., Dos Santos, B. L., & Zheng, Z. (2014). Digital innovation as a fundamental and powerful concept in the information systems curriculum. MIS Quarterly, 38(2), 329–A15.

    Article  Google Scholar 

  • Frankenberger, K., Weiblen, T., Csik, M., & Gassmann, O. (2013). The 4I-framework of business model innovation: A structured view on process phases and challenges. International Journal of Product Development, 18(3/4), 1–18.

    Article  Google Scholar 

  • Gambardella, A., & McGahan, A. M. (2010). Business-model innovation: General Purpose technologies and their implications for industry structure. Long Range Planning, 43(2–3), 262–271.

    Article  Google Scholar 

  • Gassmann, O., Frankenberger, K., & Csik, M. (2014). The business model navigator: 55 models that will revolutionise your business. Harlow, UK: Pearson.

    Google Scholar 

  • Giessmann, A., & Stanoevska, K. (2012). Platform as a service–A conjoint study on consumers’ preferences. In Proceedings if the Thirty Third International Conference on Information Systems (ICIS).

    Google Scholar 

  • Gordijn, J., & Akkermans, H. (2001). Designing and evaluating e-business models. IEEE Intelligent Systems, 16(4), 11–17.

    Article  Google Scholar 

  • Hanelt, A., Hildebrandt, B., & Polier, J. (2015). Uncovering the role of IS in business model innovation. A Taxonomy-Driven Approach to Structure the Field. Proceedings of Wirtschaftsinformatik 2015.

    Google Scholar 

  • Hart, S., Jan Hultink, E., Tzokas, N., & Commandeur, H. R. (2003). Industrial companies’ evaluation criteria in new product development gates. Journal of Product Innovation Management, 20(1), 22–36.

    Article  Google Scholar 

  • Heikkilä, M., Bouwman, H., Heikkilä, J., Haaker, T., Nicolas, C. L., & Riedl, A. (2016). Business model innovation paths and tools. 29th Bled eConference, 29, 1–17.

    Google Scholar 

  • Heikkilä, M., Bouwman, H., Heikkilä, J., Solaimani, S., & Janssen, W. (2015). Business model metrics: An open repository. Information Systems and e-Business Management, 14, 1–30.

    Article  Google Scholar 

  • Johnson, M. W. (2010). Seizing the white space: Business model innovation for growth and renewal. Boston, USA: Harvard Business Press.

    Google Scholar 

  • Johnson, M. W., Christensen, C. M., & Kagermann, H. (2008). Reinventing your business model. Harvard Business Review, 86(12), 57–68.

    Google Scholar 

  • Kauffman, R. J., & Wang, B. (2008). Tuning into the digital channel. Evaluating business model characteristics for Internet firm survival. Information Technology and Management, 9(3), 215–232.

    Article  Google Scholar 

  • Killus, H. (2016). Evaluating business models in the era of the internet of things. A literature review to evolve a research agenda. Bachelor’s thesis, Institut für Wirtschaftsinformatik, Georg-August-Universität Göttingen, Göttingen, 2016.

    Google Scholar 

  • Kley, F. (2011). Ladeinfrastrukturen für Elektrofahrzeuge: Entwicklung einer Ausbaustrategie auf Basis des Fahrverhaltens. Fraunhofer-Verl, Stuttgart: ISI-Schriftenreihe Innovationspotenziale.

    Google Scholar 

  • Koen, P. A., Bertels, H. M. J., & Elsum, I. R. (2011). The three faces of business model innovation. Challenges for established firm. Research Technology Management, 54(3), 52–59.

    Article  Google Scholar 

  • Lee, I., & Lee, K. (2015). The Internet of Things (IoT). Applications, investments, and challenges for enterprises. Business Horizons, 58(4), 431–440.

    Article  Google Scholar 

  • Levy, Y., & Ellis, T. J. (2006). A systems approach to conduct an effective literature review in support of information systems research. Informing Science Journal, 9, 181–212.

    Article  Google Scholar 

  • Magruk, A. (2015). The most important aspects of uncertainty in the internet of things field—Context of smart buildings. Procedia Engineering, 122, 220–227.

    Article  Google Scholar 

  • Martikainen, A., Niemi, P., & Pekkanen, P. (2014). Developing a service offering for a logistical service provider—Case of local food supply chain. International Journal of Production Economics, 157(C), 318–326.

    Article  Google Scholar 

  • McGrath, R. G. (2010). Business models: A discovery driven approach. Long Range Planning, 43(2–3), 247–261.

    Article  Google Scholar 

  • Morris, M., Schindehutte, M., & Allen, J. (2005). The entrepreneur’s business model. Toward a unified perspective. Journal of Business Research, 58(6), 726–735.

    Article  Google Scholar 

  • N. N. (2015). VERBAND DER HOCHSCHULLEHRER FÜR BETRIEBSWIRTSCHAFT E.V.: GESAMTLISTE. Alphabetische Gesamtliste der Fachzeitschriften in VHB-JOURQUAL3. Available at: http://vhbonline.org/service/jourqual/vhb-jourqual-3/gesamtliste/. Accessed 7 March 2016.

  • Osterwalder, A., Pigneur, Y., & Clark, T. (2010). Business model generation: A handbook for visionaries, game changers, and challengers (1st ed.). Hoboken, NJ: Wiley.

    Google Scholar 

  • Pateli, A. G., & Giaglis, G. M. (2004). A research framework for analysing eBusiness models. European Journal of Information Systems, 13(4), 302–314.

    Article  Google Scholar 

  • Pousttchi, K., & Hufenbach, Y. (2011). Value creation in the mobile market. Business and Information Systems Engineering, 3(5), 299–311.

    Article  Google Scholar 

  • Remane, G., Hanelt, A., Tesch, J., & Kolbe, L. M. (2017). The business model pattern database. A tool for systematic business model innovation. International Journal of Innovation Management, 21, 1750004-1–1750004-61.

    Article  Google Scholar 

  • Ries, E. (2011). The lean startup: How constant innovation creates radically successful businesses. London: Portfolio Penguin.

    Google Scholar 

  • Sarasvathy, S. D. (2001). Causation and effectuation: Toward a theoretical shift from economic inevitability to entrepreneurial contingency. Academy of Management Review, 26(2), 243–263.

    Article  Google Scholar 

  • Schneider, S., & Spieth, P. (2013). Business model innovation. Towards an integrated future research agenda. International Journal of Innovation Management, 17(01), 1–35.

    Article  Google Scholar 

  • Schoemaker, P. J., Day, G. S., & Snyder, S. A. (2013). Integrating organizational networks, weak signals, strategic radars and scenario planning. Technological Forecasting and Social Change, 80(4), 815–824.

    Article  Google Scholar 

  • Sharma, S., & Gutiérrez, J. A. (2010). An evaluation framework for viable business models for m-commerce in the information technology sector. Electronic Markets, 20(1), 33–52.

    Article  Google Scholar 

  • Shi, Y., & Manning, T. (2009). Understanding business models and business model risks. The Journal of Private Equity, 12(2), 49–59.

    Article  Google Scholar 

  • Sosna, M., Trevinyo-Rodríguez, R. N., & Velamuri, S. Ramakrishna. (2010). Business model innovation through trial-and-error learning: The Naturhouse case. Long Range Planning, 43(2–3), 383–407.

    Article  Google Scholar 

  • Taran, Y., Boer, H., & Lindgren, P. (2015). A business model innovation typology. Decision Sciences, 46, 301–331.

    Article  Google Scholar 

  • Teece, D. J. (2010). Business models, business strategy and innovation. Long Range Planning, 43(2–3), 172–194.

    Article  Google Scholar 

  • Tesch, J. F. (2016). Discovering the role of scenario planning as an evaluation methodology for business models in the era of the internet of things (IoT). In Proceedings of the Twenty-Fourth European Conference on Information Systems (ECIS), Vol. 24, pp. 1–25.

    Google Scholar 

  • Tesch, J. F., Brillinger, A.-S., & Bilgeri, D. (2017). Internet of things business model innovation and the stage gate process: An exploratory analysis. International Journal of Innovation Management, 21(5), 1740002.

    Article  Google Scholar 

  • Thompson, J. D., & MacMillan, I. C. (2010). Business models: Creating new markets and societal wealth. Long Range Planning, 43(2–3), 291–307.

    Article  Google Scholar 

  • Turber, S., & Smiela, C. (2014). A business model type for the Internet of Things. In ECIS 2014 Proceedings, Tel Aviv, ISR, No. 4, pp. 1–10.

    Google Scholar 

  • Vecchiato, R. (2012). Strategic foresight: Matching environmental uncertainty. Technology Analysis and Strategic Management, 24(8), 783–796.

    Article  Google Scholar 

  • Veit, D., Clemons, E., Benlian, A., Buxmann, P., Hess, T., Kundisch, D., et al. (2014). Business models. Business & Information Systems Engineering, 6(1), 45–53.

    Article  Google Scholar 

  • Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for the future: Writing a literature review. Management Information Systems Quarterly, 26(2), 13–23.

    Google Scholar 

  • Westerlund, M., Leminen, S., & Rajahonka, M. (2014). Designing business models for the internet of things. Technology Innovation Management Review, 4(7), 5–14.

    Article  Google Scholar 

  • Wirtz, B. W., Pistoia, A., Ullrich, S., & Göttel, V. (2016). Business models: Origin, development and future research perspectives. Long Range Planning, 49(1), 36–54.

    Article  Google Scholar 

  • Wirtz, B. W., Schilke, O., & Ullrich, S. (2010). Strategic development of business models: Implications of the Web 2.0 for creating value on the internet. Long Range Planning, 43(2), 272–290.

    Article  Google Scholar 

  • Yüksel, I. (2012). Developing a multi-criteria decision making model for PESTEL analysis. International Journal of Business and Management, 7(24), 52–66.

    Article  Google Scholar 

  • Yunus, M., Moingeon, B., & Lehmann-Ortega, L. (2010). Building social business models: Lessons from the grameen experience. Long Range Planning 43(2–3), S.308–325.

    Article  Google Scholar 

  • Zibuschka, J., Nofer, M. & Hinz, O. (2016). Zahlungsbereitschaft für Datenschutzfunktionen intelligenter Assistenten (pp. 1391–1402). Multikonferenz Wirtschaftsinformatik (MKWI), Ilmenau.

    Google Scholar 

  • Zott, C., & Amit, R. (2010). Business model design: An activity system perspective. Long Range Planning, 43(2–3), 216–226.

    Article  Google Scholar 

  • Zott, C., Amit, R., & Massa, L. (2011). The business model. Recent developments and future research. Journal of Management, 37(4), 1019–1042.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan F. Tesch .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Tesch, J.F., Brillinger, AS. (2019). The Evaluation Aspect of Digital Business Model Innovation. In: Tesch, J. (eds) Business Model Innovation in the Era of the Internet of Things. Progress in IS. Springer, Cham. https://doi.org/10.1007/978-3-319-98723-1_4

Download citation

Publish with us

Policies and ethics