Skip to main content

Analyzing Usage Data in Enterprise Cloud Software: An Action Design Research Approach

  • Chapter
  • First Online:

Part of the book series: Progress in IS ((PROIS))

Abstract

The shift from on-premise to cloud enterprise software has fundamentally changed the interactions between software vendors and users. Since enterprise software users are now working directly on an infrastructure that is provided or monitored by the software vendor, enterprise cloud software providers are technically able to measure nearly every interaction of each individual user with their cloud products. The novel insights into actual usage that can thereby be gained provide an opportunity for requirements engineering to improve and effectively extend enterprise cloud products while they are being used. Even though academic literature has been proposing ideas and conceptualizations of leveraging usage data in requirements engineering for nearly a decade, there are no functioning prototypes that implement such ideas. Drawing on an exploratory case study at one of the world’s leading cloud software vendors, we conceptualize an Action Design Research project that fills this gap. The project aims to establish a software prototype that supports requirements engineering activities to incrementally improve enterprise cloud software in the post-delivery phase based on actual usage data.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Baskerville, R. L., & Wood-Harper, A. T. (1998). Diversity in information systems action research methods. European Journal of Information Systems, 7(2), 90–107. https://doi.org/10.1057/palgrave.ejis.3000298.

    Article  Google Scholar 

  • Benbasat, I., & Zmud, R. W. (1999). Empirical research in information systems: The practice of relevance. MIS Quarterly, 23(1), 3–16. https://doi.org/10.2307/249403.

    Article  Google Scholar 

  • Bick, S., Spohrer, K., Hoda, R., Scheerer, A., & Heinzl, A. (2017). Coordination challenges in large-scale software development: A case study of planning misalignment in hybrid settings. IEEE Transactions on Software Engineering, 44(10), 932–950. https://doi.org/10.1109/TSE.2017.2730870.

  • Bosch, J. (2000). Design and use of software architectures: Adopting and evolving a product-line approach. Pearson Education.

    Google Scholar 

  • Bosch, J. (2012). Building products as innovation experiment systems. In International Conference of Software Business (pp. 27–39), Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30746-1_3.

  • Bosch, J., & Olsson, H. H. (2016). Data-driven continuous evolution of smart systems. In 2016 IEEE/ACM 11th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) (pp. 28–34). https://doi.org/10.1109/seams.2016.011.

  • Chakraborty, S., Sarker, S., & Sarker, S. (2010). An exploration into the process of requirements elicitation: A grounded approach. Journal of the association for information systems (11:4).

    Google Scholar 

  • Choudhary, V. (2007). Software as a service: Implications for investment in software development. In 2007 40th Annual Hawaii International Conference on System Sciences (HICSS’07) (pp. 209a–209a), IEEE. https://doi.org/10.1109/hicss.2007.493.

  • Czarnecki, K. (2018). Requirements engineering in the age of societal-scale cyber-physical systems: The case of automated driving. In 2018 IEEE 26th International Requirements Engineering Conference (RE) (pp. 3–4), IEEE. https://doi.org/10.1109/re.2018.00-57.

  • Dąbrowski, J., Kifetew, F. M., Muñante, D., Letier, E., Siena, A., & Susi, A. (2017). Discovering requirements through goal-driven process mining. In 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW) (pp. 199–203). https://doi.org/10.1109/rew.2017.61.

  • Davis, A. M., & Hickey, A. M. (2002). Requirements researchers: Do we practice what we preach? Requirements Engineering, 7(2), 107–111. https://doi.org/10.1007/s007660200007.

    Article  Google Scholar 

  • Fabijan, A., Olsson, H. H., & Bosch, J. (2015). Customer Feedback and Data Collection Techniques in Software R&D: A Literature Review. In J. M. Fernandes, R. J. Machado, & K. Wnuk (Eds.), Software business (No. 210, pp. 139–153).

    Google Scholar 

  • Franch, X., Ayala, C., López, L., Martínez-Fernández, S., Rodríguez, P., Gómez, C., & Jedlitschka, A., et al. (2017). Data-driven requirements engineering in agile projects: The Q-rapids approach. In 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW) (pp. 411–414). https://doi.org/10.1109/rew.2017.85.

  • Grover, V., Chiang, R. H. L., Liang, T.-P., & Zhang, D. (2018). Creating strategic business value from big data analytics: A research framework. Journal of Management Information Systems, 35(2), 388–423. https://doi.org/10.1080/07421222.2018.1451951.

    Article  Google Scholar 

  • Harman, M., Lakhotia, K., Singer, J., White, D. R., & Yoo, S. (2013). Cloud engineering is search based software engineering too. Journal of Systems and Software, 86(9), 2225–2241. https://doi.org/10.1016/j.jss.2012.10.027.

    Article  Google Scholar 

  • Henderson, R. M., & Clark, K. B. (1990). Architectural Innovation: The reconfiguration of existing product technologies and the failure of established firms. Administrative Science Quarterly, 35(1), 9–30. https://doi.org/10.2307/2393549.

    Article  Google Scholar 

  • Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quarterly, 28(1), 75–105. https://doi.org/10.2307/25148625.

    Article  Google Scholar 

  • Hoffmann, P., Mateja, D., Spohrer, K., & Heinzl, A. (2019). Bridging the vendor-user gap in enterprise cloud software development through data-driven requirements engineering. In Proceedings of the 40th International Conference on Information Systems (ICIS), Munich.

    Google Scholar 

  • Hoda, R., Noble, J., & Marshall, S. (2013). Self-organizing roles on agile software development teams. IEEE Transactions on Software Engineering, 39(3), 422–444. https://doi.org/10.1109/TSE.2012.30.

    Article  Google Scholar 

  • Iacob, C., & Harrison, R. (2013). Retrieving and analyzing mobile apps feature requests from online reviews. In Proceedings of the 10th Working Conference on Mining Software Repositories (pp. 41–44), IEEE.

    Google Scholar 

  • Liu, L., Zhou, Q., Liu, J., & Cao, Z. (2017). Requirements cybernetics: Elicitation based on user behavioral data. Journal of Systems and Software, 124, 187–194. https://doi.org/10.1016/j.jss.2015.12.030.

    Article  Google Scholar 

  • Maalej, W., Nayebi, M., Johann, T., & Ruhe, G. (2016). Toward data-driven requirements engineering. IEEE Software, 33(1), 48–54. https://doi.org/10.1109/MS.2015.153.

    Article  Google Scholar 

  • Mathiassen, L., Rossi, M., Saarinen, T., & Tuunanen, T. (2007). A contingency model for requirements development. Journal of the Association for Information Systems, 8(11), 569–597.

    Article  Google Scholar 

  • Oh, J., Kim, D., Lee, U., Lee, J. G., & Song, J. (2013). Facilitating developer-user interactions with mobile app review Digests. In CHI’13 Extended Abstracts on Human Factors in Computing Systems (pp. 1809–1814), ACM. https://doi.org/10.1145/2468356.2468681.

  • Olsson, H. H., & Bosch, J. (2013). Towards data-driven product development: A multiple case study on post-deployment data usage in software-intensive embedded systems. In International Conference on Lean Enterprise Software and Systems (pp. 152–164), Springer, Berlin, Heidelberg.

    Google Scholar 

  • Olsson, H. H., & Bosch, J. (2014). From opinions to data-driven Software R&D: A multi-case study on how to close the ‘Open Loop’ problem. In 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications (pp. 9–16), IEEE. https://doi.org/10.1109/seaa.2014.75.

  • Olsson, H. H., & Bosch, J. (2015). Towards continuous customer validation: A conceptual model for combining qualitative customer feedback with quantitative customer observation. In J. M. Fernandes, R. J. Machado, & K. Wnuk (Eds.), Software business (No. 210, pp. 154–166).

    Google Scholar 

  • Oriol, M., Stade, M., Fotrousi, F., Nadal, S., Varga, J., Seyff, N., & Abello, A., et al. (2018). FAME: Supporting continuous requirements elicitation by combining user feedback and monitoring. In 2018 IEEE 26th International Requirements Engineering Conference (RE) (pp. 217–227), IEEE. https://doi.org/10.1109/re.2018.00030.

  • Orlikowski, W. J., & Iacono, C. S. (2001). Research commentary: Desperately seeking the ‘IT’ in IT research—A call to theorizing the IT artifact. Information Systems Research, 12(2), 121–134. https://doi.org/10.1287/isre.12.2.121.9700.

    Article  Google Scholar 

  • Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C. A., Canfora, G., & Gall, H. C. (2015). How can I improve my App? Classifying user reviews for software maintenance and evolution. In 2015 IEEE International Conference on Software Maintenance and Evolution (pp. 281–290). https://doi.org/10.1109/icsm.2015.7332474.

  • Pohl, K. (2010). Requirements engineering: fundamentals, principles, and techniques, 1st edn. Springer Publishing Company.

    Google Scholar 

  • Robinson, W. (2010). A roadmap for comprehensive requirements modeling. IEEE Computer, 43(5), 64–72. https://doi.org/10.1109/MC.2009.373.

    Article  Google Scholar 

  • Sein, M., Henfridsson, O., Purao, S., Rossi, M., & Lindgren, R. (2011). Action design research. Management Information Systems Quarterly, 35(1), 37–56. https://doi.org/10.2307/23043488.

    Article  Google Scholar 

  • Sommerville, I. (2007). Software engineering, 8th edn. Addison Wesley.

    Google Scholar 

  • Stade, M., Oriol, M., Cabrera, O., Fotrousi, F., Schaniel, R., Seyff, N., & Schmidt, O. (2017). Providing a user forum is not enough: First experiences of a software company with CrowdRE. In IEEE 25th International Requirements Engineering Conference Workshops (REW) (pp. 164–169). https://doi.org/10.1109/rew.2017.21.

  • Vaishnavi, V., Kuechler, W., & Petter, S. (Eds.). (2004). Design science research in information systems. Created in 2004 and updated until 2015 by Vaishnavi, V. and Kuechler, W.; last updated by Vaishnavi, V. and Petter, S. 2019. http://www.desrist.org/design-research-in-information-systems/.

  • Yin, R. (2018). Case study research and applications, 6th edn, Sage.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philipp Hoffmann .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hoffmann, P., Spohrer, K., Heinzl, A. (2020). Analyzing Usage Data in Enterprise Cloud Software: An Action Design Research Approach. In: Hirschheim, R., Heinzl, A., Dibbern, J. (eds) Information Systems Outsourcing. Progress in IS. Springer, Cham. https://doi.org/10.1007/978-3-030-45819-5_11

Download citation

Publish with us

Policies and ethics