Abstract
Evaluation is a key element in the design of IT-based artifacts. A designer finds a suitable and interesting problem to solve. Then they come up with design solutions. That is followed by the actual build phase. After they have built the artifact, the next phase is evaluating for efficiency, utility, or performance.
Evaluation is a crucial component in the design science research process. The designed IT artifact is a socio-technical entity that exists within an environment (business or social) which lays out the requirements for its evaluation. Such evaluation of IT artifacts requires definition of appropriate metrics and possibly the gathering and analysis of appropriate data. IT artifacts can be evaluated in terms of functionality, completeness, consistency, accuracy, performance, reliability, usability, fit with the organization, and other relevant quality attributes (Hevner, March et al. 2004).
In this chapter, it is our goal to help the reader understand the different issues, questions, methods, and techniques that arise when one does evaluation. To present a full detailed analysis of various techniques is beyond the scope of this chapter or the book, but we hope that the reader will learn to ask the right questions, know when to apply which technique and be confident to look at the right places for more answers.
Keywords
- Clinical Decision Support System
- Design Science
- Reminder Group
- Information System Architecture
- Postoperative Infection Rate
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
I keep six honest serving men. They taught me all I knew. Their names are What and Why and When and How and Where and Who.
– Rudyard Kipling
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Friedman, C. P. and J. C. Wyatt (1997) Evaluation Methods in Medical Informatics, Springer-Verlag New York, LLC.
Hevner, A., S. March, J. Park, and S. Ram (2004) Design science in information systems research." MIS Quarterly 28 (1), pp. 75–105.
Jain, R. (1991) The Art of Computer Systems Performance Analysis, J. Wiley & Sons, Inc, New York.
Schroeder, L. D., D. L. Sjoquist, and P. E. Stephan (2007) Understanding Regression Analysis: An Introductory Guide. Sage Series: Quantitative Applications in the Social Sciences, No. 07-057.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2010 Springer-Verlag US
About this chapter
Cite this chapter
Hevner, A., Chatterjee, S. (2010). Evaluation. In: Design Research in Information Systems. Integrated Series in Information Systems, vol 22. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-5653-8_9
Download citation
DOI: https://doi.org/10.1007/978-1-4419-5653-8_9
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4419-5652-1
Online ISBN: 978-1-4419-5653-8
eBook Packages: Business and EconomicsBusiness and Management (R0)