System Evaluation

  • Eleanor Callahan Hunt
  • Sara Breckenridge Sproat
  • Rebecca Rutherford Kitzmiller
Part of the Health Informatics Series book series (HI)


Evaluation points out successes and failures in the software application and the implementation process and validates the system by verifying or capturing return on investment (ROI). By identifying both the strengths and the weaknesses of the implementation process, an evaluation study often leads to system revisions and, ultimately, a better system.1 Evaluation is useful for future project planning to avoid repeating similar situations in future implementations. Periodic evaluations also tell us where to refine the system or reeducate the users.2 Evaluation lessons are often documented in the literature as “lessons learned.” The literature suggests that all systems should be formally evaluated once they are installed, but this is not always done or thought to be important.3


System Implementation Computerize Provider Order Entry Informatics Advice Information System Evaluation Nurse Information System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Saba V, McCormick K. Essentials of Computers for Nurses, 3rd ed. New York: McGraw-Hill, 2001.Google Scholar
  2. 2.
    Larrabee JH, Boldreghini S, Elder-Sorrells K, Turner ZM, Wender RG, Hart JM, Lenzi PS. Evaluation of documentation before and after implementation of a nursing information system in an acute care hospital. Computers in Nursing 2001; 19 (2): 56–65.PubMedGoogle Scholar
  3. 3.
    Austin CJ, Hornerger KD, Shmerling JE. Managing information resources: a study of ten healthcare organizations. Journal of Healthcare Management 2000; 45 (4): 229–239.PubMedGoogle Scholar
  4. 4.
    Timmreck TC. Planning, Program Development, and Evaluation. Massachusetts: Jones and Bartlett Publishers, 1995. Available at (March 25, 2003).Google Scholar
  5. 5.
    Cantor M. Software Leadership: A Guide to Successful Software Development. New York: Addison-Wesley, 2002.Google Scholar
  6. 6.
    Whitten N. Managing Software Development Projects: Formula for Success, 2nd ed. New York: John Wiley & Sons, 1995.Google Scholar
  7. 7.
    Headquarters Department of the Army (30 September 1993 ), Training Circular (TC) 25–20. A Leader’s Guide to After-Action Reviews Washington, DC: US Government Printing Office.Google Scholar
  8. 8.
    Mintzer R. The Everything Project Management Book. Avon, MA: Adams Media Corporation, 2002.Google Scholar
  9. 9.
    Ball MJ, Hannah KJ, Newbold SK, Douglas JV. Nursing Informatics: Where Caring and Technology Meet, 3rd ed. New York: Springer-Verlag, 2000.Google Scholar
  10. 10.
    LaDuke S. Online nursing documentation. Finding a middle ground. JONA 2001; 31 (6): 283–286.CrossRefGoogle Scholar
  11. 11.
    Hebda T, Czar P, Mascara, C. Handbook of Informatics for Nurses and Health Care Professionals, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 2001.Google Scholar
  12. 12.
    McDonald T, Blignaut PJ. A comparison of a manual and a computer system in a primary health care clinic. Curationis 1998; 21 (3): 8–13.PubMedGoogle Scholar
  13. 13.
    Pabst MK, Scherubel JC, Minnick AF. The impact of computerized documentation on nurses’s use of time. Computers in Nursing 1996; 14 (1): 25–30.PubMedGoogle Scholar
  14. 14.
    Graf CM, Millar S, Feilteau C, Coakley PJ, Erickson JI. Patients’ needs for nursing care: beyond staffing ratios. Journal of Nursing Administration 2003; 33 (2): 76–81.PubMedCrossRefGoogle Scholar
  15. 15.
    Travers DA. Downs SM. Comparing user acceptance of a computer system in two pediatric offices: a qualitative study. Proceedings of the AMIA Annual Symposium, 2000, pp. 853–857.Google Scholar
  16. 16.
    Remenyi D. The elusive nature of delivering benefits from IT investment. The Electronic Journal of Information System Evaluation. ejise/vol3/paperl.html (April 16, 2003).Google Scholar
  17. 17.
    The value of healthcare information technology. publitions/HIMSS.pdf (September 12, 2003).Google Scholar
  18. 18.
    Lillrank P, Holopainen S, Paavola T. Catching intangible IT benefits. The Electronic Journal of Information System Evaluation. fr_ind.html (April 16, 2003).Google Scholar
  19. 19.
    Snyder-Halpern R, Wagner MC. Evaluating return-on-investment for a hospital clinical information system. Computers in Nursing 2000; 18 (5): 213–219.PubMedGoogle Scholar
  20. 20.
    MacKinnon R. Beyond now technologies website. Message.htm (April 18, 2003).Google Scholar
  21. 21.
    Blignaut PJ, McDonald T, Tolmie CJ. Predicting the learning and consultation time in a computerized healthcare clinic. Computers in Nursing 2001; 19 (3): 130–136.PubMedGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2004

Authors and Affiliations

  • Eleanor Callahan Hunt
    • 1
  • Sara Breckenridge Sproat
    • 2
  • Rebecca Rutherford Kitzmiller
    • 3
  1. 1.Informatics ConsultantRaleighUSA
  2. 2.67th Combat Support Hospital, UnitWuerzburgGermany
  3. 3.Duke University Health SystemDurhamUSA

Personalised recommendations