Identifying the Taiwanese Electronic Health Record Systems Evaluation Framework and Instrument by Implementing the Modified Delphi Method

Part of the Healthcare Delivery in the Information Age book series (Healthcare Delivery Inform. Age)


The aim of this research is to design an appropriate conceptual evaluation framework with a draft instrument to validate the structure of the Taiwanese EHR systems evaluation framework. The modified Delphi method was applied to refine the proposed instrument for practicality in real medical environment. The degree of consensus between and within questions in the proposed instrument by calculating both content validity index for items (I-CVI) and content validity index for scales (S-CVI) were presented in this chapter. An appropriate instrument for achieving its research purpose was achieved in this research.


Electronic health records system Delphi method EHR success EHR implementation EHR evaluation Sociotechnical 


  1. Ammenwerth, E., Graber, S., Herrmann, G., Burkle, T., & Konig, J. (2003a). Evaluation of health information systems—problems and challenges. International Journal of Medical Informatics, 71(2–3), 125.CrossRefGoogle Scholar
  2. Ammenwerth, E., Iller, C., & Mansmann, U. (2003b). Can evaluation studies benefit from triangulation? A case study. International Journal of Medical Informatics, 70(2–3), 237–248.CrossRefGoogle Scholar
  3. Ammenwerth, E., Kaiser, F., Wilhelmy, I., & Hofer, S. (2003c). Evaluation of user acceptance of information systems in health care—the value of questionnaires. In: Medical Informatics Europe (MIE 2003) (pp. 643–648). Malo: IOS Press.Google Scholar
  4. Ammenwerth, E., Brender, J., Nykanen, P., Prokosch, H. U., Rigby, M., & Talmon, J. (2004). Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the his-eval workshop in Innsbruck. International Journal of Medical Informatics, 73(6), 479–471.PubMedCrossRefGoogle Scholar
  5. Bostrom, R. P., & Heinen, J. S. (1977). MIS problems and failures: A socio-technical perspective. Part I. The causes MIS Quarterly, 1(3), 17–32.Google Scholar
  6. D’Onofrio, M., & Gendron, M. (2001). Data quality in the healthcare industry. Data Quality, 7(1), 14.Google Scholar
  7. DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information System Research, 3(1), 60–95.CrossRefGoogle Scholar
  8. Donabedian, A. (2003). An introduction to quality assurance in health care/avedis donabedian. New York: Oxford University Press.Google Scholar
  9. Hesse, B. W., & Shneiderman, B. (2007). Ehealth research from the user’s perspective. American Journal of Preventive Medicine, 32(5, Suppl. 1), S97–S103.PubMedCrossRefGoogle Scholar
  10. Hubley, A., & Palepu, A. (2007). Injection drug user quality of life scale (iduqol): Findings from a content validation study. Health and Quality of Life Outcomes, 5(1), 46.PubMedCrossRefGoogle Scholar
  11. Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–385.PubMedCrossRefGoogle Scholar
  12. Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29, 489–497.CrossRefGoogle Scholar
  13. Rushton, A., & Lindsay, G. (2008). Defining the construct of masters level clinical practice in healthcare based on the UK experience. Medical Teacher, 30(4), 100–107.CrossRefGoogle Scholar
  14. Snyder-Halpern, R. (2001). Indicators of organizational readiness for clinical information technology/systems innovation: A Delphi study. International Journal of Medical Informatics, 63(3), 179–204.PubMedCrossRefGoogle Scholar
  15. Su, Y. Y., Win, K. T., & Fulcher, J. (2006). Electronic health record system evaluation based on patient safety. Asia Pacific Medical Information Association Conference 2006, Taipei, Taiwan, 27–29 2006. Taiwan Medical Information Association, 154.Google Scholar
  16. Takemura, Y., Liu, J., Atsumi, R., & Tsuda, T. (2006). Development of a questionnaire to evaluate patient satisfaction with medical encounters. Tohoku Journal of Experimental Medicine, 210(4), 373–381.PubMedCrossRefGoogle Scholar
  17. Wan, T. T. H. (2002). Evidence-based health care management: Multivariate modeling approaches. Boston: Kluwer.CrossRefGoogle Scholar
  18. Win, K. T. (2004). Identifying the risk assessment method applicable to the electronic health record systems. HIC2004, Brisbane, July 2004. Health Informatics Society of Australia (HISA).Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Graduate Institute of Health CareMeiho University 23Pingtung CountyTaiwan
  2. 2.School of Information Systems and Technology, University of WollongongWollongongAustralia

Personalised recommendations