• Gondy Leroy
Part of the Health Informatics book series (HI)


This chapter provides an overview of resources available to developers and researchers who intend to evaluate their information systems systematically with human participants. The chapter starts by describing pilot studies. Although many would not think of this as a resource per se, conducting pilot studies is invaluable. It allows for evaluation of the final study design and also will provide valuable feedback on the system itself. It is therefore emphasized in this section. Next, several existing resources are described such as test data and gold standards, vocabularies and more structured knowledge sources such as ontologies. A few data analysis tools are also highlighted.


Open Access Journal Unify Medical Language System Linguistic Data Consortium Text Mining System Unify Medical Language System Concept 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Leroy G, Helmreich S, Cowie J (2010) The influence of text characteristics on perceived and actual difficulty of health information. Int J Med Inform 79(6):438–449PubMedCrossRefGoogle Scholar
  2. 2.
    Leroy G, Helmreich S, Cowie JR (2010) The effects of linguistic features and evaluation perspective on perceived difficulty of medical text. In: Hawaii international conference on system sciences (HICSS), Kauai, 5–8 January 2010Google Scholar
  3. 3.
    De Leo G, Gonzales C, Battagiri P, Leroy G (2010) A smart-phone application and a companion website for the improvement of the communication skills of children with autism: clinical rationale, technical development and preliminary results. J Med Syst. DOI: 10.1007/s10916-009-9407-1Google Scholar
  4. 4.
    Leroy G, Chuang S, Huang J, Charlop-Christy MJ (2005) Digital libraries on handhelds for autistic children. In: ACM I (ed) Fifth ACM  +  IEEE joint conference on digital libraries (JCDL-2005), Denver, Colorado, 7–11 June 2005Google Scholar
  5. 5.
    Zeng QT, Tse T, Crowell J, Divita G, Roth L, Browne AC (2005) Identifying consumer-friendly display (CFD) names for health concepts. In: AMIA 2005 fall symposium, Washington DC, USA, 2005, pp 859–863Google Scholar
  6. 6.
    Keselman A, Smith CA, Divita G, Kim H, Browne A, Leroy G, Zeng-Treitler Q (2008) Consumer health concepts that do not map to the UMLS: where do they fit? J Am Med Inform Assoc 15(4):496–505PubMedCrossRefGoogle Scholar
  7. 7.
    Smith B, Ashburner M, Rosse C, Bard C, Bug W, Ceusters W, Goldberg LJ, Eilbeck K, Ireland A, Mungall CJ, The OBI Consortium, Leontis N, Rocca-Serra P, Ruttenberg A, Sansone S-A, Scheuermann RH, Shah N, Whetzel PL, Lewis S (2007) The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol 25:251–1255CrossRefGoogle Scholar
  8. 8.
    Fillmore CJ, Baker CF (2010) A frame approach to semantic analysis. In: Heine B, Narrog H (eds) Oxford handbook of linguistic analysis. OUPGoogle Scholar
  9. 9.
    Miller GA, Beckwidth R, Fellbaum C, Gross D, Miller K (1998) Introduction to WordNet: an on-line lexical database.
  10. 10.
    Witten IH, Frank E (2000) Data mining: practical machine learning tools and techniques with Java. The Morgan Kaufmann Series in data management systems. Morgan Kaufmann, San FranciscoGoogle Scholar
  11. 11.
    Cunningham H, Maynard D, Bontcheva K, Tablan V (2002) GATE: a framework and graphical development environment for robust NLP tools and applications. In: 40th Anniversary Meeting of the Association for Computational Linguistics (ACL’02), Philadelphia, July 2002Google Scholar
  12. 12.
    Rindflesch TC, Fiszman M (2003) The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text. J Biomed Inform 36(6):462–477PubMedCrossRefGoogle Scholar
  13. 13.
    Rindflesch TC, Libbus B, Hristovski D, Aronson AR, Kilicoglu H (2003) Semantic relations asserting the etiology of genetic diseases. In: AMIA annual symposium, 2003, pp 554–558Google Scholar
  14. 14.
    Fiszman M, Rindflesch TC, Kilicoglu H (2004) Abstraction summarization for managing the biomedical research literature. In: Workshop on Computational Lexical Semantics (HLT-NAACL), 2004, pp 76–83Google Scholar
  15. 15.
    Dunn CM, Chadwick GL (2004) Protecting study volunteers in research: a manual for investigative sites, 3rd edn. Thomson Centerwatch Inc, BostonGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.School of Information Systems and TechnologyClaremont Graduate UniversityClaremontUSA

Personalised recommendations