DNA — Uncorking the Bottleneck in Knowledge Elicitation and Organization

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1452)


There are two main purposes of this paper. First, we describe a novel cognitive tool that was designed to aid in knowledge elicitation and organization for instructional purposes — specifically to be used for intelligent tutoring system development. This automated approach to knowledge elicitation is embodied in a program called DNA (Decompose, Network, Assess). Our aim for this tool is to increase the efficiency of developing the expert model — often referred to as the bottleneck in developing intelligent instructional systems. The second purpose is to present a first-order summative evaluation of the tool’s efficacy. Specifically, we used DNA with three statistical experts to explicate their knowledge structures related to measures of central tendency. In short, we found that DNA can be used as a standalone program to effectively elicit relevant information on which to build instruction. This was achieved in hours compared to months for conventional elicitation procedures.


Knowledge Structure Central Tendency Conceptual Knowledge Intelligent Tutoring System Expert Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Polson, M. C., & Richardson, J. J.: Foundations of Intelligent Tutoring Systems. Lawrence Erlbaum Associates, New Jersey (1988)Google Scholar
  2. 2.
    Shute, V. J., & Psotka, J.: Intelligent Tutoring Systems: Past, Present, and Future. In: Jonassen, D. (ed.): Handbook of Research on Educational Communications and Technology: A project of the Association for Educational Communication. Macmillan, New York (1996) 570–600Google Scholar
  3. 3.
    Anderson, J. R.: The Expert Module. In: Polson, M. C., Richardson, J. J. (eds.): Foundations of Intelligent Tutoring Systems. Lawrence Erlbaum Associates New Jersey (1988) 21–50Google Scholar
  4. 4.
    Shute, V. J., Torreano, L. A., & Willis, R. E.: Cognitive Task Analysis: Towards an Automated, Powerful Tool. In: Lajoie, S. (ed.): Computers as Cognitive Tools, Vol. 2. Lawrence Erlbaum Associates, New Jersey (in press)Google Scholar
  5. 5.
    Ryder, J. M., & Redding, R. E.: Integrating Cognitive Task Analysis Into Instructional Systems Development. Educational Technology Research and Development 41 (1993) 75–96CrossRefGoogle Scholar
  6. 6.
    Nisbett, R. E., & Wilson, T. D.: Telling More Than We Can Know: Verbal Reports on Mental Processes. Psychological Review 8 (1977) 231–259CrossRefGoogle Scholar
  7. 7.
    Card, S., Moran, T. P., & Newell, A.: The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates New Jersey (1983)Google Scholar
  8. 8.
    Shraagen, J. M. C., Chipman, S. E., Shute, V. J., Annett, J., Strub, M., Sheppard, C., Ruisseau, J. Y., & Graff, N.: State-of-the-Art Review of Cognitive Task Analysis Techniques. Deliverable Report of RSG.27 on Cognitive Task Analysis NATO Defense Research Group (Panel 8/RSG.27). TNO Human Factors Research Institute Group: Information Processing (1997)Google Scholar
  9. 9.
    Williams, K. E.: The Development of an Automated Cognitive Task Analysis and Modeling Process for Intelligent Tutoring System Development. Contract final report on N00014-97-J-5-1500. Manpower Personnel and Training Program, Office of Naval Research (1993)Google Scholar
  10. 10.
    Gordon, S. E., Schmierer, K. A., & Gill, R. T.: Conceptual Graph Analysis: Knowledge Acquisition For Instructional System Design. Human Factors 35 (1993) 459–481Google Scholar
  11. 11.
    Shute, V. J., Gawlick, L. A., & Lefort, N. K.: Stat Lady [Unpublished computer program]. Brooks Air Force Base, TX: Armstrong Laboratory (1996)Google Scholar
  12. 12.
    Shute, V. J.: SMART: Student modeling approach for responsive tutoring. User Modeling and User-Adapted Interaction 5 (1995) 1–44CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  1. 1.Air Force Research Laboratory (AFRL)Lackland AFB
  2. 2.National Research Council AssociateLackland AFB
  3. 3.Galaxy Scientific, Corp.Lackland AFB

Personalised recommendations