Defining Human-Centered System Issues for Verifying and Validating Air Traffic Control Systems

  • Kelly Harwood
Part of the NATO ASI Series book series (volume 110)


Over the past 40 years, the application of automation to the U.S. air traffic control (ATC) system has grown enormously to meet significant increases in air traffic volume. The next ten years will witness a dramatic overhaul of computer hardware and software in enroute and terminal facilities to accommodate future growth in air traffic activities. From a human factors perspective, notable changes are the new controller workstations or sector-suites which will provide such new features as adjustable consoles, graphic situation displays, and electronic flight strips. This modernization will provide the basis for introducing automated functions that will transition the controller from tactical control to strategic traffic management. The U.S. Federal Aviation Administration (FAA) recognizes the importance of an effective human-system interface to successful operations (Kloster & Zellweger, 1987). Because various phases of test and evaluation are just around the corner for these new system upgrades, questions arise concerning what aspects of the human-system component must be addressed to verify system safety and efficiency. Such questions are not trivial. They strike at the heart of the “omnipresent criterion problem” (Christensen, 1958), that is, the difficulty of defining criterion measures for verifying and validating complex systems.


Traffic Management Technical Usability Federal Aviation Administration Domain Suitability User Acceptability 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. ATC Systems Field Office. (1992). Traffic Management Advisor (TMA) Reference Manual. Moffett Field, CA: NASA-Ames Research Center.Google Scholar
  2. Billings, C. E. (1992). Human-Centered Aircraft Automation: A Concept and Guidelines. NASA Technical Memorandum 103885. Moffett Field, CA: NASA-Ames Research Center.Google Scholar
  3. Boff, K. R., and Lincoln, J. E. (Eds.). (1988). Engineering Data Compendium. Wright Patterson Air Force Base, OH: Harry G. Armstrong Aerospace Medical Research Laboratory.Google Scholar
  4. Brooks, F. P., Jr. (1987). No silver bullet: Essence and accidents of software engineering. Computer, pp. 10–19.Google Scholar
  5. Christensen, J. M. (1958). Trends in human factors. Human Factors, 1, 2–7.Google Scholar
  6. Davis, T. J., Erzberger, H., and Green, S. M. (1991). Design and evaluation of air traffic control final approach spacing tool. NASA Technical Memorandum 10287. Moffett Field, CA: NASA-Ames Research Center.Google Scholar
  7. Department of Defence. (1989). Military Standard: Human Engineering Design Criteria for Military Systems, Equipment, and Facilities. (MIL-STD-1472D). Washington, DC: Department of Defence.Google Scholar
  8. Erzberger, H., and Nedell, W. (1989). Design of Automated Systems for Management of Arrival Traffic. (NASA Technical Memorandum 102201 ). Moffett Field, CA: NASA-Ames Research Center.Google Scholar
  9. Federal Aviation Administration. (1989). FAA NAS Test and Evaluation Program. (ORDER No. 1810. 4A ). Washington, DC: Federal Aviation Administration.Google Scholar
  10. Federal Aviation Administration. (1990). The National Plan for Aviation Human Factors (Draft). Washington, DC: Federal Aviation Administration.Google Scholar
  11. Fitts, P. M. (Ed.). (1951). Human Engineering for an Effective Air-Navigation and Traffic Control System. Washington, DC: National Research Council.Google Scholar
  12. Gould, J. D. (1988). How to design usable systems. In M. Helander (Ed.), Handbook of Human-Computer Interaction. (pp. 757–789 ). New York: Elsevier Science.Google Scholar
  13. Hollnagel, E., and Woods, D. D. (1983). Cognitive systems engineering: new wine in new bottles. International Journal of Man-Machine Systems, 18, 583–600.CrossRefGoogle Scholar
  14. Hopkin, V. D. (1980). The measurement of the air traffic controller. Human Factors, 22, 547–560.Google Scholar
  15. Hopkin, V. D. (1991). Automated flight strip usage: Lessons from the functions of paper strips. In Challenges in Aviation Human Factors: The National Plan, Book of Abstracts (pp. 62–64 ). Washington, DC: AIAA.Google Scholar
  16. Hopkin, V. D. (1992). Human factors issues in air traffic control Human Factors Society Bulletin, 35. Santa Monica, CA: Human Factors Society.Google Scholar
  17. Hunt, V. R., and Zellweger, A. (1987). The FAA’s advanced automation system: Strategies for future air traffic control systems, Computer, 20, pp. 19–32.CrossRefGoogle Scholar
  18. Hutchins, E. (1991). How a Cockpit Remembers its Speed. Technical Report, Distributed Cognition Laboratory, University of California at San Diego.Google Scholar
  19. Johnson, A., and Johnson, O. R. (1990). Quality and quantity: On the measurement potential of ethnographic fieldnotes. In R. Sanjek (Ed.), Fieldnotes: The Making of Anthropology (pp. 161–186 ). Ithaca, NY: Cornell University Press.Google Scholar
  20. Kloster, G. V., and Zellweger, A. (1987). Engineering the man-machine interface for Air Traffic Control. Computer, 20, pp. 47–62.CrossRefGoogle Scholar
  21. Meister, D. (1985). Behavioral Analysis and Measurement Methods. New York, NY: John Wiley and SonsGoogle Scholar
  22. Norman, D. A., and Draper, S. W. (1986). User-Centered System Design: New Perspectives on Human Computer Interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
  23. Parsons, M. (1972). Man Machine System Experiments. Baltimore, MD: The Johns Hopkins Press.Google Scholar
  24. Rasmussen, J. (1985). The role of hierarchical knowledge representation in decision making and system management. IEEE Transaction on Systems, Man, and Cybernetics, 15, 234–243.CrossRefGoogle Scholar
  25. Rasmussen, J. (1986). Information processing and Human-Machine Interaction: An Approach to Cognitive Engineering. Amsterdam. North-Holland.Google Scholar
  26. Rasmussen, J., and Goodstein, L. P. (1988). Information technology and work. In M. Helander (Ed.), Handbook of Human-Computer Interaction. (pp. 175–201 ). New York: Elsevier Science Publishers BV (North Holland).Google Scholar
  27. Rasmussen, J., and Lind, M. (1981). Coping with complexity. In H. G. Stassen (Ed.), First Annual European Conference on Human Decision-Making and Manual Control. (pp. 70–91 ). New York: Plenum Press.Google Scholar
  28. Sanjek, R. (1990). The secret life of fieldnotes. In R. Sanjek (Ed.), Fieldnotes: The Making of Anthropology. (pp. 187–270 ). Ithaca, NY: Cornell University Press.Google Scholar
  29. Shneiderman, B. (1987). Designing for the User Interface. Reading, MA: Addison-Wesley.Google Scholar
  30. Smith, S. L., and Mosier, J. N. (1986). Guidelines for designing user interface software. (Technical Report NTIS No. A177 198 ). Hanscom Air Force Base, MA: USAF Electronic Systems Division.Google Scholar
  31. Suchman, L. A. (1987). Plans, and Situated Actions: The Problem of Human Machine Communication. Cambridge, MA: Cambridge University Press.Google Scholar
  32. Suchman, L. A., and Trigg, R. H. (1991). Understanding practice: Video as a medium in reflection and design. In J. Greenbaum and M. Kyng (Eds.), Design at Work (pp. 65–89 ). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
  33. Tobias, L., Volckers, U., and Erzberger, H. (1989). Controller evaluations of the descent advisor automation aid. Proceedings of the AIAA Guidance, Navigation, and Control Conference. (pp. 1609–1618 ). Washington, DC: AIAA.Google Scholar
  34. Van Cott, H. P., and Kincaid, R. G. (1972). Human Engineering Guide to Equipment Design. Washington, DC: U.S. Government Printing Office.Google Scholar
  35. Whiteside, J., Bennet, J., and Holtzblatt, K. (1988). Usability engineering: Our experience and evolution. In M. Helander (Ed.), Handbook of Human-Computer Interaction (pp. 791–817 ). New York: Elsevier Science Publishers BV (North Holland).Google Scholar
  36. Whitfield, D., and Stammers, R. B. (1978). The air traffic controller. In W. T. Singleton (Ed.), The Study of Real Skills: Volume 1 The Analysis of Practical Skills. (pp. 209–235 ). Lancaster, U.K.: MTP Press.CrossRefGoogle Scholar
  37. Wickens, C. D. (1992). Engineering Psychology and Human Performance, Second Edition. New York: Harper Collins Publishers.Google Scholar
  38. Woods, D. D., and Hollnagel, E. (1987). Mapping cognitive demands in complex problem-solving worlds. International Journal of Man-Machine Systems, 26, 257–275.CrossRefGoogle Scholar
  39. Woods, D. D. (1988). Coping with complexity: The psychology of human behavior in complex systems. In L. P. Goodstein, H. B. Andersen, and S. E. Olsen (Eds.), Tasks, Errors and Mental Models. (pp. 128–148 ). London: Taylor Francis.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • Kelly Harwood
    • 1
  1. 1.CTA IncorporatedMoffett FieldUSA

Personalised recommendations