Advertisement

Methodological Challenges in HAMMLAB

  • Gyrd SkraaningJr.
  • Maren Helene Rø Eitrheim
Conference paper

Abstract

Classical experimental methods have to be adjusted and expanded to serve the simulator studies in HAMMLAB. Experiences from this methodological development process are presented in this chapter, focusing on insights from experimental design and human performance measurement.

Keywords

Task Performance Human Performance Situation Awareness Presentation Order Mental Workload 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. American Institute of Aeronautics and Astronautics (1992) Guide to human performance measurement (AIAA Publication No G-035-1992). AIAA, Washington, DCGoogle Scholar
  2. Andresen G, Drøivoldsmo A (2000) Human performance assessment: methods and measures (HPR-353). OECD Halden Reactor Project, HaldenGoogle Scholar
  3. Andresen G, Strand S (2007) Usability questionnaires and human system interface evaluations: review of standardize questionnaires and lessons learned from HAMMLAB (HWR-856). OECD Halden Reactor Project, HaldenGoogle Scholar
  4. Andresen G, Svengren H, Heimdal J, Nilsen S, Hulsund JE, Bisio R, Debroise X (2004) Procedure automation: the effect of automated procedure execution on situation awareness and human performance (HWR-759). OECD Halden Reactor Project, HaldenGoogle Scholar
  5. Baker S, Hollnagel E, Marshall E, Øwre F (1985a) An experimental comparison of three computer based alarm systems: design, procedure and execution (HWR-134). OECD Halden Reactor Project, HaldenGoogle Scholar
  6. Baker S, Gertman D, Hollnagel E, Holmstrøm C, Marshall E, Øwre F (1985b) An experimental comparison of three computer-based alarm systems—results and conclusions (HWR-142). OECD Halden Reactor Project, HaldenGoogle Scholar
  7. Braarud PØ (1998) Complexity factors and prediction of crew performance (HWR-521). OECD Halden Reactor Project, HaldenGoogle Scholar
  8. Braarud PØ (2000) Subjective task complexity in the control room (HWR-621). OECD Halden Reactor Project, HaldenGoogle Scholar
  9. Braarud PØ, Brendryen H (2001) Task demand, task management, and teamwork (HWR-657). OECD Halden Reactor Project, HaldenGoogle Scholar
  10. Braarud PØ, Ludvigsen JT (2002) Experimental study of the effect of task priority and coordination strategy on crew performance (HWR-704). OECD Halden Reactor Project, HaldenGoogle Scholar
  11. Bye A, Laumann K, Braarud P, Massaiu S (2006) Methodology for improving HRA by simulator studies. In: PSAM8, proceedings of the 8th international conference on probabilistic safety assessment and management, New Orleans, Louisiana, pp 205–209Google Scholar
  12. Collier S (1998) Development of a diagnostic complexity questionnaire (HWR-536). OECD Halden Reactor Project, HaldenGoogle Scholar
  13. Collier S, Andresen G (2000) A second study of the prediction of cognitive errors using the “CREAM” technique (HWR-625). OECD Halden Reactor Project, HaldenGoogle Scholar
  14. Cook TD, Campbell DT (1979) Quasi-experimentation: design and analysis issues for field settings. Rand McNally, ChicagoGoogle Scholar
  15. Cronbach LJ (1990) Essentials of psychological testing, 5th edn. HarperCollins, New YorkGoogle Scholar
  16. Drøivoldsmo A, Skraaning G, Sverrbo M, Dalen J, Grimstad T, Andresen G (1998) Continuous measures of situation awareness and workload (HWR-539). OECD Halden Reactor Project, HaldenGoogle Scholar
  17. Drury C (1992) Do speed and accuracy trade off? In: Proceedings of the 28th annual conference on unlocking the potential for the future productivity and quality of life, Melbourne, AustraliaGoogle Scholar
  18. Follesø K, Volden FS (1993) Lessons learned on test and evaluation from test and evaluation activities performed at the OECD Halden reactor project (HWR-336). OECD Halden Reactor Project, HaldenGoogle Scholar
  19. Follesø K, Drøivoldsmo A, Kaarstad M, Collier S, Kirwan B (1995) Human error—the third pilot study (HWR-430). OECD Halden Reactor Project, HaldenGoogle Scholar
  20. Follesø K, Kaarstad M, Drøivoldsmo A, Hollnagel E, Kirwan B (1996) Practical insights from initial studies related to the Human Error Analysis Project (HEAP) (HWR-459). OECD Halden Reactor Project, HaldenGoogle Scholar
  21. Grimstad T, Andresen G, Skjerve AB (2000) Human-centred automation programme: review of experiment related studies (HWR-628). OECD Halden Reactor Project, HaldenGoogle Scholar
  22. Heidegger M (1926) Being and time. Blackwell, OxfordGoogle Scholar
  23. Hogg DN, Follesø K, Torralba B, Volden FS (1994) Measurement of the operator’s situation awareness for use within process control research: four methodological studies (HWR-377). OECD Halden Reactor Project, HaldenGoogle Scholar
  24. Hopkin VD (1995) Human factors in air traffic control. Taylor & Francis, LondonGoogle Scholar
  25. Howell DC (1997) Statistical methods for psychology, 4th edn. Wadsworth, CAGoogle Scholar
  26. Jones JL (1995) Understanding psychological science. HarperCollins, New YorkGoogle Scholar
  27. Kaarstad M, Andresen A (2001) Performance recovery and goal conflict (HWR-653). OECD Halden Reactor Project, HaldenGoogle Scholar
  28. Kaarstad M, Kirwan B, Follesø K, Endestad T, Torralba B (1994) Human error—the first pilot study (HWR-417). OECD Halden Reactor Project, HaldenGoogle Scholar
  29. Kaarstad M, Follesø K, Collier S, Hauland G, Kirwan B (1995) Human error—the second pilot study (HWR-421). OECD Halden Reactor Project, HaldenGoogle Scholar
  30. Kaarstad M, Hollnagel E, Lee H (1998) Human error analysis project (HEAP)—report from main experiment (HWR-540). OECD Halden Reactor Project, HaldenGoogle Scholar
  31. Kirk RE (1995) Experimental design: procedures for the behavioral sciences, 3rd edn. Brooks Cole, Pacific GroveMATHGoogle Scholar
  32. Laumann K, Braarud PØ, Svengren H (2005) The task complexity experiment 2003/04 (HWR-758). OECD Halden Reactor Project, HaldenGoogle Scholar
  33. Massaiu S, Skjerve AB, Skraaning G, Strand S, Wærø I (2004) Studying human-automation interactions: methodological lessons learned from the human-centred automation experiments 1997–2001 HWR-760). OECD Halden Reactor Project, HaldenGoogle Scholar
  34. Montgomery DC (1997) Design and analysis of experiments. Wiley, New YorkMATHGoogle Scholar
  35. Moracho MJ (1998) Plant performance assessment system (PPAS) for crew performance evaluations. Lessons learned from an alarm study conducted in HAMMLAB (HWR-504). OECD Halden Reactor Project, HaldenGoogle Scholar
  36. Murphy KR, Davidshofer CO (1991) Psychological testing: principles and applications. Englewood Cliffs, Prentice-HallGoogle Scholar
  37. Neale JM, Liebert RM (1986) Science and behavior: an introduction to methods of research. Englewood Cliffs, Prentice-HallGoogle Scholar
  38. O’Hara JM, Brown WS, Hallbert B, Skraaning G, Persensky JJ, Wachtel J (2000) The effects of alarm display, processing and availability on crew performance (NUREG/CR-6691). US Nuclear Regulatory CommissionGoogle Scholar
  39. Parkes JT (1998) Reducing task-related variance in performance assessment using concept maps. Thesis in educational psychology. Pennsylvania State University, USAGoogle Scholar
  40. Rasmussen J (1987) Reasons, causes, and human error. In: Rasmussen J, Duncan K, Leplat J (eds) New technology and human error. Wiley, ChichesterGoogle Scholar
  41. Rouse WB, Cannon-Bowers JA, Salas E (1992) The role of mental models in team performance in complex systems. IEEE Trans Syst Man Cybern 22(6):1296–1308CrossRefGoogle Scholar
  42. Skjerve AB (2002) The Halden co-operation scale. Human-automation co-operation in control room settings (HWR-685). OECD Halden Reactor Project, HaldenGoogle Scholar
  43. Skjerve AB, Skraaning G (2004) The Quality of human-automation cooperation in human-system interface for nuclear power plants. Int J Hum Comput Stud 61:649–677CrossRefGoogle Scholar
  44. Skjerve AB, Andresen G, Saarni R, Skraaning G (2001a) The influence of automation malfunctions on operator performance. Study plan for the human-centred automation 2000 experiment (HWR-659). OECD Halden Reactor Project, HaldenGoogle Scholar
  45. Skjerve AB, Andresen G, Saarni R, Skraaning G, Brevig L (2001b) Human-centred automation 2000 experiment. Preliminary results (HWR-660). OECD Halden Reactor Project, HaldenGoogle Scholar
  46. Skjerve AB, Strand S, Saarni R, Skraaning G (2002) The influence of automation malfunctions and interface design on operator performance. The HCA-2001 experiment (HWR-686). OECD Halden Reactor Project, HaldenGoogle Scholar
  47. Skjerve AB, Strand S, Skraaning G, Nihlwing C, Helgar S, Olsen A, Kvilesjø HØ, Meyer G, Drøivoldsmo A, Svengren H (2005a) The extended teamwork 2004/2005 exploratory study. Study plan (HWR-791). OECD Halden Reactor Project, HaldenGoogle Scholar
  48. Skjerve AB, Strand S, Skraaning G, Nihlwing C (2005b) The extended teamwork 2004/2005 exploratory study. Preliminary results (HWR-812). OECD Halden Reactor Project, HaldenGoogle Scholar
  49. Skraaning G (1998) The operator performance assessment system (OPAS) (HWR-538). OECD Halden Reactor Project, HaldenGoogle Scholar
  50. Skraaning G (2003) Experimental control versus realism: methodological solutions for simulator studies in complex operating environments (HPR-361). OECD Halden Reactor Project, Dr. philos. dissertation NTNU, Trondheim, Norway Human Performance. OECD Halden Reactor Project, HaldenGoogle Scholar
  51. Skraaning G, Lau N, Welch R, Nihlwing C, Andresen G, Brevig LH, Veland Ø, Jamieson G, Burns CM, Kwok J (2007) The ecological interface design experiment (2005) (HWR-833). OECD Halden Reactor Project, HaldenGoogle Scholar
  52. Stanton N (1996) Simulators: a review of research and practice. In: Stanton N (ed) Human factors in nuclear safety. Taylor & Francis, LondonCrossRefGoogle Scholar
  53. Strand S (2001) Trust and automation: the influence of automation malfunctions and system feedback on operator trust (HWR-643). OECD Halden Reactor Project, HaldenGoogle Scholar
  54. Wioland L, Kaarstad M, Skraaning G (2000) Error detection and recovery—results from experiment 1997 (HWR-622). OECD Halden Reactor Project, HaldenGoogle Scholar

Copyright information

© Springer-Verlag London Limited  2010

Authors and Affiliations

  1. 1.OECD Halden Reactor ProjectInstitutt for EnergiteknikkHaldenNorway

Personalised recommendations