Journal of Clinical Monitoring and Computing

, Volume 20, Issue 1, pp 47–55 | Cite as

Factors Affecting Reliability of Interpretations of Intra-Operative Evoked Potentials

  • Mark M. Stecker
  • Jennifer Robertshaw


Objective. There are two objectives of this study. The first is to understand how practitioners of differing backgrounds approach the process of interpreting intra-operative neurophysiologic monitoring. The second is to understand whether the experience and educational background of practitioners influences the degree of agreement in their interpretations. Methods. A survey was distributed at the 2004 American Society of Neurophysiological Monitoring meeting. A total of 92 responses were obtained. The effect that various characteristics of the respondents including their experience, degree, certification and role in monitoring had on a number of outcome measures was assessed. These outcome measures included the probability that the surgeon responded to a warning, the chance that the patient would wake without a deficit after a warning was delivered, and the degree to which respondents agreed on interpretations of SSEP traces. Results. It was found that surgeons were more likely to respond to warnings issued by a monitrist with a higher degree of experience. Respondents with higher levels of experience, certification level, and degree level were more likely to agree on interpretations of evoked potential tracings. Overall, however, the degree of agreement between respondents was at most moderate. Respondents with higher levels of experience and training were more likely to provide correct answers to a subset of traces that were designed to reflect a classic pattern of change. Conclusions. This study indicates the need for additional studies on the criteria for providing warnings during IOM and the characteristics of monitrists that influence their interpretations.


Reliability evoked potentials intra-operative monitoring survey inter-observer agreement 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Moller AR. Evoked Potentials in Intraoperative Monitoring. Baltimore:Williams and Wilkins, 1987.Google Scholar
  2. 2.
    Deletis V. and Shils JL. Neurophysiology in Neurosurgery. New York:Academic Press, 2002.Google Scholar
  3. 3.
    Nuwer MR, Dawson EG, Carlson LG, Kanim LE, Sherman JE. Somatosensory evoked potential spinal cord monitoring reduces neurologic deficits after scoliosis surgery: results of a large multicenter survey. ElectroencephalogrClin Neurophysiol. 1995; 96: 6–11.CrossRefGoogle Scholar
  4. 4.
    Dixon WJ. BMDP Statistical Software Manual. Berkley: University ofCalifornia Press, 1992.Google Scholar
  5. 5.
    Beauchamp K, Baker S, McDaniel C, Moser W, Zalman DC, Balinghoff J,Cheung AT, Stecker M. Reliability of Nursing Neurologic Assessments in the CardiacIntensive Care Unit. American Journal of Critical Care 2001; 10: 298–305.PubMedGoogle Scholar
  6. 6.
    Carmines EG and Zeller RA. Reliability and Validity Assessment. ThousandOaks: Sage, 1979.Google Scholar
  7. 7.
    Fisher LD and Van Belle G. Biostatistics. New York: John Wiley,1993; 256–259.Google Scholar
  8. 8.
    Anonymous. American society of electroneurodiagnostic technologists, inc. position statement: electroneurodiagnostic technologists in the operatingroom. Am J End Technol 1987; 37: 67–88.Google Scholar
  9. 9.
    Thompson B. Understanding reliability and coefficient alpha, really. In:Thompson B, ed. Score Reliability. Thousand Oaks: Sage, 2003; 3–23.Google Scholar

Copyright information

© Springer Science+Business Media, Inc. 2006

Authors and Affiliations

  1. 1.Department of NeurologyGeisinger Medical CenterDanvilleUSA
  2. 2.Department of NeurologyGeisinger Medical CenterDanvilleUSA

Personalised recommendations