Factors Affecting Reliability of Interpretations of Intra-Operative Evoked Potentials
- 84 Downloads
Objective. There are two objectives of this study. The first is to understand how practitioners of differing backgrounds approach the process of interpreting intra-operative neurophysiologic monitoring. The second is to understand whether the experience and educational background of practitioners influences the degree of agreement in their interpretations. Methods. A survey was distributed at the 2004 American Society of Neurophysiological Monitoring meeting. A total of 92 responses were obtained. The effect that various characteristics of the respondents including their experience, degree, certification and role in monitoring had on a number of outcome measures was assessed. These outcome measures included the probability that the surgeon responded to a warning, the chance that the patient would wake without a deficit after a warning was delivered, and the degree to which respondents agreed on interpretations of SSEP traces. Results. It was found that surgeons were more likely to respond to warnings issued by a monitrist with a higher degree of experience. Respondents with higher levels of experience, certification level, and degree level were more likely to agree on interpretations of evoked potential tracings. Overall, however, the degree of agreement between respondents was at most moderate. Respondents with higher levels of experience and training were more likely to provide correct answers to a subset of traces that were designed to reflect a classic pattern of change. Conclusions. This study indicates the need for additional studies on the criteria for providing warnings during IOM and the characteristics of monitrists that influence their interpretations.
KeywordsReliability evoked potentials intra-operative monitoring survey inter-observer agreement
Unable to display preview. Download preview PDF.
- 1.Moller AR. Evoked Potentials in Intraoperative Monitoring. Baltimore:Williams and Wilkins, 1987.Google Scholar
- 2.Deletis V. and Shils JL. Neurophysiology in Neurosurgery. New York:Academic Press, 2002.Google Scholar
- 4.Dixon WJ. BMDP Statistical Software Manual. Berkley: University ofCalifornia Press, 1992.Google Scholar
- 6.Carmines EG and Zeller RA. Reliability and Validity Assessment. ThousandOaks: Sage, 1979.Google Scholar
- 7.Fisher LD and Van Belle G. Biostatistics. New York: John Wiley,1993; 256–259.Google Scholar
- 8.Anonymous. American society of electroneurodiagnostic technologists, inc. position statement: electroneurodiagnostic technologists in the operatingroom. Am J End Technol 1987; 37: 67–88.Google Scholar
- 9.Thompson B. Understanding reliability and coefficient alpha, really. In:Thompson B, ed. Score Reliability. Thousand Oaks: Sage, 2003; 3–23.Google Scholar