Skip to main content

Advertisement

SpringerLink
Log in

Inter-scorer reliability of sleep assessment using EEG and EOG recording system in comparison to polysomnography

  • Original Article
  • Published:
Sleep and Biological Rhythms Aims and scope Submit manuscript

Abstract

There are increasing needs for self-applicable methods assessing sleep in clinical and non-clinical settings. This study aimed to investigate the inter-scorer reliability for the sleep stage scoring and for the sleep variable assessments in the portable electroencephalography (EEG) and electro-oculography (EOG) recording system. Sleep recordings were performed simultaneously with polysomnography (PSG) and portable EEG/EOG recordings in 14 healthy adults. The inter-scorer concordance of the sleep stage scoring was assessed in the two recording methods. Sleep variables were compared between the two methods using the Bland–Altman plots in each scorer. The overall inter-scorer concordance rate of sleep stage scoring for the EEG/EOG data was 85.5 %, and the Cohen’s κ was 0.80 (p < 0.001), being equivalent to those for the PSG data (89.2 %, 0.85, p < 0.001) while that for StageN1 was relatively low (EEG/EOG 60.1 %, PSG 71.7 %). In both scorers, Bland–Altman plots showed that the mean difference between sleep variables obtained from the two systems was within the acceptable range although the inter-class correlations between the two systems were lower for StageN2 or StageR in either scorer. Although the results suggest that the sufficient inter-scorer reliability can be obtained with the EEG/EOG recording system based on manual sleep stage scoring in healthy young adults, the nature of the EEG/EOG recording system can influence the precisions in manually assessing sleep architectures in comparison to PSG.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Cappuccio FP, D’Elia L, Strazzullo P, Miller MA. Sleep duration and all-cause mortality: a systematic review and meta-analysis of prospective studies. Sleep. 2010;33:585–92.

    PubMed  PubMed Central  Google Scholar 

  2. Devine EB, Hakim Z, Green J. A systematic review of patient-reported outcome instruments measuring sleep dysfunction in adults. Pharmacoeconomics. 2005;23:889–912.

    Article  Google Scholar 

  3. Kushida CA, Littner MR, Morgenthaler T, Alessi CA, Bailey D, Coleman Jr J, Friedman L, Hirshkowitz M, Kapen S, Kramer M, Lee-Chiong T, Loube DL, Owens J, Pancer JP, Wise M. Practice parameters for the indications for polysomnography and related procedures: an update for 2005. Sleep. 2005;28:499–521.

    PubMed  Google Scholar 

  4. Morgenthaler T, Alessi C, Friedman L, Owens J, Kapur V, Boehlecke B, Brown T, Chesson Jr A, Coleman J, Lee-Chiong T, Pancer J, Swick TJ. Practice parameters for the use of actigraphy in the assessment of sleep and sleep disorders: an update for 2007. Sleep. 2007;30:519–29.

    PubMed  Google Scholar 

  5. Rechtschaffen A, Kales A. A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects. Los Angeles: University of California, Brain Information Service/ Brain Research Institute; 1968.

    Google Scholar 

  6. Indications for polysomnography task force, American sleep disorders association standards of practice committee. Practice parameters for the indications for polysomnography and related procedures. Sleep. 1997;20:406–22.

    Google Scholar 

  7. Shambroom JR, Fábregas SE, Johnstone J. Validation of an automated wireless system to monitor sleep in healthy adults. J Sleep Res. 2012;21:221–30. doi:10.1111/j.1365-2869.2011.00944.x.

    Article  PubMed  Google Scholar 

  8. Kaplan RF, Wang Y, Loparo KA, Kelly MR, Bootzin RR. Performance evaluation of an automated single-channel sleep-wake detection algorithm. Nat Sci Sleep. 2014;6:113–22. doi:10.2147/NSS.S71159.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Voinescu BI, Wislowska M, Schabus M. Assessment of SOMNOwatch plus EEG for sleep monitoring in healthy individuals. Physiol Behav. 2014;132:73–8. doi:10.1016/j.physbeh.2014.04.052.

    Article  CAS  PubMed  Google Scholar 

  10. Van de Water AT, Holmes A, Hurley DA. Objective measurements of sleep for non-laboratory settings as alternatives to polysomnography—a systematic review. J Sleep Res. 2011;20:183–200. doi:10.1111/j.1365-2869.2009.00814.x.

    Article  PubMed  Google Scholar 

  11. Berthomier C, Drouot X, Herman-Stoïca M, Berthomier P, Pra-do J, Bokar-Thire D, Benoit O, Mattout J, d’Ortho MP. Automatic analysis of single-channel sleep EEG: validation in healthy individuals. Sleep. 2007;30:1587–95.

    PubMed  PubMed Central  Google Scholar 

  12. Tonetti L, Cellini N, De Zambotti M, Fabbri M, Martoni M, Fabregas S, Stegagno L, Natale V. Polysomnographic validation of a wireless dry headband technology for sleep monitoring in healthy young adults. Physiol Behav. 2013;118:185–8. doi:10.1016/j.physbeh.2013.05.036.

    Article  CAS  PubMed  Google Scholar 

  13. Griessenberger H, Heib DPJ, Kunz AB, Hoedlmoser K, Schabus M. Assessment of a wireless headband for automatic sleep scoring. Sleep Breath. 2013;17:747–52. doi:10.1007/s11325-012-0757-4.

    Article  CAS  PubMed  Google Scholar 

  14. Markwald RR, Bessman SC, Reini SA, Drummond SP. Performance of a portable sleep monitoring device in individuals with high versus low sleep efficiency. J Clin Sleep Med. 2016;12:95–103. doi:10.5664/jcsm.5404.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Berry RB, Brooks R, Gamaldo CE, Harding SM, Lloyd RM, Marcus CL, Vaughn BV, The American Academy of Sleep Medicine. The AASM manual for the scoring of sleep and associated events: rules, terminology and technical specifications, Version 2.1. Darien: Illinois: American Academy of Sleep Medicine; 2014.

  16. Kemp B, Varri A, Rosa AC, Nielson KD, Gade J. A simple format for exchange of digitized polygraphic recordings. Electroencephalogr Clin Neurophysiol. 1992;82:391–3.

    Article  CAS  PubMed  Google Scholar 

  17. Adrian ED, Matthews BHC. The Berger rhythm potential changes from the occipital lobes in man. Brain. 1934;57:355–85.

    Article  Google Scholar 

  18. Marzano C, Moroni F, Gorgoni M, Nobili L, Ferrara M, De Gennaro L. How we fall asleep: regional and temporal differences in electroencephalographic synchronization at sleep onset. Sleep Med. 2013;14:1112–22. doi:10.1016/j.sleep.2013.05.021.

    Article  PubMed  Google Scholar 

  19. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.

    Article  CAS  PubMed  Google Scholar 

  20. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  21. De Gennaro L, Ferrara M, Bertini M. Topographical distribution of spindles: variations between and within NREM sleep cycles. Sleep Res Online. 2000;3:155–60.

    Article  CAS  PubMed  Google Scholar 

  22. McCormick L, Nielsen T, Nicolas A, Ptito M, Montplaisir J. Topographical distribution of spindles and K-complexes in normal subjects. Sleep. 1997;20:939–41.

    CAS  PubMed  Google Scholar 

  23. Dehghani N, Cash SS, Halgren E. Topographical frequency dynamics within EEG and MEG sleep spindles. Clin Neurophysiol. 2011;122:229–35. doi:10.1016/j.clinph.2010.06.018.

    Article  PubMed  Google Scholar 

  24. Happe S, Anderer P, Gruber G, Klosch G, Saletu B, Zeitlhofer J. Scalp topography of the spontaneous K-complex and of delta-waves in human sleep. Brain Topogr. 2002;15:43–9.

    Article  PubMed  Google Scholar 

  25. Werth E, Achermann P, Borbely AA. Fronto-occipital EEG power gradients in human sleep. J Sleep Res. 1997;6:102–12.

    Article  CAS  PubMed  Google Scholar 

  26. Danker-Hopfe H, Anderer P, Zeitlhofer J, Boeck M, Dorn H, Gruber G, Heller E, Loretz E, Moser D, Parapatics S, Saletu B, Schmidt A, Dorffner G. Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard. J Sleep Res. 2009;18:74–84. doi:10.1111/j.1365-2869.2008.00700.x.

    Article  PubMed  Google Scholar 

  27. Rosenberg RS, Van Hout S. The American Academy of Sleep Medicine inter-scorer reliability program: sleep stage scoring. J Clin Sleep Med. 2013;9:81–7. doi:10.5664/jcsm.2350.

    PubMed  PubMed Central  Google Scholar 

  28. Danker-Hopfe H, Kunz D, Gruber G, Klösch G, Lorenzo JL, Himanen SL, Kemp B, Penzel T, Röschke J, Dorn H, Schlögl A, Trenker E, Dorffner G. Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders. J Sleep Res. 2004;13:63–9.

    Article  PubMed  Google Scholar 

  29. Ruehland WR, O’Donoghue FJ, Pierce RJ, Thornton AT, Singh P, Copland JM, Stevens B, Rochford PD. The 2007 AASM recommendations for EEG electrode placement in polysomnography: impact on sleep and cortical arousal scoring. Sleep. 2011;34:73–81.

    PubMed  PubMed Central  Google Scholar 

  30. Silber MH, Ancoli-Israel S, Bonnet MH, Chokroverty S, Grigg-Damberger MM, Hirshkowitz M, Kapen S, Keenan SA, Kryger MH, Penzel T, Pressman MR, Iber C. The visual scoring of sleep in adults. J Clin Sleep Med. 2007;3:121–31.

    PubMed  Google Scholar 

Download references

Acknowledgments

This study was partially supported by the Grant-in-Aid for Scientific Research (B) (#25293393), the funds from the Intractable Oral Disease at Osaka University Graduate School of Dentistry, and Center of Innovation Science and Technology based Radical Innovation and Entrepreneurship Program (COISTREAM).

Author information

Authors and Affiliations

  1. Department of Psychiatry, Osaka University Graduate School of Medicine, Osaka, Japan

    Shigeru Nonoue, Midori Mashita, Akira Mikami & Hiroyoshi Adachi

  2. Sleep Medicine Center, Osaka University Hospital, Osaka, Japan

    Shigeru Nonoue, Midori Mashita, Akira Mikami, Hiroyoshi Adachi, Masako Taniike & Takafumi Kato

  3. Department of Fixed Prosthodontics, Osaka University Graduate School of Dentistry, Osaka, Japan

    Shingo Haraki & Hirofumi Yatani

  4. Department of Oral Anatomy and Neurobiology, Osaka University Graduate School of Dentistry, 1-8 Yamadaoka, Suita, Osaka, Japan

    Atsushi Yoshida & Takafumi Kato

  5. Support Center for Campus Life, Osaka University, Osaka, Japan

    Akira Mikami

  6. Osaka University Health Care Center, Osaka, Japan

    Hiroyoshi Adachi

  7. United Graduate School of Child Development, Osaka University, Osaka, Japan

    Masako Taniike & Takafumi Kato

Authors
  1. Shigeru Nonoue
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Midori Mashita
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shingo Haraki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Akira Mikami
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hiroyoshi Adachi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hirofumi Yatani
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Atsushi Yoshida
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Masako Taniike
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Takafumi Kato
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Takafumi Kato.

Ethics declarations

Disclosure statements

This was an investigator-initiated study. Proassist, Ltd. in Japan partially supported research cost of this study. All data collection, statistical analyses and manuscript writing were performed by the investigators independently of Proassist.

Funding

This study was funded by the Grant-in-Aid for Scientific Research (B) (#25293393), the funds from the Intractable Oral Disease at Osaka University Graduate School of Dentistry, and Center of Innovation Science and Technology based Radical Innovation and Entrepreneurship Program (COISTREAM).

Conflict of interest

TK received research grants from Proassist. Other authors declare that they have no conflict of interest.

Ethical approval

This study protocol was approved by the Ethics Committees of Graduate School and School of Dentistry, Osaka University, and Osaka University Dental Hospital.

Informed consent

Written informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nonoue, S., Mashita, M., Haraki, S. et al. Inter-scorer reliability of sleep assessment using EEG and EOG recording system in comparison to polysomnography. Sleep Biol. Rhythms 15, 39–48 (2017). https://doi.org/10.1007/s41105-016-0078-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41105-016-0078-2

Keywords

Search

Navigation