Empirical Mode Decomposition Algorithms for Classification of Single-Channel EEG Manifesting McGurk Effect

  • Arup Kumar Pal
  • Dipanjan Roy
  • G. Vinodh Kumar
  • Bipra Chatterjee
  • L. N. Sharma
  • Arpan Banerjee
  • Cota Navin GuptaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11886)


Brain state classification using electroencephalography (EEG) finds applications in both clinical and non-clinical contexts, such as detecting sleep states or perceiving illusory effects during multisensory McGurk paradigm, respectively. Existing literature mostly considers recordings of EEG electrodes that cover the entire head. However, for real world applications, wearable devices that encompass just one (or a few) channels are desirable, which make the classification of EEG states even more challenging. With this as background, we applied variants of data driven Empirical Mode Decomposition (EMD) on McGurk EEG, which is an illusory perception of speech when the movement of lips does not match with the audio signal, for classifying whether the perception is affected by the visual cue or not. After applying a common pre-processing pipeline, we explored four EMD based frameworks to extract EEG features, which were classified using Random Forest. Among the four alternatives, the most effective framework decomposes the ensemble average of two classes of EEG into their respective intrinsic mode functions forming the basis on which the trials were projected to obtain features, which on classification resulted in accuracies of 63.66% using single electrode and 75.85% using three electrodes. The frequency band which plays vital role during audio-visual integration was also studied using traditional band pass filters. Of all, Gamma band was found to be the most prominent followed by alpha and beta bands which contemplates findings from previous studies.


EMD EEG McGurk effect Random Forest 



NBRC authors (DR, GVK and AB) collected the EEG data and performed preprocessing steps. The EMD frameworks were formulated by AKP and CNG. The code for Random Forest was written in MATLAB by BC, AKP and CNG. The paper was written by AKP, BC and CNG. All authors assisted in answering the reviewers comments.

This initial part of this research was funded by NBRC core and the grants Ramalingaswami fellowship (BT/RLF/Re-entry/31/2011) and Innovative Young Bio-technologist Award (IYBA) (BT/07/IYBA/2013) from the Department of Biotechnology (DBT), Ministry of Science Technology, Government of India to Arpan Banerjee. Dipanjan Roy was supported by the Ramalingaswami fellowship (BT/RLF/Re-entry/07/2014) and DST extramural grant (SR/CSRI/21/2016). Neural Engineering Lab, IIT Guwahati is supported by Startup Grant, IIT Guwahati and NECBH grant sponsored by DBT (NECBH/2019-20/177).


  1. 1.
    McGurk, H., MacDonald, J.: Hearing lips and seeing voices. Nature 264(5588), 746 (1976)CrossRefGoogle Scholar
  2. 2.
    Huang, N.E., et al.: The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. A 454(1971), 903–995 (1998)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Molla, M., Islam, K., Rahman, M.S., Sumi, A., Banik, P.: Empirical mode decomposition analysis of climate changes with special reference to rainfall data. Discrete Dyn. Nature Soc. 2006 (2006) Google Scholar
  4. 4.
    Loh, C.-H., Wu, T.-C., Huang, N.E.: Application of the empirical mode decomposition-Hilbert spectrum method to identify near-fault ground-motion characteristics and structural responses. Bull. Seismol. Soc. Am. 91(5), 1339–1357 (2001)CrossRefGoogle Scholar
  5. 5.
    Looney, D., Mandic, D.P.: Multiscale image fusion using complex extensions of EMD. IEEE Trans. Signal Process. 57(4), 1626–1630 (2009)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Veltcheva, A.D.: Wave and group transformation by a Hilbert spectrum. Coast. Eng. J. 44(4), 283–300 (2002)CrossRefGoogle Scholar
  7. 7.
    Arasteh, A., Moradi, M.H., Janghorbani, A.: A novel method based on empirical mode decomposition for P300-based detection of deception. IEEE Trans. Inf. Forensics Secur. 11(11), 2584–2593 (2016)CrossRefGoogle Scholar
  8. 8.
    Kumar, G.V., Halder, T., Jaiswal, A.K., Mukherjee, A., Roy, D., Banerjee, A.: Large scale functional brain networks underlying temporal integration of audiovisual speech perception: an EEG study. Front. Psychol. 7, 1558 (2016)Google Scholar
  9. 9.
    Hocking, J., Price, C.J.: The role of the posterior superior temporal sulcus in audiovisual processing. Cereb. Cortex 18(10), 2439–2449 (2008)CrossRefGoogle Scholar
  10. 10.
    Kumar, V.G., Dutta, S., Talwar, S., Roy, D., Banerjee, A.: Neurodynamic explanation of inter-individual and inter-trial variability in cross-modal perception. bioRxiv, p. 286609 (2018)Google Scholar
  11. 11.
    Teplan, M., et al.: Fundamentals of EEG measurement. Meas. Sci. Rev. 2(2), 1–11 (2002)Google Scholar
  12. 12.
    Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., Arnaldi, B.: A review of classification algorithms for EEG-based brain-computer interfaces. J. Neural Eng. 4(2), R1 (2007)CrossRefGoogle Scholar
  13. 13.
    Colominas, M.A., Schlotthauer, G., Torres, M.E.: Improved complete ensemble EMD: a suitable tool for biomedical signal processing. Biomed. Signal Process. Control 14, 19–29 (2014)CrossRefGoogle Scholar
  14. 14.
    Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Arup Kumar Pal
    • 1
    • 3
  • Dipanjan Roy
    • 2
  • G. Vinodh Kumar
    • 2
  • Bipra Chatterjee
    • 1
  • L. N. Sharma
    • 3
  • Arpan Banerjee
    • 2
  • Cota Navin Gupta
    • 1
    Email author
  1. 1.Neural Engineering Lab, Department of Biosciences and BioengineeringIndian Institute of Technology GuwahatiGuwahatiIndia
  2. 2.Cognitive Brain Dynamics LabNational Brain Research CentreGurgaonIndia
  3. 3.EMST Lab, Department of Electronics and Electrical EngineeringIndian Institute of Technology GuwahatiGuwahatiIndia

Personalised recommendations