N-way Decomposition: Towards Linking Concurrent EEG and fMRI Analysis During Natural Stimulus

  • Jinglei LvEmail author
  • Vinh Thai Nguyen
  • Johan van der Meer
  • Michael Breakspear
  • Christine Cong Guo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10433)


The human brain is intrinsically a high-dimensional and multi-variant system. Simultaneous EEG and fMRI recoding offers a powerful tool to examine the electrical activity of neuron populations at high temporal and frequency resolution, and concurrent blood oxygen level dependent (BOLD) responses at high spatial resolution. Joint analysis of EEG and fMRI data could thus help comprehensively understand the brain function at multiple scales. Such analysis, however, is challenging due to the limited knowledge on the coupling principle of neuronal-electrical and hemodynamic responses. A rich body of works have been done to model EEG-fMRI data during event related design and resting state, while few have explored concurrent data during natural stimulus due to the complexity of both stimulus and response. In this paper, we propose a novel method based on N-way decomposition to jointly analyze simultaneous EEG and fMRI data during natural movie viewing. Briefly, a 4-way tensor from the EEG data, constructed in four dimensions of time, frequency, channel and subject, is decomposed into group-wise rank one components by canonical polyadic decomposition (CPD). We then used the decomposed temporal features to constrain a 2-way sparse decomposition of fMRI data for network detection. Our results showed that the proposed method could effectively decode meaningful brain activity from both modalities and link EEG multi-way features with fMRI functional networks.


Simultaneous EEG fMRI Natural stimulus Joint analysis Canonical polyadic decomposition Sparse decomposition 


  1. 1.
    Bullmore, E., Sporns, O.: Complex brain networks: graph theoretical analysis of structural and functional systems. Nat. Rev. Neurosci. 10(3), 186–198 (2009)CrossRefGoogle Scholar
  2. 2.
    Ullsperger, M., Debener, S.: Simultaneous EEG and fMRI: recording, analysis, and application. Oxford University Press, New York (2010)CrossRefGoogle Scholar
  3. 3.
    Moosmann, M., et al.: Joint independent component analysis for simultaneous EEG–fMRI: principle and simulation. Int. J. Psychophysiol. 67(3), 212–221 (2008)CrossRefGoogle Scholar
  4. 4.
    Huster, R.J., et al.: Methods for simultaneous EEG-fMRI: an introductory review. J. Neurosci. 32(18), 6053–6060 (2012)CrossRefGoogle Scholar
  5. 5.
    Whittingstall, K., et al.: Integration of EEG source imaging and fMRI during continuous viewing of natural movies. Magn. Reson. Imaging 28(8), 1135–1142 (2010)CrossRefGoogle Scholar
  6. 6.
    Sorber, L., et al.: Structured data fusion. IEEE J. Sel. Top. Sign. Process. 9(4), 586–600 (2015)CrossRefGoogle Scholar
  7. 7.
    Mairal, J., et al.: Online learning for matrix factorization and sparse coding. J. Mach. Learn. Res. 11, 19–60 (2010)MathSciNetzbMATHGoogle Scholar
  8. 8.
    Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134(1), 9–21 (2004)CrossRefGoogle Scholar
  9. 9.
    Dumermuth, G., Molinari, L.: Spectral analysis of the EEG. Neuropsychobiology 17(1–2), 85–99 (1987)Google Scholar
  10. 10.
    Bland, J.M., Altman, D.G.: Statistics notes: Cronbach’s alpha. BMJ 314(7080), 572 (1997)CrossRefGoogle Scholar
  11. 11.
    Foxe, J.J., Snyder, A.C.: The role of alpha-band brain oscillations as a sensory suppression mechanism during selective attention. Frontiers Psychol. 2, 154 (2011)CrossRefGoogle Scholar
  12. 12.
    Rowland, N., et al.: EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. Science 228(4700), 750–752 (1985)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Jinglei Lv
    • 1
    Email author
  • Vinh Thai Nguyen
    • 1
  • Johan van der Meer
    • 1
  • Michael Breakspear
    • 1
  • Christine Cong Guo
    • 1
  1. 1.QIMR Berghofer Medical Research InstituteHerstonAustralia

Personalised recommendations