Fusion of Inertial Motion Sensors and Electroencephalogram for Activity Detection

  • Ibai Baglietto Araquistain
  • Xabier Garmendia
  • Manuel GrañaEmail author
  • Javier de Lope Asiain
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11486)


A central issue in Computational Neuroethology is the fusion of information coming from a wide variety of devices, by computational tools and techniques aiming to correlate the neural substrate and the observable behavior. In this paper we are concerned with the fusion of information from two specific commercial devices, the Emotiv EPOC+ EEG recorder, and the Rokoko motion capture suite based on inertial motion units (IMU). We have built an ad hoc system for synchronized data capture. We test the system on the recognition of simple activities. We are able to confirm that the fusion of the neural activity information and the motion information improves the activity recognition.



This work has been partially supported by FEDER funds through MINECO project TIN2017-85827-P, and project KK-2018/00071 of the Elkartek 2018 funding program of the Basque Government


  1. 1.
    Akkaya, B., Tabar, Y.R., Gharbalchi, F., Ulusoy, I., Halici, U.: Tracking mice face in video. In: 20th National Biomedical Engineering Meeting (BIYOMUT), pp. 1–4, November 2016Google Scholar
  2. 2.
    Baglietto, I., Garmendia, X., Graña, M.: A synchronized capture system for Emotiv+, Kinect, and Rokoko motion capture, Jaunary 2019.
  3. 3.
    Burgos-Artizzu, X.P., Dollár, P., Lin, D., Anderson, D.J., Perona, P.: Social behavior recognition in continuous video. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1322–1329, June 2012Google Scholar
  4. 4.
    Carreno, M.I., et al.: First approach to the analysis of spontaneous activity of mice based on permutation entropy. In: 2015 4th International Work Conference on Bioinspired Intelligence (IWOBI), pp. 197–204, June 2015Google Scholar
  5. 5.
    Dell, A.I., et al.: Automated image-based tracking and its application in ecology. Trends Ecol. Evol. 29(7), 417–428 (2014)CrossRefGoogle Scholar
  6. 6.
    Fröhlich, H., Claes, K., De Wolf, C., Van Damme, X., Michel, A.: A machine learning approach to automated gait analysis for the Noldus Catwalk system. IEEE Trans. Biomed. Eng. 65(5), 1133–1139 (2018)Google Scholar
  7. 7.
    Kearns, W.D., Fozard, J.L., Nams, V.O.: Movement path tortuosity in free ambulation: relationships to age and brain disease. IEEE J. Biomed. Health Inform. 21(2), 539–548 (2017)CrossRefGoogle Scholar
  8. 8.
    Kelso, J.A.S., Dumas, G., Tognoli, E.: Outline of a general theory of behavior and brain coordination. Neural Netw. 37, 120–131 (2013). Twenty-fifth Anniversay Commemorative IssueCrossRefGoogle Scholar
  9. 9.
    Mobbs, D., et al.: Foraging under competition: the neural basis of input-matching in humans. J. Neurosci. 33(23), 9866–9872 (2013)CrossRefGoogle Scholar
  10. 10.
    Mobbs, D., Kim, J.J.: Neuroethological studies of fear, anxiety, and risky decision-making in rodents and humans. Curr. Opin. Behav. Sci. 5, 8–15 (2015). NeuroeconomicsCrossRefGoogle Scholar
  11. 11.
    Sminchisescu, C.: Conditional models for contextual human motion recognition. In: Tenth IEEE International Conference on Computer Vision (ICCV 2005), Volume 1, vol. 2, pp. 1808–1815, October 2005Google Scholar
  12. 12.
    Tang, B., et al.: An in vivo study of hypoxia-inducible factor-1\(\alpha \) signaling in ginsenoside Rg1-mediated brain repair after hypoxia/ischemia brain injury. Pediatric Res. 81, 120 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Ibai Baglietto Araquistain
    • 1
  • Xabier Garmendia
    • 1
  • Manuel Graña
    • 1
    Email author
  • Javier de Lope Asiain
    • 2
  1. 1.Computational Intelligence GroupUniversity of the Basque Country, (UPV/EHU)San SebastiánSpain
  2. 2.Computational Cognitive Robotics Group, Department of Artificial IntelligenceUniversidad Politécnica de Madrid (UPM)MadridSpain

Personalised recommendations