A nature-inspired biomarker for mental concentration using a single-channel EEG

Abstract

We developed a system for measuring the attentional process during the performance of specific activities. The proposed biomarker device is able to estimate the mental concentration using a single-channel EEG. The system captures the EEG signal and several brain waves located in the left orbitofrontal brain region. Furthermore, we extended the input features of the system applying spectrum analysis. We applied two well-known evolutionary algorithms for selecting the best combination of input features: simulated annealing and geometric particle swarm optimization. Besides, we solved the binary classification problem (concentration vs. relaxation) using support vector machines and neural networks. Support vector machines are among the most common instruments for solving binary classification problems. On the other hand, we selected to study a family of neural networks named echo state networks, because the model is ideal for embedded systems and has shown good accuracy in real-world applications. The training and execution are fast, robust, and reliable. The developed system is autonomous, portable, reliable, non-invasive and has a low economic cost. Besides, it can be easily adjusted for each person and for each problem.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

References

  1. 1.

    Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz JL (2012) Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine. In: Bravo J, Hervás R, Rodríguez M (eds) Ambient assisted living and home care. Springer, Berlin, pp 216–223

    Google Scholar 

  2. 2.

    Bacciu D, Barsocchi P, Chessa S, Gallicchio C, Micheli A (2014) An experimental characterization of reservoir computing in ambient assisted living applications. Neural Comput Appl 24(6):1451–1464. https://doi.org/10.1007/s00521-013-1364-4

    Google Scholar 

  3. 3.

    Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Ferscha A, Mattern F (eds) Pervasive computing. Springer, Berlin, pp 1–17

    Google Scholar 

  4. 4.

    Basterrech S Availability of source code and dataset: goo.gl/zmDgSu

  5. 5.

    Basterrech S (2017) Empirical analysis of the necessary and sufficient conditions of the echo state property. In: 2017 International joint conference on neural networks (IJCNN 2017), Anchorage, AK, USA, May 14–19, 2017, pp 888–896

  6. 6.

    Basterrech S, Bobrov P, Frolov A, Husek D (2015) Nature-inspired algorithms for selecting EEG sources for motor imagery based BCI. In: Rutkowski L, Korytkowski M, Scherer R, Tadeusiewicz R, Zadeh LA, Zurada JM (eds) Artificial intelligence and soft computing, volume 9120 of lecture notes in computer science. Springer, Berlin, pp 79–90

    Google Scholar 

  7. 7.

    Basterrech S, Fyfe C, Rubino G (2011) Self-organizing maps and scale-invariant maps in echo state networks. In: 11th International conference on intelligent systems design and applications (ISDA 2011), Córdoba, Spain, pp 94–99

  8. 8.

    Basterrech S, Rubino G (2017) Echo state queueing networks: a combination of reservoir computing and random neural networks. Probab Eng Inf Sci 31:457–476

    MathSciNet  MATH  Google Scholar 

  9. 9.

    Biesiada J, Duch W, Kachel A, Maczka K, Palucha S (2005) Feature ranking methods based on information entropy with parzen windows. In: International conference on research in electrotechnology and applied informatics, vol 1, p 1

  10. 10.

    Bobrov P, Frolov AA, Cantor C, Fedulova I, Bakhnyan M, Zhavoronkov A (2011) Brain-computer interface based on generation of visual images. PLoS ONE 6(6):1–12

    Google Scholar 

  11. 11.

    Butcher JB, Verstraeten D, Schrauwen B, Day CR, Haycock PW (2013) Reservoir computing and extreme learning machines for non-linear time-series data analysis. Neural Netw 38:76–89

    Google Scholar 

  12. 12.

    Campbell C, Ying Y (2011) Learning with support vector machines. Synth Lect Artif Intell Mach Learn 5(1):1–95

    MATH  Google Scholar 

  13. 13.

    Cleghorn CW, Engelbrecht AP (2014) A generalized theoretical deterministic particle swarm model. Swarm Intell 8(1):35–59

    Google Scholar 

  14. 14.

    Clerc M (2010) Particle swarm optimization. ISTE, Wiley, New York

    Google Scholar 

  15. 15.

    Clerc M, Kennedy J (2002) The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73

    Google Scholar 

  16. 16.

    Dashdamirov H, Basterrech S, Kromer P (2018) A nature-inspired system for mental state recognition. In: 2018 IEEE Congress on evolutionary computation (CEC), pp 1–8

  17. 17.

    Diao R, Shen Q (2015) Nature inspired feature selection meta-heuristics. Artif Intell Rev 44(3):311–340

    Google Scholar 

  18. 18.

    Dirk K, Ott J (2003) Dynamic device access for mobile users. In: Proceedings of the eighth international conference on personal wireless communications

  19. 19.

    Engelbrecht A (2007) Computational intelligence: an introduction, 2nd edn. Wiley, New York

    Google Scholar 

  20. 20.

    Frolov AA, Husek D, Bobrov P, Korshakov A, Chernikova L, Konovalov R, Mokienko O (2012) Sources of EEG activity most relevant to performance of brain–computer interface based on motor imagery. Neural Netw World 22(1):21–37

    Google Scholar 

  21. 21.

    Frolov AA, Husek D, Bobrov P, Mokienko O, Tintera J (2013) Sources of electrical brain activity most relevant to performance of brain–computer interface based on motor imagery. In: Brain–computer interface systems—recent progress and future prospects. InTech, pp 175–193

  22. 22.

    Funahashi K, Nakamura Y (1993) Approximation of dynamical systems by continuous time recurrent neural networks. Neural Netw 6:801–806

    Google Scholar 

  23. 23.

    Gallicchio C, Micheli A, Pedrelli L (2017) Deep reservoir computing: a critical experimental analysis. Neurocomputing 268(Supplement C):87 – 99. Advances in artificial neural networks, machine learning and computational intelligence

  24. 24.

    Hamel LH (2009) Knowledge discovery with support vector machines. Wiley, New York

    Google Scholar 

  25. 25.

    Hastie T, Tibshirani R, Friedman J (2001) The elements of statistical learning. Spring series in statistics. Springer, New York

    Google Scholar 

  26. 26.

    Herbrich R (2001) Learning kernel classifiers: theory and algorithms (adaptive computation and machine learning). MIT Press, Cambridge

    Google Scholar 

  27. 27.

    Jaeger H (2001) The “echo state” approach to analysing and training recurrent neural networks. Technical Report 148, German National Research Center for Information Technology

  28. 28.

    Jaeger H, Lukoševičius M, Popovici D, Siewert U (2007) Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw 20(3):335–352

    MATH  Google Scholar 

  29. 29.

    Jongen HT, Meer K, Triesch E (2004) Optimization theory. Kluwer, Dordrecht

    Google Scholar 

  30. 30.

    Kafka F (1925) The trial. Der Prozeß. Translated by David Wyllie

  31. 31.

    Kecman V (2005) Support vector machines: an introduction. In: Wang L (ed) Support vector machines: theory and applications, volume 177 of studies in fuzziness and soft computing. Springer, Berlin, pp 605–605

    Google Scholar 

  32. 32.

    Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol 4, pp 1942–1948

  33. 33.

    Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220(4598):671–680

    MathSciNet  MATH  Google Scholar 

  34. 34.

    Liu H, Motoda H (2013) Feature selection for knowledge discovery and data mining. The Springer international series in engineering and computer science. Springer, US

    Google Scholar 

  35. 35.

    Lukoševičius M (2010) On self-organizing reservoirs and their hierarchies. Technical Report 25, Jacobs University, Bremen

  36. 36.

    Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3:127–149

    MATH  Google Scholar 

  37. 37.

    Lukoševičius M (2012) A practical guide to applying echo state networks. In: Montavon G, Orr GB, Müller K-R (eds) Neural networks: tricks of the trade, volume 7700 of lecture notes in computer. Springer, Berlin, pp 659–686

    Google Scholar 

  38. 38.

    Maass W (1999) Noisy spiking neurons with temporal coding have more computational power than sigmoidal neurons. Technical Report TR-1999-037, Institute for Theorical Computer Science. Technische Universitaet Graz. Graz, Austria

  39. 39.

    Manjunath G, Jaeger H (2013) Echo state property linked to an input: exploring a fundamental characteristic of recurrent neural networks. Neural Comput 25(3):671–696

    MathSciNet  MATH  Google Scholar 

  40. 40.

    Moraglio A, Di Chio C, Togelius J, Poli R (2008) Geometric particle swarm optimization. J Artif Evol Appl 2008:11:1–11:14

    Google Scholar 

  41. 41.

    Rolls ET (2004) The functions of the orbitofrontal cortex. Brain Cognit 55:11–29

    Google Scholar 

  42. 42.

    Ravindran AR (2016) Operations research and management science handbook. Operations research series. CRC Press, Boca Raton

    Google Scholar 

  43. 43.

    Rodan A, Tino P (2012) Simple deterministically constructed cycle reservoirs with regular jumps. Neural Comput 24:1822–1852

    MathSciNet  Google Scholar 

  44. 44.

    Rumelhart DE, Hinton GE, McClelland JL (1986) A general framework for parallel distributed processing. In: Rumelhart DE, McClelland JL, the PDP Research Group (eds) Parallel distributed processing: explorations in the microstructure of cognition, volume 1 of computational models of cognition and perception, chapter 2. MIT Press, Cambridge, pp 45–76.

  45. 45.

    Schmidhuber J, Wierstra D, Gagliolo M, Gomez F (2007) Training recurrent networks by Evolino. Neural Netw 19:757–779

    MATH  Google Scholar 

  46. 46.

    Siegelmann HT, Sontag ED (1991) Turing computability with neural nets. Appl Math Lett 4(6):77–80

    MathSciNet  MATH  Google Scholar 

  47. 47.

    Technologies Neurosky Brain Computer (2015) MindWave mobile: user guide. NeuroSky’s Mindset Company, Technical report. http://neurosky.com

  48. 48.

    Tong S, Thakor NV (eds) (2009) Quantitative EEG analysis methods and clinical applications. Artech House Series, Engineering in Medicine & Biology. ISBN-13: 978-1-59693-204-3

  49. 49.

    Verstraeten D, Schrauwen B, D’Haene M, Stroobandt D (2007) An experimental unification of reservoir computing methods. Neural Netw 20(3):287–289

    MATH  Google Scholar 

  50. 50.

    Wegener I (2005) Simulated annealing beats metropolis in combinatorial optimization. In: Caires L, Italiano GF, Monteiro L, Palamidessi C, Yung M (eds) Automata, languages and programming. Springer, Berlin, pp 589–601

    Google Scholar 

  51. 51.

    Yildiza IB, Jaeger H, Kiebela SJ (2012) Re-visiting the echo state property. Neural Netw 35:1–9

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Technology Agency of the Czech Republic in the frame of the project no. TN01000024 “National Competence Center – Cybernetics and Artificial Intelligence”, and by the projects SP2019/135 and SP2019/141 of the Student Grant System, VSB – Technical University of Ostrava.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Sebastián Basterrech.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interests regarding the publication paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Basterrech, S., Krömer, P. A nature-inspired biomarker for mental concentration using a single-channel EEG. Neural Comput & Applic 32, 7941–7956 (2020). https://doi.org/10.1007/s00521-019-04574-2

Download citation

Keywords

  • Brain–computer interface
  • Biomarkers
  • Echo state network
  • Simulated annealing
  • Swarm intelligence