Abstract
Recently, deep learning has gained great attention in decoding the neuro-physiological signal. However, which one (classical machine learning or deep learning) has better performance for decoding the functional near-infrared spectroscopy (fNIRS) signal is still lack of full verification. Thus, in this paper, we systematically compared the performance of many classical machine learning methods and deep learning methods in fNIRS data processing for decoding the mental arithmetic task. The classical machine learning methods such as decision tree, linear discriminant analysis (LDA), support vector machine (SVM), K-Nearest Neighbor (KNN) and ensemble methods with strict feature extraction and screening, were used for performance comparison, while the long short-term memory-fully convolutional network (LSTM-FCN) method as a representative of deep leaning methods was applied. Results showed that the classification performance of SVM was the best among the classical machine learning methods, achieving that the average accuracy of the subject-related/unrelated were 91.0% and 83.0%, respectively. Furthermore, the classification accuracy of deep learning was significantly better than that of the involved classical machine learning methods, where the accuracy of deep learning could reach 95.3% with subject-related condition and 97.1% with subject-unrelated condition, respectively. Thus, this paper has totally showed the excellent performance of LSTM-FCN as a representative of deep learning in decoding brain signal from fNIRS dataset, which has outperformed many classical machine learning methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bauernfeind, G., et al.: Single trial classification of fNIRS-based brain-computer interface mental arithmetic data: a comparison between different classifiers. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 2004–2007. IEEE (2014)
Pasley, B.N., Freeman, R.D.: Neurovascular coupling. Scholarpedia 3(3), 5340 (2008)
Scholkmann, F., Kleiser, S., Metz, A.J., et al.: A review on continuous wave functional near-infrared spectroscopy and imaging instrumentation and methodology. Neuroimage 85, 6–27 (2014)
Hoshi, Y.: Functional near-infrared optical imaging: utility and limitations in human brain mapping. Psychophysiology 40(4), 511–520 (2003)
Hoshi, Y.: Near-infrared spectroscopy for studying higher cognition. In: Kraft, E., Gulyás, B., Pöppel, E. (eds.) Neural Correlates of Thinking. On Thinking, vol. 1, pp. 83–93. Springer, Berlin (2009). https://doi.org/10.1007/978-3-540-68044-4_6
Kim, S.G., Ogawa, S.: Biophysical and physiological origins of blood oxygenation level-dependent fMRI signals. J. Cerebral Blood Flow Metab. 32(7), 1188–1206 (2012)
Leff, D.R., Orihuela-Espina, F., Elwell, C.E., et al.: Assessment of the cerebral cortex during motor task behaviours in adults: a systematic review of functional near infrared spectroscopy (fNIRS) studies. Neuroimage 54(4), 2922–2936 (2011)
Irani, F., Platek, S.M., Bunce, S., et al.: Functional near infrared spectroscopy (fNIRS): an emerging neuroimaging technology with important applications for the study of brain disorders. Clin. Neuropsychol. 21(1), 9–37 (2007)
Coyle, S.M., Ward, T.E., Markham, C.M.: Brain–computer interface using a simplified functional near-infrared spectroscopy system. J. Neural Eng. 4(3), 219 (2007)
Sitaram, R., Zhang, H., Guan, C., et al.: Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface. NeuroImage 34(4), 1416–1427 (2007)
Naito, M., Michioka, Y., Ozawa, K., et al.: A communication means for totally locked-in ALS patients based on changes in cerebral blood volume measured with near-infrared light. IEICE Trans. Inf. Syst. 90(7), 1028–1037 (2007)
Naseer, N., Hong, K.S.: fNIRS-based brain-computer interfaces: a review. Front. Hum. Neurosci. 9, 3 (2015)
Hennrich, J., et al.: Investigating deep learning for fNIRS based BCI. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2844–2847. IEEE (2015)
Günther, B., Scherer, R., Pfurtscheller, G., et al.: Single-trial classification of antagonistic oxyhemoglobin responses during mental arithmetic. Med. Biol. Eng. Comput. 49(9), 979–984 (2011)
Kirilina, E., Jelzow, A., Heine, A., et al.: The physiological origin of task-evoked systemic artefacts in functional near infrared spectroscopy. Neuroimage 61(1), 70–81 (2012)
Bauernfeind, G., et al.: Physiological noise removal from fNIRS signals. Biomed. Eng./Biomedizinische Technik, 1–2 (2013)
Cui, X., Bray, S., Reiss, A.L.: Speeded near infrared spectroscopy (NIRS) response detection. PLoS One 5(11), 1–7 (2010). e15474
Putze, F., Hesslinger, S., Tse, C.Y., et al.: Hybrid fNIRS-EEG based classification of auditory and visual perception processes. Front. Neurosci. 8, 1–13 (2014)
Yin, X., Xu, B., Jiang, C., et al: A hybrid BCI based on EEG and fNIRS signals improves the performance of decoding motor imagery of both force and speed of hand clenching. J. Neural Eng. 12(3), 1–12 (2015). 036004
Buccino, A.P., Hasan, O.K., Ahmet, O.: Hybrid EEG-fNIRS asynchronous brain-computer interface for multiple motor tasks. PLoS ONE 11, 1 (2016)
Raheel, B.M., Hong, M.J., Yun-Hee, K., et al.: Single-trial lie detection using a combined fNIRS-polygraph system. Front. Psychol. 6, 709 (2015)
Karim, F., Majumdar, S., Darabi, H., et al.: LSTM Fully Convolutional Networks for Time Series Classification. IEEE Access 6, 1662–1669 (2017)
Wang, Z., Yan, W., Oates, T.: Time series classification from scratch with deep neural networks: a strong baseline. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp. 1578–1585. IEEE (2017)
Lin, M., Chen, Q., Yan, S.: Network in network. https://arxiv.org/abs/1312.4400 (2013)
Srivastava, N., Hinton, G., Krizhevsky, A., et al.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)
Acknowledgements
This work was supported by National Natural Science Foundation of China (No. 61701318, 61971289), Natural Science Research Project of Jiangsu Higher Education Institutions (No. 18KJB416001), Project of “Six Talent Peaks” of Jiangsu Province (No. SWYY-017), Shenzhen Fundamental Research Project (No. JCYJ20170412111316339), Shenzhen Talent Peacock Plan (No. 827-000083), and Shenzhen-Hong Kong Institute of Brain Science-Shenzhen Fundamental Research Institutions.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 IFIP International Federation for Information Processing
About this paper
Cite this paper
Lu, J., Yan, H., Chang, C., Wang, N. (2020). Comparison of Machine Learning and Deep Learning Approaches for Decoding Brain Computer Interface: An fNIRS Study. In: Shi, Z., Vadera, S., Chang, E. (eds) Intelligent Information Processing X. IIP 2020. IFIP Advances in Information and Communication Technology, vol 581. Springer, Cham. https://doi.org/10.1007/978-3-030-46931-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-46931-3_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-46930-6
Online ISBN: 978-3-030-46931-3
eBook Packages: Computer ScienceComputer Science (R0)
