Abstract
Recent studies have demonstrated that functional near-infrared spectroscopy (fNIRS) is a potential non-invasive system for human mental workload (MWL) evaluation in both off-line and on-line manners. While most of the studies have been based on supervised classification of different MWL levels, which requires much effort to collect labeled training data, investigation on unlabeled data seems to be more promising. In this paper, we developed unsupervised learning and classification techniques of fNIRS parameters to support human workload classification. In the experimental setup, five subjects engaged in ten-loop memorizing tasks that were devised into two MWL levels while fNIRS signals were being monitored over their frontal lobes. Independent component analysis (ICA) was applied on a set of unlabeled random fNIRS data to extract the basis and sparse functions. Then two-dimensional convolutional matrices, which were constructed as sets of convolutional coefficients of fNIRS signal with learned basis functions, were implemented as the inputs for MWL classification using convolutional neural network classifier. Study of generalized linear model demonstrated that basis functions extracted using ICA is more effective when illustrating the activation regions over measuring cortex than using the modeled hemodynamic response functions. Besides, ICA basis function demonstrates the sparseness so that it is superior to basis functions learned by the conventional method of principle component analysis (PCA) in mental classification and shows its potential for further study of fNIRS signals based on their hidden basis functions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, H., Yao, D., Liu, Z.: A comparison of Gamma and Gaussian dynamic convolution models of the fMRI BOLD response. Magn. Reson. Imaging 23, 83–88 (2005)
Penny, W., Fladin, G., Trujillo-Barreto, N.: Chapter 25-Spatio-temporal models for fMRI. In: Statistical Parametric Mapping. Academic Press, London (2007)
John, R.H., Wilson, W.P.: EEG and Evoked Potentials in Psychiatry and Behavior Neurology. Butterworth-Heinemann (1999)
Gregory, B., Qianqian, F., Stefan, A.C., Eric, L.M., Dana, H.B., Juliette, S., et al.: Spatio-temporal imaging of the hemoglobin in the compressed breast with diffuse optical tomography. Phys. Med. Biol. 52, 3619–3641 (2007)
Ferrari, M., Quaresima, V.: A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application. NeuroImage. 63, 921–935 (2012)
Huppert, T.J., Hoge, R.D., Diamond, S.G., Franceschini, M.A., Boas, D.A.: A temporal comparison of BOLD, ASL, and NIRS hemodynamic responses to motor stimuli in adult humans. NeuroImage. 19, 368–382 (2006)
Yuan, Z.: Spatiotemporal and time-frequency analysis of functional near infrared spectroscopy brain signals using independent component analysis. J. Biomed. Opt. 18, 106011 (2013)
Cohen, L.: Convolution, filtering, linear systems, the Wiener-Khinchin theorem: generalizations. In: Proceedings of SPIE 1770, Advanced Signal Processing Algorithms, Architectures, and Implementations III, 378–393 (1992)
Hyvrinen, A., Hurri, J., Hoyer, P.O.: Natural Image Statistics: A Probabilistic Approach to Early Computational Vision. Springer Publishing Company, Incorporated, London (2009)
Friston, K.J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M.D., Turner, R.: Event-Related fMRI: Characterizing Differential Responses. NeuroImage. 7, 30–40 (1998)
Smith, E.C., Lewicki, M.S.: Efficient auditory coding. Nature 439, 978–982 (2006)
Olshausen, B.A., Field, D.J.: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607–609 (1996)
Huppert, T.J., Diamond, S.G., Franceschini, M.A., Boas, D.A.: HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain. Appl. Opt. 48, D280–D298 (2009)
Calvert, G.A., Campbell, R., Brammer, M.J.: Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10, 649–657 (2000)
Sassaroli, A., Zheng, F., Hirshfield, M., Girouard, A., Solovey, E., Jacob, R., Fantini, S.: Discrimination of mental workload levels in human subjects with functional near-infrared spectroscopy. J. Innov. Opt. Health Sci. 1, 227–237 (2008)
Cecotti, H.: A time-frequency convolutional neural network for the offline classification of steady-state visual evoked potential responses. Pattern Recognit. Lett. 32, 1145–1153 (2011)
Sainath, T.N., Kingsbury, B., Saon, G., Soltau, H., Mohamed, A., Dahl, G., et al.: Deep Convolutional Neural Networks for Large-scale Speech Tasks. Neural Networks, 64, 39–48 (2015)
Acknowledgments
This work has been supported by grants No. 106.99-2010.11 of Vietnam National Foundation for Science and Technology Development (NAFOSTED) and No. B2011-28-01 of Vietnam National Universities—HCMC. We thank the European Union’s Seventh Framework Programme for Research, Technological Development and Demonstration for grant No. 611014 CONNECT2SEA project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Pham, T.T., Nguyen, T.D., Van Vo, T. (2016). Sparse fNIRS Feature Estimation via Unsupervised Learning for Mental Workload Classification. In: Bassis, S., Esposito, A., Morabito, F., Pasero, E. (eds) Advances in Neural Networks. WIRN 2015. Smart Innovation, Systems and Technologies, vol 54. Springer, Cham. https://doi.org/10.1007/978-3-319-33747-0_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-33747-0_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-33746-3
Online ISBN: 978-3-319-33747-0
eBook Packages: EngineeringEngineering (R0)