Deep Learning and Sensor Fusion Methods for Studying Gait Changes Under Cognitive Load in Males and Females
Human gait is the manner of walking in people. It is influenced by weight, age, health condition or the interaction with the surrounding environment. In this work, we study gait changes under cognitive load in healthy males and females, using machine learning methods. A deep learning model with multi-processing pipelining and back propagation techniques, is proposed for cognitive load gait analysis. The IMAGiMAT floor system enabling sensor fusion from plastic optical fiber (POF) elements, is utilized to record gait raw data on spatiotemporal ground reaction force (GRF). A deep parallel Convolutional Neural Network (CNN) is engineered for POF sensors fusion, and gait GRF classification. The Layer-Wise Relevance Propagation (LRP), is applied to reveal which gait events are relevant towards informing the parallel CNN prediction. The CNN differentiates between males and females with 95% weighted average precision, and cognitive load gait classification with 93% weighted average precision. These findings present a new hypothesis, whereas larger dataset holds promise for human activity analysis.
KeywordsConvolutional Neural Networks (CNN) Cognitive load gait Ground Reaction Force (GRF) Layer-Wise Relevance Propagation (LRP)
- 1.Yogev, G., Hausdorff, J.M., Giladi, N.: The role of executive function and attention in gait. Official J. Mov. Disord. Soc. 23(3), 329–342 (2008)Google Scholar
- 6.Adenzato, M., Brambilla, M., Manenti, R., et al.: Gender differences in cognitive theory of mind revealed by transcranial direct current stimulation on medial prefrontal cortex. Sci. Rep. 7(41219) (2017). https://doi.org/10.1038/srep41219
- 14.Suutala, J., Fujinami, K., Röning, J.: Gaussian process person identifier based on simple floor sensors. In: Roggen, D., Lombriser, C., Tröster, G., Kortuem, G., Havinga, P. (eds.) EuroSSC 2008. LNCS, vol. 5279, pp. 55–68. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88793-5_5CrossRefGoogle Scholar
- 17.Bharadhwaj, H.: Layer-wise relevance propagation for explainable deep learning based speech recognition. In: 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), pp. 168–174 (2018)Google Scholar
- 18.Maximilian, A., et al.: iNNvestigate neural networks (2018). https://github.com/albermax/innvestigate