Advertisement

Mobile EEG-Based Workers’ Stress Recognition by Applying Deep Neural Network

  • Houtan Jebelli
  • Mohammad Mahdi Khalili
  • SangHyun Lee
Conference paper

Abstract

A large number of construction workers are struggling with high stress associated with their perilous job sites. Excessive occupational stress can cause serious job difficulties by negatively impacting workers’ productivity, safety, and health. The first step to decrease the adverse outcomes of this work-related stress is to measure workers’ stress and detect the factors causing stress among workers. Various self-assessment instruments (e.g., a stress assessment questionnaire) have been used to assess workers’ perceived stress. However, these methods are compromised by several drawbacks that limit their use in the field. Firstly, these methods interrupt workers ongoing tasks. Secondly, these methods are subject to a high degree of bias, which can lead to inconsistent results. The authors’ earlier work attempted to address the limitations of these subjective methods by applying different machine learning methods (e.g., Supervised Learning algorithms) to identify the pattern of workers’ brain waves that is acquired from a wearable Electroencephalography (EEG) device, while exposed to different stressors. This research thus attempts to improve the stress recognition accuracy of the previous algorithms by developing an EEG-based stress recognition framework by applying two Deep Learning Neural Networks (DNN) structures: a convolutional deep learning neural network (deep CNN) and a Fully Connected Deep Neural Network. Results of the optimum DNN configuration yielded a maximum of 86.62% accuracy using EEG signals in recognizing workers’ stress, which is at least six percent more accurate when compared with previous handcraft feature-based stress recognition methods. Detecting workers’ stress with a high accuracy in the field will lead to enhancing workers’ safety, productivity, and health by early detection and mitigation of stressors at construction sites.

Keywords

Brain waves Workers’ stress Wearable electroencephalography (EEG) Convolutional deep neural network Fully connected deep neural network Occupational stress Workers’ productivity Health Safety 

Notes

Acknowledgements

The authors would like to acknowledge their industry partners for their considerable help in collecting data.

References

  1. 1.
    Campbell, F.: Occupational stress in the construction industry, Berkshire. Chartered Institute of Building, UK (2006)Google Scholar
  2. 2.
    Leung, M.Y., Liang, Q., Olomolaiye, P.: Impact of job stressors and stress on the safety behavior and accidents of construction workers. J. Manag. Eng. 32, 04015019 (2015).  https://doi.org/10.1061/(ASCE)ME.1943-5479.0000373CrossRefGoogle Scholar
  3. 3.
    Mucci, N., Giorgi, G., Cupelli, V., Gioffrè, P.A., Rosati, M.V., Tomei, F., Tomei, G., Breso-Esteve, E., Arcangeli, G.: Work-related stress assessment in a population of Italian workers. The Stress Questionnaire. Sci. Total Environ. 502, 673–679 (2015)CrossRefGoogle Scholar
  4. 4.
    Al-shargie, F., Tang, T.B., Badruddin, N., Kiguchi, M.: Mental stress quantification using EEG signals. In: International Conference for Innovation in Biomedical Engineering and Life Sciences. Springer, pp. 15–19 (2015).  https://doi.org/10.1007/978-981-10-0266-3_4Google Scholar
  5. 5.
    Goodman, R.N., Rietschel, J.C., Lo, L.-C., Costanzo, M.E., Hatfield, B.D.: Stress, emotion regulation and cognitive performance: The predictive contributions of trait and state relative frontal EEG alpha asymmetry. Int. J. Psychophysiol. 87, 115–123 (2013)CrossRefGoogle Scholar
  6. 6.
    Al-Shargie, F., Tang, T.B., Kiguchi, M.: Assessment of mental stress effects on prefrontal cortical activities using canonical correlation analysis: an fNIRS-EEG study. Biomed. Opt. Express 8, 2583–2598 (2017).  https://doi.org/10.1364/BOE.8.002583CrossRefGoogle Scholar
  7. 7.
    Hou, X., Liu, Y., Sourina, O., Tan, Y.R.E., Wang, L., Mueller-Wittig, W.: EEG based stress monitoring. In: Systems, Man, and Cybernetics. IEEE, Kowloon, China, pp. 3110–3115 (2015).  https://doi.org/10.1109/SMC.2015.540
  8. 8.
    Jebelli, H., Ahn, C.R., Stentz, T.L.: Comprehensive fall-risk assessment of construction workers using inertial measurement units: validation of the gait-stability metric to assess the fall risk of iron workers. J. Comput. Civ. Eng. 30, 04015034 (2015).  https://doi.org/10.1061/(ASCE)CP.1943-5487.0000511CrossRefGoogle Scholar
  9. 9.
    Jebelli, H., Ahn, C.R., Stentz, T.L.: Fall risk analysis of construction workers using inertial measurement units: validating the usefulness of the postural stability metrics in construction. Saf. Sci. 84, 161–170 (2016).  https://doi.org/10.1061/9780784481264.036CrossRefGoogle Scholar
  10. 10.
    Nouredanesh, M., Kukreja, S.L., Tung, J.: Detection of compensatory balance responses using wearable electromyography sensors for fall-risk assessment. In: Engineering in Medicine and Biology Society (EMBC), 2016 IEEE 38th Annual International Conference of The, IEEE, pp. 1680–1683 (2016)Google Scholar
  11. 11.
    Jebelli, H., Ahn, C.R., Stentz, T.L.: The validation of gait-stability metrics to assess construction workers’ fall risk. Comput. Civ. Build. Eng. 2014, 997–1004 (2014).  https://doi.org/10.1061/9780784413616.124CrossRefGoogle Scholar
  12. 12.
    Jebelli, H., Hwang, S., Lee, S.: Feasibility of field measurement of construction workers’ valence using a wearable EEG device. In: Computing in Civil Engineering 2017, ASCE, Reston, VA, pp. 99–106 (2017).  https://doi.org/10.1061/9780784480830.013
  13. 13.
    Baghdadi, A., Megahed, F.M., Esfahani, E.T., Cavuoto, L.A.: A machine learning approach to detect changes in gait parameters following a fatiguing occupational task. Ergonomics. 1–14 (2018)Google Scholar
  14. 14.
    Jebelli, H., Hwang, S., Lee, S.: EEG-based workers’ stress recognition at construction sites. Autom. Constr. 93, 315–324 (2018).  https://doi.org/10.1016/j.autcon.2018.05.027CrossRefGoogle Scholar
  15. 15.
    Hwang, S., Seo, J., Jebelli, H., Lee, S.: Feasibility analysis of heart rate monitoring of construction workers using a photoplethysmography (PPG) sensor embedded in a wristband-type activity tracker. Autom. Constr. 71, 372–381 (2016).  https://doi.org/10.1016/j.autcon.2016.08.029CrossRefGoogle Scholar
  16. 16.
    Hwang, S., Jebelli, H., Choi, B., Choi, M., Lee, S.: Measuring workers’ emotional state during construction tasks using wearable EEG. J. Const. Eng. Manag. 144, 04018050 (2018).  https://doi.org/10.1061/(ASCE)CO.1943-7862.0001506CrossRefGoogle Scholar
  17. 17.
    Kim, H., Ahn, C.R., Stentz, T.L., Jebelli, H.: Assessing the effects of slippery steel beam coatings to ironworkers’ gait stability. Appl. Ergon. 68, 72–79 (2018).  https://doi.org/10.1016/j.apergo.2017.11.003CrossRefGoogle Scholar
  18. 18.
    Yang, K., Jebelli, H., Ahn, C., Vuran, M.: Threshold-based approach to detect near-miss falls of iron workers using inertial measurement units. In: Computing in Civil Engineering 2015, ASCE, pp. 148–155 (2015). https://doi.org/10.1061/9780784479247.019
  19. 19.
    Jebelli, H., Yang, K., Khalili, M.M., Ahn, C.R., Stentz, T.: Assessing the effects of tool-loading formation on construction workers’ postural stability. In: Construction Research Congress 2018, pp. 292–302 (2018).  https://doi.org/10.1061/9780784481288.029
  20. 20.
    Jebelli, H., Choi, B., Kim, H., Lee, S.: Feasibility study of a wristband-type wearable sensor to understand construction workers’ physical and mental status. In: Construction Research Congress 2018, ASCE, Reston, VA, pp. 367–377 (2018).  https://doi.org/10.1061/9780784481264.036
  21. 21.
    Jebelli, H., Khalili, M.M., Hwang, S., Lee, S.: A supervised learning-based construction workers’ stress recognition using a wearable electroencephalography (EEG) device. In: Construction Research Congress 2018, (2018). https://doi.org/10.1061/9780784481288.005
  22. 22.
    Levine, A., Zagoory-Sharon, O., Feldman, R., Lewis, J.G., Weller, A.: Measuring cortisol in human psychobiological studies. Physiol. Behav. 90, 43–53 (2007).  https://doi.org/10.1016/j.physbeh.2006.08.025CrossRefGoogle Scholar
  23. 23.
    Jebelli, H., Hwang, S., Lee, S.: EEG signal-processing framework to obtain high-quality brain waves from an off-the-shelf wearable EEG device. J. Comp. Civ. Eng. 32, 04017070 (2017).  https://doi.org/10.1061/(ASCE)CP.1943-5487.0000719CrossRefGoogle Scholar
  24. 24.
    Urigüen, J.A., Garcia-Zapirain, B.: EEG artifact removal-state-of-the-art and guidelines. J. Neural Eng. 12, 031001 (2015).  https://doi.org/10.1088/1741-2560/12/3/031001CrossRefGoogle Scholar
  25. 25.
    Jung, T.P., Makeig, S., Stensmo, M., Sejnowski, T.J.: Estimating alertness from the EEG power spectrum. IEEE Trans. Biomed. Eng. 44, 60–69 (1997)CrossRefGoogle Scholar
  26. 26.
    Kar, S., Bhagat, M., Routray, A.: EEG signal analysis for the assessment and quantification of driver’s fatigue. Transp. Res. Part F: Traffic Psychol. Behav. 13, 297–306 (2010)CrossRefGoogle Scholar
  27. 27.
    Shao, S.Y., Shen, K.Q., Ong, C.J., Wilder-Smith, E.P., Li, X.P.: Automatic EEG artifact removal: a weighted support vector machine approach with error correction. IEEE Trans. Biomed. Eng. 56, 336–344 (2009)CrossRefGoogle Scholar
  28. 28.
    Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).  https://doi.org/10.1016/j.jneumeth.2003.10.009CrossRefGoogle Scholar
  29. 29.
    Vigário, R.N.: Extraction of ocular artefacts from EEG using independent component analysis. Electroencephalogr. Clin. Neurophysiol. 103, 395–404 (1997).  https://doi.org/10.1016/S0013-4694(97)00042-8CrossRefGoogle Scholar
  30. 30.
    Zhukov, L., Weinstein, D., Johnson, C.: Independent component analysis for EEG source localization. IEEE Eng. Med. Biol. Mag. 19, 87–96 (2000).  https://doi.org/10.1109/51.844386CrossRefGoogle Scholar
  31. 31.
    Comon, P.: Independent component analysis, a new concept? Sig. Process. 36, 287–314 (1994)CrossRefGoogle Scholar
  32. 32.
    Hecht-Nielsen, R. : Theory of the backpropagation neural network. In: Neural Networks for Perception. Elsevier, pp. 65–93 (1992)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Houtan Jebelli
    • 1
  • Mohammad Mahdi Khalili
    • 1
  • SangHyun Lee
    • 1
  1. 1.University of MichiganAnn ArborUSA

Personalised recommendations