Advertisement

Novel features for intensive human activity recognition based on wearable and smartphone sensors

  • 32 Accesses

Abstract

On the lap of this modern era, human activity recognition (HAR) has been of great help in case of health monitoring and rehabilitation. Existing works mostly use one or more specific devices (with embedded sensors) including smartphones for activity recognition and most of the time the detected activities are coarse grained like sit or walk rather than detailed and intensive like sit carrying weight or walk carrying weight. But, intensity of activities reflects valuable insight about a person’s health and more importantly, physical exertion for performing those activities. Consequently, in this paper, we propose an intense activity recognition framework that combines features from smartphone accelerometer (available in almost every smartphone) and that from wearable heartrate sensor. We introduce a set of novel heartrate features that takes into consideration finer variation of heartrate as compared to the resting heartrate of an individual. The proposed framework forms an ensemble model based on different classifiers to address the challenge of usage behavior in terms of how the smartphone is carried. The stack generalization based ensemble model predicts the intensity of activity. We have implemented the framework and tested for a real dataset collected from four users. We have observed that our work is able to identify both static and dynamic intense activities with 96% accuracy, and even found to be better than state of the art techniques.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant unlimited access to the full article PDF.

US$ 39.95

Price includes VAT for USA

Subscribe to journal

Immediate online access to all issues from 2019. Subscription will auto renew annually.

US$ 199

This is the net price. Taxes to be calculated in checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Notes

  1. 1.

    https://play.google.com/store/apps/details?id=com.peterhohsy.gsensor_debug&hl=en_IN.

References

  1. Acharjee D, Mukherjee A, Mandal JK, Mukherjee N (2016) Activity recognition system using inbuilt sensors of smart mobile phone and minimizing feature vectors. Microsyst Technol 22(11):2715–2722

  2. Adi E, Yeh CI, Chou N, Lee MW, Lin YH (2016) Integrated wearable system for monitoring heart rate and step during physical activity. Mob Inf Syst 2016:1–10

  3. Altin C, Er O (2016) Comparison of different time and frequency domain feature extraction methods on elbow gesture’s emg. Eur J Interdiscip Stud 5:35

  4. Banerjee T, Keller JM, Skubic M, Stone E (2014) Day or night activity recognition from video using fuzzy clustering techniques. IEEE Trans Fuzzy Syst 22(3):483–493

  5. Choudhury T, Borriello G, Consolvo S, Haehnel D, Harrison B, Hemingway B, Hightower J, Klasnja P, Koscher K, LaMarca A, Landay JA, LeGrand L, Lester J, Rahimi A, Rea A, Wyatt D (2008) The mobile sensing platform: an embedded activity recognition system. IEEE Pervasive Comput 7(2):32–41

  6. Coskun D, Incel OD, Ozgovde A (2015) Phone position/placement detection using accelerometer: impact on activity recognition. In: 2015 IEEE 10th international conference on intelligent sensors, sensor networks and information processing (ISSNIP), pp 1–6

  7. Curone D, Tognetti A, Secco EL, Anania G, Carbonaro N, De Rossi D, Magenes G (2010) Heart rate and accelerometer data fusion for activity assessment of rescuers during emergency interventions. IEEE Trans Inf Technol Biomed 14(3):702–710

  8. Goldberger A, Amaral L, Glass L, Havlin S, M Hausdorg J, Ivanov P, G Mark R, E Mietus J, B Moody G, Peng CK, Stanley H, Physiobank P (2000) Components of a new research resource for complex physiologic signals. PhysioNet 101

  9. Gupta P, Dallas T (2014) Feature selection and activity recognition system using a single triaxial accelerometer. IEEE Trans Biomed Eng 61(6):1780–1786

  10. Janidarmian M, Roshan Fekr A, Radecka K, Zilic Z (2017) A comprehensive analysis on wearable acceleration sensors in human activity recognition. Sensors 17:529

  11. Lau SL, König I, David K, Parandian B, Carius-Düssel C, Schultz M (2010) Supporting patient monitoring using activity recognition with a smartphone. In: 2010 7th International symposium on wireless communication systems, pp 810–814

  12. LeeHeyone J, Oh KH, Do JC, Nam CW, Hwang DH, Lee SJ (2019) Angular velocity estimation of rotating plate using extended kalman filter with accelerometer bias model. Microsyst Technol 25:2855–2867

  13. Mehrang S, Pietila J, Korhonen I (2018) An activity recognition framework deploying the random forest classifier and a single optical heart rate monitoring and triaxial accelerometer wrist-band. Sensors (Basel) 18(2):613

  14. Nath S, Dey A, Pachal P, Sing JK, Sarkar SK (2019) Performance analysis of gas sensing device and corresponding iot framework in mines. Microsyst Technol. https://doi.org/10.1007/s00542-019-04621-x

  15. Park H, Dong S, Lee M, Youn I (2017) The role of heart-rate variability parameters in activity recognition and energy-expenditure estimation using wearable sensors. Sensors (Basel) 17(7):1698

  16. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, VanderPlas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2012) Scikit-learn: machine learning in python. arXiv:abs/1201.0490

  17. Powers D (2008) Evaluation: from precision, recall and f-factor to roc, informedness, markedness and correlation. Mach Learn Technol 2

  18. RoyChowdhury I, Saha J, Chowdhury C (2018) Detailed activity recognition with smartphones. In: 2018 5th International conference on emerging applications of information technology (EAIT), pp 1–4

  19. Saha J, Chowdhury C, Biswas S (2018a) Two phase ensemble classifier for smartphone based human activity recognition independent of hardware configuration and usage behaviour. Microsyst Technol 24(6):2737–2752

  20. Saha J, Chowdhury C, Chowdhury IR, Biswas S, Aslam N (2018b) An ensemble of condition based classifiers for device independent detailed human activity recognition using smartphones. Information 9:94

  21. Shany T, Redmond SJ, Narayanan MR, Lovell NH (2012) Sensors-based wearable systems for monitoring of human movement and falls. IEEE Sens J 12(3):658–670

  22. Tapia EM, Intille SS, Haskell W, Larson K, Wright J, King A, Friedman R (2007) Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: 2007 11th IEEE international symposium on wearable computers, pp 37–40

  23. Zhou ZH (2015) Ensemble learning. Springer, Boston, pp 411–416

Download references

Author information

Correspondence to Chandreyee Chowdhury.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Nandy, A., Saha, J. & Chowdhury, C. Novel features for intensive human activity recognition based on wearable and smartphone sensors. Microsyst Technol (2020). https://doi.org/10.1007/s00542-019-04738-z

Download citation