Abstract
With the surging significance of personal health care, driver’s physiological state is no longer negligible nowadays. Among all the indicators of health state in human, heart rate (HR) is one of the most cardinal indicators. The commonly used HR measurement is contact-type, might result in driver’s distraction and discomfort in the vehicle applications. To cope with this problem, remote photoplethysmography (rPPG) is utilized to monitor HR at a distance via a web camera. Nevertheless, the rPPG is not without its flaw. The main concern of the rPPG technique is the potential not-robustness result from the arbitrary motion. Consequently, the contribution of this paper is to conquer the motion noise when the car is driving and the driver’s health state is well monitored to enhance the public safety. The proposed algorithm is investigated in not only the indoor environment but as well the outdoor driving, which contains much more unpredictable motion. With k-nearest neighbor (kNN) classifier on chrominance-based features, the mean square error can be reduced from 30.6 to 2.79 bpm, approaching the medical instrument level. The proposed method can be applied to human improving driving safety for Advanced Driver Assistance Systems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Hertzman, A.B.: Photoelectric plethysmography of the fingers and toes in man. Exp. Biol. Med. 37, 290–292 (1937)
Zijlstra, W., Buursma, A.: Spectrophotometry of hemoglobin: absorption spectra of bovine oxyhemoglobin, deoxyhemoglobin, carboxyhemoglobin, and methemoglobin. Comp. Biochem. Physiol. B 118, 743–749 (1997)
Cheang, P.Y.S., Smith, P.R.: An overview of non-contact photoplethysmography. Electron. Syst. Control Div. Res, 57–59 (2003)
Allen, J: Photoplethysmography and its application in clinical physiological measurement. Physiol. Meas., 28, R1 (2007)
Poh, M.-Z., McDuff, D.J., Picard, R.W.: Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18, 10762–10774 (2010)
Lewandowska, M., Ruminski, J., Kocejko, T., Nowak, J.: Measuring pulse rate with a webcam—a non-contact method for evaluating cardiac activity. In: (IEEE) Proceedings of Federated Conference Computer Science and Information Systems, pp. 405–410 (2011)
Holton, B.D., Mannapperuma, K., Lesniewski, P.J., Thomas, J.C.: Signal recovery in imaging photoplethysmography. Physiol. Meas. 34, 1499–1511 (2013)
Wedekind, D., Trumpp, A., Andreotti, F., Gaetjen, F., Rasche, S., Matschke, K., et al.: Assessment of source separation techniques to extract vital parameters from videos. In: 23rd European Signal Processing Conference, pp. 434–438 (2015)
Mannapperuma, K., Holton, B.D., Lesniewski, P.J., Thomas, J.C.: Performance limits of ICA-based heart rate identification techniques in imaging photoplethysmography. Physiol. Meas. 36(1), 67–83 (2015)
Wang, W.: Exploiting spatial redundancy of image sensor for motion robust rPPG. IEEE Trans. Biomed. Eng. 62(2), 415–425 (2015)
Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: Bigun, J., Gustavsson, T. (eds.) SCIA 2003. LNCS, vol. 2749, pp. 363–370. Springer, Heidelberg (2003). doi:10.1007/3-540-45103-X_50
Monkaresi, H., Calvo, R.A., Yan, H.: A machine learning approach to improve contactless heart rate monitoring using a webcam. IEEE J. Biomed. Health Inf. 13, 1153–1160 (2014)
de Haan, G., Jeanne, V.: Robust pulse rate from chrominance-based rPPG IEEE Trans. Biomed. Eng. 60, 2878–2886 (2013)
de Haan, G., van Leest, A.: Improved motion robustness of remote-PPG by using the blood volume pulse signature. Physiological measurement 35(9), 1913–1926 (2014)
van Gastel, M.: Motion robust remote-PPG in infrared. IEEE Trans. Biomed. Eng. 62(5), 1425–1433 (2015)
Huang, R.Y., Dung, L.R.: A motion-robust contactless photoplethysmography using chrominance and adaptive filtering, 1–4 (2015)
Hsu, Y.: Learning-based heart rate detection from remote photoplethysmography features. In: Proceedings of IEEE International Conference Acoustics Speech Signal Processing, pp. 4433–4437 (2014)
SCOSCHE, Rhythm+ (2015). http://www.scosche.com/rhythm-plus-heart-rate-monitor-armband
Dlib library, imaging processing toolbox (2016), http://dlib.net/imaging.html
Aha, D., Kibler, D., Albert, M.: Instance-based learning algorithms. Mach. Learn. 6(1), 37–66 (1991)
Acknowledgement
This work was supported by Ministry of Science and Technology under Grand no. MOST105-2622-E-009-013-CC2.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wu, BF., Chu, YW., Huang, PW., Chung, ML., Lin, TM. (2017). A Motion Robust Remote-PPG Approach to Driver’s Health State Monitoring. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10116. Springer, Cham. https://doi.org/10.1007/978-3-319-54407-6_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-54407-6_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54406-9
Online ISBN: 978-3-319-54407-6
eBook Packages: Computer ScienceComputer Science (R0)