A Motion Robust Remote-PPG Approach to Driver’s Health State Monitoring

  • Bing-Fei Wu
  • Yun-Wei ChuEmail author
  • Po-Wei Huang
  • Meng-Liang Chung
  • Tzu-Min Lin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10116)


With the surging significance of personal health care, driver’s physiological state is no longer negligible nowadays. Among all the indicators of health state in human, heart rate (HR) is one of the most cardinal indicators. The commonly used HR measurement is contact-type, might result in driver’s distraction and discomfort in the vehicle applications. To cope with this problem, remote photoplethysmography (rPPG) is utilized to monitor HR at a distance via a web camera. Nevertheless, the rPPG is not without its flaw. The main concern of the rPPG technique is the potential not-robustness result from the arbitrary motion. Consequently, the contribution of this paper is to conquer the motion noise when the car is driving and the driver’s health state is well monitored to enhance the public safety. The proposed algorithm is investigated in not only the indoor environment but as well the outdoor driving, which contains much more unpredictable motion. With k-nearest neighbor (kNN) classifier on chrominance-based features, the mean square error can be reduced from 30.6 to 2.79 bpm, approaching the medical instrument level. The proposed method can be applied to human improving driving safety for Advanced Driver Assistance Systems.


Root Mean Square Error Mean Square Error Independent Component Analysis Empirical Mode Decomposition Face Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was supported by Ministry of Science and Technology under Grand no. MOST105-2622-E-009-013-CC2.


  1. 1.
    Hertzman, A.B.: Photoelectric plethysmography of the fingers and toes in man. Exp. Biol. Med. 37, 290–292 (1937)CrossRefGoogle Scholar
  2. 2.
    Zijlstra, W., Buursma, A.: Spectrophotometry of hemoglobin: absorption spectra of bovine oxyhemoglobin, deoxyhemoglobin, carboxyhemoglobin, and methemoglobin. Comp. Biochem. Physiol. B 118, 743–749 (1997)CrossRefGoogle Scholar
  3. 3.
    Cheang, P.Y.S., Smith, P.R.: An overview of non-contact photoplethysmography. Electron. Syst. Control Div. Res, 57–59 (2003)Google Scholar
  4. 4.
    Allen, J: Photoplethysmography and its application in clinical physiological measurement. Physiol. Meas., 28, R1 (2007)Google Scholar
  5. 5.
    Poh, M.-Z., McDuff, D.J., Picard, R.W.: Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18, 10762–10774 (2010)CrossRefGoogle Scholar
  6. 6.
    Lewandowska, M., Ruminski, J., Kocejko, T., Nowak, J.: Measuring pulse rate with a webcam—a non-contact method for evaluating cardiac activity. In: (IEEE) Proceedings of Federated Conference Computer Science and Information Systems, pp. 405–410 (2011)Google Scholar
  7. 7.
    Holton, B.D., Mannapperuma, K., Lesniewski, P.J., Thomas, J.C.: Signal recovery in imaging photoplethysmography. Physiol. Meas. 34, 1499–1511 (2013)CrossRefGoogle Scholar
  8. 8.
    Wedekind, D., Trumpp, A., Andreotti, F., Gaetjen, F., Rasche, S., Matschke, K., et al.: Assessment of source separation techniques to extract vital parameters from videos. In: 23rd European Signal Processing Conference, pp. 434–438 (2015)Google Scholar
  9. 9.
    Mannapperuma, K., Holton, B.D., Lesniewski, P.J., Thomas, J.C.: Performance limits of ICA-based heart rate identification techniques in imaging photoplethysmography. Physiol. Meas. 36(1), 67–83 (2015)CrossRefGoogle Scholar
  10. 10.
    Wang, W.: Exploiting spatial redundancy of image sensor for motion robust rPPG. IEEE Trans. Biomed. Eng. 62(2), 415–425 (2015)CrossRefGoogle Scholar
  11. 11.
    Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: Bigun, J., Gustavsson, T. (eds.) SCIA 2003. LNCS, vol. 2749, pp. 363–370. Springer, Heidelberg (2003). doi: 10.1007/3-540-45103-X_50 CrossRefGoogle Scholar
  12. 12.
    Monkaresi, H., Calvo, R.A., Yan, H.: A machine learning approach to improve contactless heart rate monitoring using a webcam. IEEE J. Biomed. Health Inf. 13, 1153–1160 (2014)CrossRefGoogle Scholar
  13. 13.
    de Haan, G., Jeanne, V.: Robust pulse rate from chrominance-based rPPG IEEE Trans. Biomed. Eng. 60, 2878–2886 (2013)Google Scholar
  14. 14.
    de Haan, G., van Leest, A.: Improved motion robustness of remote-PPG by using the blood volume pulse signature. Physiological measurement 35(9), 1913–1926 (2014)CrossRefGoogle Scholar
  15. 15.
    van Gastel, M.: Motion robust remote-PPG in infrared. IEEE Trans. Biomed. Eng. 62(5), 1425–1433 (2015)CrossRefGoogle Scholar
  16. 16.
    Huang, R.Y., Dung, L.R.: A motion-robust contactless photoplethysmography using chrominance and adaptive filtering, 1–4 (2015)Google Scholar
  17. 17.
    Hsu, Y.: Learning-based heart rate detection from remote photoplethysmography features. In: Proceedings of IEEE International Conference Acoustics Speech Signal Processing, pp. 4433–4437 (2014)Google Scholar
  18. 18.
  19. 19.
    Dlib library, imaging processing toolbox (2016),
  20. 20.
    Aha, D., Kibler, D., Albert, M.: Instance-based learning algorithms. Mach. Learn. 6(1), 37–66 (1991)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Bing-Fei Wu
    • 1
  • Yun-Wei Chu
    • 1
    Email author
  • Po-Wei Huang
    • 2
  • Meng-Liang Chung
    • 1
  • Tzu-Min Lin
    • 3
  1. 1.Institute of Electrical Control EngineeringNational Chiao Tung UniversityHsinchuTaiwan
  2. 2.Department of Electrical and Computer EngineeringNational Chiao Tung UniversityHsinchuTaiwan
  3. 3.Division of Rheumatology, Immunology and Allergy, Department of Internal MedicineTaipei Medical University HospitalTaipeiTaiwan

Personalised recommendations