Advertisement

Smartphone-based respiratory rate estimation using photoplethysmographic imaging and discrete wavelet transform

  • Maha Alafeef
  • Mohammad FraiwanEmail author
Original Research

Abstract

Respiratory rate is a key vital sign that needs daily monitoring for hospital patients in general and those with respiratory conditions in particular. Moreover, it is a predictor of major heart conditions. Yet, studies have shown that it is widely neglected in hospital care due partially to the discomfort caused by the required equipment. In this paper, we propose a smartphone-based method for accurate measurement of the respiratory rate using the video of the skin surface as recorded by the smartphone built-in camera in the presence of the flash light. From this input, we use frame averaging to extract a photoplethysmographic signal of the red, green, and blue channels. Next, we apply discrete wavelet transform on the best representative photoplethysmographic signal for respiratory signal extraction and estimate the rate. Fifteen subjects participated in the testing and evaluation. The maximum absolute error was 0.67 breaths/min, whereas the root mean square error was 0.366 breaths/min. The average percentage error and average percentage accuracy using our approach were 2.2%, 97.8% respectively. A comparison with other works in the literature reveal a superior performance in terms of accuracy, ease of use, and cost.

Keywords

Smartphone Respiratory rate Photoplethysmographic Discrete wavelet transform 

Notes

Funding

This research was supported by Jordan University of Science and Technology, Deanship of Research award number 20180356.

References

  1. Alafeef M (2017) Smartphone-based photoplethysmographic imaging for heart rate monitoring. J Med Eng Technol 41(5):1–9.  https://doi.org/10.1080/03091902.2017.1299233 CrossRefGoogle Scholar
  2. Almond NE, Jones DP, Cooke ED (1988) Noninvasive measurement of the human peripheral circulation: relationship between laser doppler flowmeter and photoplethysmograph signals from the finger. Angiology 39(9):819–29CrossRefGoogle Scholar
  3. Bailon R, Sornmo L, Laguna P (2006) A robust method for ecg-based estimation of the respiratory frequency during stress testing. IEEE Trans Biomed Eng 53(7):1273–85.  https://doi.org/10.1109/tbme.2006.871888 CrossRefGoogle Scholar
  4. Barrett KE, Barman SM, Scott Boitano HLB (2019) Ganong’s review of medical physiology, 26th edn. McGraw-Hill, New YorkGoogle Scholar
  5. Bland JM, Altman D (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 327(8476):307–310.  https://doi.org/10.1016/S0140-6736(86)90837-8, http://www.sciencedirect.com/science/article/pii/S0140673686908378, originally published as Volume 1, Issue 8476
  6. Charlton PH, Birrenkott DA, Bonnici T, Pimentel MAF, Johnson AEW, Alastruey J, Tarassenko L, Watkinson PJ, Beale R, Clifton DA (2018) Breathing rate estimation from the electrocardiogram and photoplethysmogram: a review. IEEE Rev Biomed Eng 11:2–20.  https://doi.org/10.1109/RBME.2017.2763681 CrossRefGoogle Scholar
  7. Chen T, Chiu MC (2018) Smart technologies for assisting the life quality of persons in a mobile environment: a review. J Ambient Intell Humaniz Comput 9(2):319–327.  https://doi.org/10.1007/s12652-016-0396-x CrossRefGoogle Scholar
  8. Cretikos MA, Bellomo R, Hillman K, Chen J, Finfer S, Flabouris A (2008) Respiratory rate: the neglected vital sign. Med J Aust 188(11):657–9Google Scholar
  9. Daubechies I (1990) The wavelet transform, time-frequency localization and signal analysis. IEEE Trans Inf Theory 36(5):961–1005.  https://doi.org/10.1109/18.57199 MathSciNetCrossRefzbMATHGoogle Scholar
  10. Giurgiutiu V (2014) Chapter 14-signal processing and pattern recognition for structural health monitoring with pwas transducers. In: Giurgiutiu V (ed) Structural Health Monitoring with Piezoelectric Wafer Active Sensors (2nd Edn), second edition edn, Academic Press, Oxford, pp 807 – 862,  https://doi.org/10.1016/B978-0-12-418691-0.00014-9, http://www.sciencedirect.com/science/article/pii/B9780124186910000149
  11. Gravelyn TR, Weg JG (1980) Respiratory rate as an indicator of acute respiratory dysfunction. JAMA 244(10):1123–5CrossRefGoogle Scholar
  12. Hassan M, Malik A, Fofi D, Saad N, Karasfi B, Ali Y, Meriaudeau F (2017) Heart rate estimation using facial video: a review. Biomed Signal Process Control 38:346–360.  https://doi.org/10.1016/j.bspc.2017.07.004, http://www.sciencedirect.com/science/article/pii/S1746809417301362
  13. iWorkx (2018a) The iworx 214 and labscribe v2.0 tutorial. http://www.iworx.com/wp-content/uploads/2013/02/Tutorial-LS2.pdf. Accessed 26 May 2018
  14. iWorkx (2018b) Labscribe. https://www.iworx.com/research/software/labscribe/. Accessed 26 May 2018
  15. Jamil U, Sajid A, Hussain M, Aldabbas O, Alam A, Shafiq MU (2019) Melanoma segmentation using bio-medical image analysis for smarter mobile healthcare. J Ambient Intell Humaniz Comput.  https://doi.org/10.1007/s12652-019-01218-0 Google Scholar
  16. Kao Y, Chao PC, Wey C (2019) Design and validation of a new ppg module to acquire high-quality physiological signals for high-accuracy biomedical sensing. IEEE J Sel Top Quantum Electron 25(1):1–10.  https://doi.org/10.1109/JSTQE.2018.2871604 CrossRefGoogle Scholar
  17. Karlen W, Garde A, Myers D, Scheffer C, Ansermino JM, Dumont GA (2015) Estimation of respiratory rate from photoplethysmographic imaging videos compared to pulse oximetry. IEEE J Biomed Health Inform 19(4):1331–8.  https://doi.org/10.1109/jbhi.2015.2429746 CrossRefGoogle Scholar
  18. Leonard PA, Clifton D, Addison PS, Watson JN, Beattie T (2006) An automated algorithm for determining respiratory rate by photoplethysmogram in children. Acta Paediatr 95(9):1124–8.  https://doi.org/10.1080/08035250600612280 CrossRefGoogle Scholar
  19. Li X (2016) Using mobile phone sensors to detect rapid respiratory rate in the diagnosis of pneumonia. Int J Eng Technol 8(4):293–296.  https://doi.org/10.7763/ijet.2016.v8.900 CrossRefGoogle Scholar
  20. Lin YD, Ho HY, Tsai CC, Wang SF, Lin KP, Chang HH (2013) Simultaneous heartbeat and respiration monitoring using ppg and riiv on a smartphone device. Biomed Eng Appl Basis Commun 25:  https://doi.org/10.4015/S1016237213500415, https://www.worldscientific.com/doi/abs/10.4015/S1016237213500415
  21. Lin YD, Chien YH, Chen YS (2017) Wavelet-based embedded algorithm for respiratory rate estimation from ppg signal. Biomed Signal Process Control 36:138–145.  https://doi.org/10.1016/j.bspc.2017.03.009, http://www.sciencedirect.com/science/article/pii/S1746809417300599
  22. Malasinghe LP, Ramzan N, Dahal K (2019) Remote patient monitoring: a comprehensive study. J Ambient Intell Humaniz Comput 10(1):57–76.  https://doi.org/10.1007/s12652-017-0598-x CrossRefGoogle Scholar
  23. MathWorks (2018) Matlab. https://www.mathworks.com/products/matlab.html. Accessed 26 May 2018
  24. Meredith DJ, Clifton D, Charlton P, Brooks J, Pugh CW, Tarassenko L (2012) Photoplethysmographic derivation of respiratory rate: a review of relevant physiology. J Med Eng Technol 36(1):1–7.  https://doi.org/10.3109/03091902.2011.638965, http://www.ncbi.nlm.nih.gov/pubmed/22185462
  25. Mitali R, Prabhu S (2015) A novel algorithm to obtain respiratory rate from the ppg signal. Int J Comput Appl 126(15):9–12.  https://doi.org/10.5120/ijca2015906263 Google Scholar
  26. Moraes JL, Rocha MX, Vasconcelos GG, Vasconcelos Filho JE, De Albuquerque VHC, Alexandria AR (2018) Advances in photopletysmography signal analysis for biomedical applications. Sensors 18(6),  https://doi.org/10.3390/s18061894, http://www.mdpi.com/1424-8220/18/6/1894
  27. Murthy VS, Ramamoorthy S, Srinivasan N, Rajagopal S, Rao MM (2001) Analysis of photoplethysmographic signals of cardiovascular patients. In: Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol 3, pp 2204–2207,  https://doi.org/10.1109/IEMBS.2001.1017209
  28. Nie R, He M, Cao J, Zhou D, Liang Z (2018) Pulse coupled neural network based mri image enhancement using classical visual receptive field for smarter mobile healthcare. J Ambient Intell Humaniz Comput.  https://doi.org/10.1007/s12652-018-1098-3 Google Scholar
  29. Pirhonen M, Peltokangas M, Vehkaoja A (2018) Acquiring respiration rate from photoplethysmographic signal by recursive bayesian tracking of intrinsic modes in time-frequency spectra. Sensors (Basel) 18(6):1693.  https://doi.org/10.3390/s18061693
  30. Ps KB, Jatti A (2015) Respiration and heart rate monitoring from photoplethysmograph signal. Adv Sig Process 3(1):8–16.  https://doi.org/10.13189/asp.2015.030102 Google Scholar
  31. Sanyal S, Nundy KK (2018) Algorithms for monitoring heart rate and respiratory rate from the video of a user’s face. IEEE J Transl Eng Health Med 6:1–11.  https://doi.org/10.1109/JTEHM.2018.2818687 CrossRefGoogle Scholar
  32. Schroeder CA, Smith LJ (2011) Respiratory rates and arterial blood-gas tensions in healthy rabbits given buprenorphine, butorphanol, midazolam, or their combinations. Journal of the American Association for Laboratory Animal Science : JAALAS 50(2):205–211, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3061421/
  33. Singh M (2014) Introduction to Biomedical Instrumentation, 2nd edn. PHI LearningGoogle Scholar
  34. Soltani S (2002) On the use of the wavelet decomposition for time series prediction. Neurocomputing 48(1):267–277.  https://doi.org/10.1016/S0925-2312(01)00648-8, http://www.sciencedirect.com/science/article/pii/S0925231201006488
  35. Tabei F, Kumar R, Phan TN, McManus DD, Chong JW (2018) A novel personalized motion and noise artifact (mna) detection method for smartphone photoplethysmograph (ppg) signals. IEEE Access 6:60498–60512.  https://doi.org/10.1109/ACCESS.2018.2875873 CrossRefGoogle Scholar
  36. Tambe SB, Gajre SS (2018) Cluster-based real-time analysis of mobile healthcare application for prediction of physiological data. J Ambient Intell Humaniz Comput 9(2):429–445.  https://doi.org/10.1007/s12652-017-0562-9 CrossRefGoogle Scholar
  37. Ubeyli ED, Guler I (2005) Feature extraction from doppler ultrasound signals for automated diagnostic systems. Comput Biol Med 35(9):735–64.  https://doi.org/10.1016/j.compbiomed.2004.06.006 CrossRefGoogle Scholar
  38. Unser M, Aldroubi A (1996) A review of wavelets in biomedical applications. Proc IEEE 84(4):626–638.  https://doi.org/10.1109/5.488704 CrossRefGoogle Scholar
  39. Webster JG (1997) Design of pulse oximeters, 1st edn. Institute of Physics Publishing, http://www.crcnetbase.com/isbn/9780750304672

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of BioengineeringUniversity of Illinois Urbana-ChampaignUrbanaUSA
  2. 2.Department of Biomedical EngineeringJordan University of Science and TechnologyIrbidJordan
  3. 3.Department of Computer EngineeringJordan University of Science and TechnologyIrbidJordan

Personalised recommendations