Abstract
Augmented reality is the process of rendering virtual objects in a scene such that the scene appears as mixed reality. Augmented reality-based health applications are gaining popularity due to improvement of processing and rendering techniques and open-source software. Several camera-based health vital extraction techniques are being developed over last several years. However, these techniques are limited time applications and are limited by the lighting, environment, and posture. In this work, we propose a unique cloud-based augmented reality health vital framework that extracts continuous pulse rate and pulse signal from user face image using cloud-based face detection, intensity normalization, facial contour tracking, atrial vascular network correlation on face, and temporal peak detection. The proposed method is validated in real time under controlled clinical environment and provides an overall accuracy of 91%. The system also augments continuous health information on the real camera feed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Léger, E., et.al.: Gesture-based registration correction using a mobile augmented reality image-guided neurosurgery system, IET (2018)
Mewes, A., et. al.: Concepts for augmented reality visualization to support needle guidance inside the MRI. Healthcare Technol. Lett. (2018)
Kausar, S., et. al.: Augmented reality based self treatment using acupressure. In: 2017 13th International Conference on Emerging Technologies (ICET) (2017)
Chen, L., et. al.: Real-time geometry-aware augmented reality in minimally invasive surgery. Healthcare Technol. Lett. 4(5), 163–167 (2017)
El-Hariri, H., et. al.: Augmented reality visualisation for orthopaedic surgical guidance with pre- and intra-operative multimodal image data fusion. Healthcare Technol. Lett. 5(5), 189–193 (2018)
Andersen, D., et. al.: Augmented visual instruction for surgical practice and training, IEEE (2018)
Monge, J., et. al.: Augmented reality and smart sensors for physical rehabilitation. In: 10th EPE (2018)
Ponce, B.A., et. al.: Telemedicine with mobile devices and augmented reality for early postoperative care. In: 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4411–4414 (2016)
Hsiao, K.-F., et.al.: Using sensor enabled augmented reality for healthcare (2012)
Basoglu, N.A., et.al.: Exploring adoption of augmented reality smart glasses: applications in the medical industry (2017)
Nishizaki, M..: Visualizing positive and negative affordances in infancy using mobile augmented reality, IEEE (2017)
Das, R., Shivakumar, K.B.: Augmented world: real time gesture based image processing tool with intel realsense™ technology. Int. J. Sign. Process. Image Process. Pattern Recog. 9(1), 63–84 (2016)
Gajbhe, M., et. al.: Performance augmentation of mobile devices using Cloud Computing (2015)
Bohez, S., et. al.: Mobile collaborative augmented reality using Cloudlets, IEEE (2013)
Tippaet, M.U.N., et al.: Augmented reality application for live transform over Cloud (2014)
Chen, Y., et.al.: Research about mobile AR system based on cloud computing, IEEE (2013)
Huang, B.-R., et.al.: Mobile augmented reality based on cloud computing, IEEE (2012)
Doukas, C., Maglogiannis, I.: Bringing IoT and cloud computing towards pervasive healthcare. Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS). https://doi.org/10.1109/IMIS.2012.26 (2012)
Nkosi, M.T., et.al.: Cloud computing for enhanced mobile health applications, IEEE (2011)
Toledo Peral, C.L., et.al.: An application for skin macules characterization based on a 3-stage image-processing algorithm for patients with diabetes (2018)
Singh, P., et.al.: Assessing the scar images to check medical treatment effectiveness, IEEE (2018)
Ostankovich, V., et.al: Towards human pulse rate estimation from face video: automatic component selection and comparison of blind source separation methods. Int. Conf. Intell. Syst. (IS) (2018)
Lewandowska, M., et. al.: Measuring pulse rate with a webcam – a non-contact method for evaluating cardiac activity. In: Proceedings of the Federated Conference on Computer Science and Information Systems, IEEE, pp. 405–410 (2011)
Declaration
“We have taken permission from competent authorities to use the images/data as given in the paper. In case of any dispute in the future, we shall be wholly responsible.”
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sirse, D., Gadgay, B., Das, R. (2020). CHAR: A Novel Cloud-Based Live Health Augmented Reality Framework. In: Reddy, V., Prasad, V., Wang, J., Reddy, K. (eds) Soft Computing and Signal Processing. ICSCSP 2019. Advances in Intelligent Systems and Computing, vol 1118. Springer, Singapore. https://doi.org/10.1007/978-981-15-2475-2_41
Download citation
DOI: https://doi.org/10.1007/978-981-15-2475-2_41
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2474-5
Online ISBN: 978-981-15-2475-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)