Abstract
Visual examination of volumetric medical data sets in virtual reality offers an intuitive and immersive experience. To further increase the realism of virtual environments, haptic feedback can be added. Such systems can help students to gain anatomical knowledge or surgeons to prepare for specific interventions. In this work, we present a method for direct visual and haptic rendering of volumetric medical data sets in virtual reality. This method guarantees a continuous force field and does not rely on any mesh or surface generation. Using a transfer function, we mapped computed tomography voxel intensities to color and opacity values and then visualized the anatomical structures using a direct volume rendering approach. A continuous haptic force field was generated based on a conservative potential field computed from the voxel opacities. In a path following experiment, we showed that the deviation from a reference path on the surface of the rendered anatomical structure decreased with the added haptic feedback. This system demonstrates an immersive exploration of anatomy and is a step towards patient-specific surgical planning and simulation.
B. Faludi and E. I. Zoller—These two authors contributed equally to this work.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Alaraj, A., et al.: Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Op. Neurosurg. 11(1), 52–58 (2015)
Andermatt, S., Pezold, S., Cattin, P.C.: Automated segmentation of multiple sclerosis lesions using multi-dimensional gated recurrent units. In: Crimi, A., Bakas, S., Kuijf, H., Menze, B., Reyes, M. (eds.) BrainLes 2017. LNCS, vol. 10670, pp. 31–42. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75238-9_3
Avila, R.S., Sobierajski, L.M.: A haptic interaction method for volume visualization. In: Proceedings of Seventh Annual IEEE Visualization 1996, pp. 197–204. IEEE (1996)
Conti, F., et al.: The CHAI libraries. In: Proceedings of Eurohaptics 2003, Dublin, Ireland, pp. 496–500 (2003)
García-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D.L., Collins, D.L.: Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med. Image Anal. 17(1), 1–18 (2013)
Laycock, S.D., Day, A.: A survey of haptic rendering techniques. In: Computer Graphics Forum, vol. 26, pp. 50–65. Wiley Online Library (2007)
Levoy, M.: Display of surfaces from volume data. IEEE Comput. Graph. Appl. 8(3), 29–37 (1988)
Levoy, M.: Efficient ray tracing of volume data. ACM Trans. Graph. (TOG) 9(3), 245–261 (1990)
Maloca, P.M., et al.: High-performance virtual reality volume rendering of original optical coherence tomography point-cloud data enhanced with real-time ray casting. Transl. Vis. Sci. Technol. 7(4), 2–2 (2018)
Pfandler, M., Lazarovici, M., Stefan, P., Wucherer, P., Weigl, M.: Virtual reality-based simulators for spine surgery: a systematic review. Spine J. 17(9), 1352–1363 (2017)
Rauter, G., Sigrist, R., Riener, R., Wolf, P.: Learning of temporal and spatial movement aspects: a comparison of four types of haptic control and concurrent visual feedback. IEEE Trans. Haptics 8(4), 421–433 (2015)
Ren, J., Patel, R.V., McIsaac, K.A., Guiraudon, G., Peters, T.M.: Dynamic 3-d virtual fixtures for minimally invasive beating heart procedures. IEEE Trans. Med. Imaging 27(8), 1061–1070 (2008)
Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 26(1), 43–49 (1978)
Wendland, H.: Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree. Adv. Comput. Math. 4(1), 389–396 (1995)
Yagel, R., Shi, Z.: Accelerating volume animation by space-leaping. In: Proceedings of the 4th conference on Visualization 1993, pp. 62–69. IEEE Computer Society (1993)
Acknowledgment
This work was financially supported by the Werner Siemens Foundation through the MIRACLE project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Faludi, B., Zoller, E.I., Gerig, N., Zam, A., Rauter, G., Cattin, P.C. (2019). Direct Visual and Haptic Volume Rendering of Medical Data Sets for an Immersive Exploration in Virtual Reality. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11768. Springer, Cham. https://doi.org/10.1007/978-3-030-32254-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-32254-0_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32253-3
Online ISBN: 978-3-030-32254-0
eBook Packages: Computer ScienceComputer Science (R0)
