Direct Visual and Haptic Volume Rendering of Medical Data Sets for an Immersive Exploration in Virtual Reality
Visual examination of volumetric medical data sets in virtual reality offers an intuitive and immersive experience. To further increase the realism of virtual environments, haptic feedback can be added. Such systems can help students to gain anatomical knowledge or surgeons to prepare for specific interventions. In this work, we present a method for direct visual and haptic rendering of volumetric medical data sets in virtual reality. This method guarantees a continuous force field and does not rely on any mesh or surface generation. Using a transfer function, we mapped computed tomography voxel intensities to color and opacity values and then visualized the anatomical structures using a direct volume rendering approach. A continuous haptic force field was generated based on a conservative potential field computed from the voxel opacities. In a path following experiment, we showed that the deviation from a reference path on the surface of the rendered anatomical structure decreased with the added haptic feedback. This system demonstrates an immersive exploration of anatomy and is a step towards patient-specific surgical planning and simulation.
KeywordsHaptic rendering CT Human-robot interaction Medical simulation Surgical planning
This work was financially supported by the Werner Siemens Foundation through the MIRACLE project.
- 1.Alaraj, A., et al.: Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Op. Neurosurg. 11(1), 52–58 (2015)Google Scholar
- 2.Andermatt, S., Pezold, S., Cattin, P.C.: Automated segmentation of multiple sclerosis lesions using multi-dimensional gated recurrent units. In: Crimi, A., Bakas, S., Kuijf, H., Menze, B., Reyes, M. (eds.) BrainLes 2017. LNCS, vol. 10670, pp. 31–42. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75238-9_3CrossRefGoogle Scholar
- 3.Avila, R.S., Sobierajski, L.M.: A haptic interaction method for volume visualization. In: Proceedings of Seventh Annual IEEE Visualization 1996, pp. 197–204. IEEE (1996)Google Scholar
- 4.Conti, F., et al.: The CHAI libraries. In: Proceedings of Eurohaptics 2003, Dublin, Ireland, pp. 496–500 (2003)Google Scholar
- 6.Laycock, S.D., Day, A.: A survey of haptic rendering techniques. In: Computer Graphics Forum, vol. 26, pp. 50–65. Wiley Online Library (2007)Google Scholar
- 15.Yagel, R., Shi, Z.: Accelerating volume animation by space-leaping. In: Proceedings of the 4th conference on Visualization 1993, pp. 62–69. IEEE Computer Society (1993)Google Scholar