Coronary Motion Modelling for Augmented Reality Guidance of Endoscopic Coronary Artery Bypass
The overall aim of our project is to guide totally endoscopic coronary artery bypass. This requires construction of a 4D preoperative model of the coronary arteries and myocardium. The model must be aligned with the endoscopic view of the patient’s beating heart and presented to the surgeon using augmented reality. We propose that the model can be constructed from coronary CT. Segmentation can be performed for one phase of the cardiac cycle only and propagated to the others using non-rigid registration. We have compared the location of the coronaries produced by this method to hand segmentation.
Registration of the model to the endoscopic view of the patient is achieved in two phases. Temporal registration is performed by identification of corresponding motion between model and video. Then we calculate photo-consistency between the two da Vinci endoscope views and average over the frames of the motion model. This has been shown to improve the shape of the cost function. Phantom results are presented.
The model can then be transformed to the calibrated endoscope view and overlaid using two video mixers.
KeywordsAugmented Reality Camera Calibration Beating Heart Feature Tracking Endoscopic View
Unable to display preview. Download preview PDF.
- 1.Dogan, S., Aybek, T., Andressen, E., Byhahn, C., Mierdl, S., Westphal, K., Matheis, G., Moritz, A., Wimmer-Greinecker, G.: Totally endoscopic coronary artery bypass grafting on cardiopulmonary bypass with robotically enhanced telemanipulation: Report of forty-five cases. J. Thorac. Cardiovasc. Surg. 123, 1125–1131 (2002)CrossRefGoogle Scholar
- 5.Chandrashekara, R., Mohiaddin, R., Razavi, R., Rueckert, R.: Nonrigid image registration with subdivision lattices: Application to cardiac mr image analysis. In: Taylor, C., Colchester, A. (eds.) MICCAI 1999. LNCS, vol. 1679, pp. 335–342. Springer, Heidelberg (1999)Google Scholar
- 6.Perperidis, D., Mohiaddin, R., Edwards, P., Rueckert, D.: Hill: Segmentation of cardiac MR and CT image sequences using model-based registration of a 4D statistical model. In: Proc. SPIE Medical Imaging 2007, vol. 6512 (2007)Google Scholar
- 11.Bouguet, J.: Camera calibration toolbox for matlab (2007), http://www.vision.caltech.edu/bouguetj