Structure from Motion Based Approaches to 3D Reconstruction in Minimal Invasive Laparoscopy
The present article proposes a Structure from Motion (SfM) methodology to recover the liver surface from endoscopic video sequences. Features from an imaged liver are extracted and tracked for the complete sequence to generate a correspondences lookup table (C-LUT) between all frames. A keyframe selection code extracts two frames, from which the relative pose of the camera is reconstructed using a MSAC-based 5-Point algorithm. Techniques such as an optimal triangulation method and a PnP resection algorithm are also used to obtain an initial 3D surface of the liver. A global Bundle Adjustment step refines the initial reconstruction. Proper parametrization and conditioning of these techniques are compared and evaluated under typical laparoscopic uncertainties arising from patient, illumination, reflections, image quality and organs’ location among others. A robotic system and grid patterns are used to provide camera pose and surface ground truth data respectively.
KeywordsLaparoscopy Endoscopy Structure from Motion Image Reconstruction Computer Aided Diagnosis Epipolar geometry Optimal triangulation PnP problem Bundle Adjustment Rigid Registration
Unable to display preview. Download preview PDF.
- 1.Jones, D., Wu, J., Soper, N.: Laparoscopic surgery: principles and procedures. Marcel Dekker Inc., New York (2004)Google Scholar
- 10.Rabaud, V.: Structure from motion toolbox, http://vision.ucsd.edu/~vrabaud/toolbox/
- 11.von Oehsen, U., Marcinczak, J.M., Mármol Vélez, A., Grigat, R.-R.: Key-frame selection for robust pose estimation in laparoscopic videos. In: Medical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling, New York (2012)Google Scholar
- 12.Bern, M., Eppstein, D., Gilbert, J.: Provably Good Mesh Generation. J. Comput. Syst. Sci. 48, 231–241 (1990)Google Scholar
- 13.Camera calibration toolbox for Matlab, http://www.vision.caltech.edu/bouguetj/calib_doc/