Real-time microrobot posture recognition via biplane X-ray imaging system for external electromagnetic actuation
- 121 Downloads
As a promising intravascular therapeutic approach for autonomous catheterization, especially for thrombosis treatment, a microrobot or robotic catheter driven by an external electromagnetic actuation system has been recently investigated. However, the three-dimensional (3D) real-time position and orientation tracking of the microrobot remains a challenge for precise feedback control in clinical applications owing to the micro-size of the microrobot geometry in vessels, along with bifurcation and vulnerability. Therefore, in this paper, we propose a 3D posture recognition method for the unmanned microrobotic surgery driven by an external electromagnetic actuator system.
We propose a real-time position and spatial orientation tracking method for a millimeter-sized intravascular object or microrobot using a principal component analysis algorithm and an X-ray reconstruction. The suggested algorithm was implemented to an actual controllable wireless microrobot system composed of a bullet-shaped object, a biplane X-ray imaging device, and an electromagnetic actuation system. Numerical computations and experiments were conducted for the performance verification.
The experimental results showed a good performance of the implemented system with tracking errors less than 0.4 mm in position and 2° in orientation. The proposed tracking technique accomplished a fast processing time, ~ 0.125 ms/frame, and high-precision recognition of the micro-sized object.
Since the suggested method does not require pre-information of the object geometry in the human body for its 3D shape and position recognition, it could be applied to various elliptical shapes of the microrobot system with computation time efficacy and recognition accuracy. Hence, the method can be used for therapeutic millimeter- or micron-sized manipulator recognition in vascular, as well as implanted objects in the human body.
KeywordsReal-time 3D posture recognition Intravascular microrobot Electromagnetic actuation system Principal component analysis X-ray reconstruction
This research was supported by the Bio & Medical Technology Development Program of the National Research Foundation (NRF) funded by the Korean government (MSIT) (No. 2015M3D5A1065682). Seong Young Ko, for this work, was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2016R1D1A1B03933079).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflicts of interest.
This article does not contain any studies, performed by any of the authors, with human participants or animals.
This article does not contain patient data.
- 1.World Health Organization (2015) Noncommunicable diseases progress monitor 2015Google Scholar
- 2.Dharmarajah B (2015) European Congress of Radiology, p 1Google Scholar
- 3.Bashir R, Zack CJ, Zhao H, Comerota AJ, Bove AA (2014) Comparative outcomes of catheter-directed thrombolysis plus anticoagulation vs anticoagulation alone to treat lower-extremity proximal deep vein thrombosis. JAMA Intern Med 174:1494–1501. https://doi.org/10.1001/jamainternmed.2014.3415 CrossRefPubMedGoogle Scholar
- 5.Nelson BJ, Kaliakatsos IK, Abbott JJ (2010) Microrobots for minimally invasive medicine. Annu Rev Biomed Eng 12:55–85. https://doi.org/10.1146/annurev-bioeng-010510-103409 CrossRefPubMedGoogle Scholar
- 6.Belharet K, Folio D, Ferreira A (2010) 3D MRI-based predictive control of a ferromagnetic microrobot navigating in blood vessels. In: 2010 3rd IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, BioRob 2010, pp 808–813Google Scholar
- 9.Oh J, Park JO, Park S, Ko SY (2015) Image-based guidance system for intravascular microrobot: Fiducial marker-based registration using biplanar fluoroscopic images and CTA images. In: 2015 15th international conference on control, automation and systems (ICCAS), pp 919–922Google Scholar
- 10.Brattain LJ, Loschak PM, Tschabrunn CM, Anter E, Howe RD (2014) Instrument tracking and visualization for ultrasound catheter guided procedures. In: Augmented environments for computer-assisted interventions, pp 41–50Google Scholar
- 11.Saxena A, Driemeyer J, Ng AY (2009) Learning 3-d object orientation from images. In Robotics and Automation. In: ICRA’09. 2009 IEEE international conference on robotics and automation, pp 794–800Google Scholar
- 12.Nakabo Y, Ishi I, Ishikawa M (2002) 3D tracking using two high-speed vision systems. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, pp 360–365Google Scholar
- 17.Wijewickrema SNR, Paplinski AP (2005) Principal component analysis for the approximation of a fruit as an ellipse. In: Proceedings of 13th international conference central Europe on computer graphics, visualization and computer vision, pp 1–6Google Scholar
- 19.Nguyen PB, Park JO, Park S, Ko SY (2016) Medical micro-robot navigation using image processing-blood vessel extraction and X-ray calibration. In Proceedings of the IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics, vol 2016, pp 365–370Google Scholar
- 20.Richard Harltey AZ (2004) Multiple view geometry in computer vision. Cambridge University Press, CambridgeGoogle Scholar
- 22.Mönnich H, Stein D, Raczkowsky J, Wörn H (2010) An automatic and complete self-calibration method for robotic guided laser ablation. In: Proceedings of IEEE international conference on robotics and automation, pp 1086–1087Google Scholar
- 24.Stein D, Moennich H, Raczkowsky J, Woern H (2009) IEEE automatic and hand guided self-registration between a robot and an optical tracking system. In: ICAR 2009 14th international conference on advanced robotics, vol 1–2, pp 13–17Google Scholar