Abstract
We describe a software defined surgical microscope platform for developing AI applications in surgical training. The microscope has facility to merge and render multiple streams of live and/or stored video, and has the ability to enhance, annotate, and measure using a 3D position and orientation tracking forceps. A configuration mechanism controls the zoom, focus and disparity of the stereo view and stores surgeon and procedure specific configuration. The system tracks the surgical motion and analyses its quality in realtime. Several measures of quality of motion are described and can be used as a platform to develop AI applications in surgical training.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agur, A.M.R., Lee, M.J.: Grant’sAtlas ofAnatomy, 10th edn. Lippincott Williams and Wilkins (1999)
Desmurget, M., Pelisson, D., Rossetti, Y., Prablanc, C.: From eye to hand: planning goal directed movements. Neurosci. Bio. Behav. Rev. 22, 761–788 (1998)
Crawford, J.D., Medendorp, W.P., Marotta, J.J.: Spatialtransformations for eye-hand coordination. J. Neurophysiol. 92, 10–19 (2004)
Ballard, D.H., Hayhoe, M.M., Li, F.: Hand-eye coordination during sequential tasks. Philos. Trans. R Soc. Lond. B Biol. Sci. 337, 331–338 (1992)
Smeets, J.B., Hayhoe, M.M., Ballard, D.H.: Goal-directed arm movements change eye-head coordination. Exp. Brain Res. 109, 434–440 (1996)
Flanagan, J.R., Johansson, R.S.: Action plans used in action observation. Nature 424, 769–771 (2003)
Hayhoe, M., Ballard, D.: Eye movements in natural behavior. Trends in Cognitive Sciences 9, 188–194 (2005)
Ware, C., Arthur, K., Booth, K.S.: Fish tank virtual reality. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, April 24-29, pp. 37–42 (1993)
Rappel, J.K., et al.: Assessing suturing techniques using a virtual reality surgical simulator. Microsurgery 30(6), 479–486 (2010)
A.C., et al.: Virtual- reality Model for Grading Surgical-dexterity in Suture Placement and customization of needle shape. In: 59th Annual Meeting of the American Society for Surgery of the Hand, USA (2004)
Lahiri, A., et al.: Virtual- reality Model for Grading Surgical-dexterity in Suture Placement and Customization of Needle Shape. In: 7th NUH-NUS ASM New Frontiers in Medicine, Singapore (2003)
Datta, V., et al.: Motion analysis in the assessment of surgical skill. Computer Methods in Biomechanics and Biomedical Engineering 4(6), 515–523 (2001)
Datta, V., et al.: The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. Journal of the American College of Surgeons 193(5), 479–485 (2001)
Starkes, J.L., Payk, I., Hodges, N.J.: Developing a standardized test for the assessment of suturing skill in novice microsurgeons. Microsurgery 18(1), 19–22 (1998)
Macmillan, A.I., Cuschieri, A.: Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. The American Journal of Surgery 177(3), 274–277 (1999)
Egi, H., et al.: Objective assessment of endoscopic surgical skills by analyzing direction-dependent dexterity using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD). Surgery Today 38(8), 705–710 (2008)
Mason, J.D., et al.: Is motion analysis a valid tool for assessing laparoscopic skill? Surgical Endoscopy, 1–10 (2012)
Reiley, C.E., Hager, G.D.: Task versus subtask surgical skill evaluation of robotic minimally invasive surgery. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009, Part I. LNCS, vol. 5761, pp. 435–442. Springer, Heidelberg (2009)
Rosen, J., et al.: Task decomposition of laparoscopic surgery for objective evaluation of surgical residents’ learning curve using hidden Markov model. Computer Aided Surgery 7(1), 49–61 (2002)
Pagador, J.B., et al.: Decomposition and analysis of laparoscopic suturing task using tool-motion analysis (TMA): improving the objective assessment. International Journal of Computer Assisted Radiology and Surgery 7(2), 305–313 (2012)
Cao, C., et al.: Hierarchical decomposition of laparoscopic procedures. Studies in Health Technology and Informatics, 83–89 (1999)
Chen, J., Yeasin, M., Sharma, R.: Visual modelling and evaluation of surgical skill. Pattern Analysis & Applications 6(1), 1–11 (2003)
Harwell, R.C., Ferguson, R.L.: Physiologic tremor and microsurgery. Microsurgery 4(3), 187–192 (1983)
Elble, R.J., Koller, W.C.: Tremor. Johns Hopkins University Press (1990)
Rappel, J.K., et al.: Tremor Profiling Using Digital Microsurgical Pre-Trainer. In: The Third Asian Pacific Conference on Biomechanics. The Japan Society of Mechanical Engineers, Japan (2007)
Huang, N.E., et al.: The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London 454, 903–995 (1998)
Schenker, P.S., et al.: Development of a telemanipulator for dexterity enhanced microsurgery. In: Proc. 2nd Intl. Symp. Med. Robot. Comput. Assist. Surg. (1995)
Riviere, C., Khosla, P.: Accuracy in positioning of handheld instruments. In: Proceedings of the 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Bridging Disciplines for Biomedicine. IEEE (1996)
Hotraphinyo, L.F., Riviere, C.N.: Three-dimensional accuracy assessment of eye surgeons. In: Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE (2001)
Moraes, R.M., Machado, L.S.: Psychomotor Skills Assessment in Medical Training Based on Virtual Reality Using a Weighted Possibilistic Approach. Knowledge-Based Systems (in press, 2014)
De Moraes, R.M., dos Santos Machado, L.: A New Class of Assessment Methodologies in Medical Training Based on Combining Classifiers. In: 12th Safety, Health and Environment World Congress, San Paulo, Brazil, July 22-25 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Rappel, J.K., Lahiri, A., Chee Leong, T. (2014). A Digital Stereo Microscope Platform for Microsurgery Training. In: Cheng, SM., Day, MY. (eds) Technologies and Applications of Artificial Intelligence. TAAI 2014. Lecture Notes in Computer Science(), vol 8916. Springer, Cham. https://doi.org/10.1007/978-3-319-13987-6_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-13987-6_28
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13986-9
Online ISBN: 978-3-319-13987-6
eBook Packages: Computer ScienceComputer Science (R0)