Construct validity of a video-tracking system based on orthogonal cameras approach for objective assessment of laparoscopic skills
This study was aimed to establish the construct validity of a video-tracking system based on orthogonal cameras approach for assessment of laparoscopic psychomotor skills in training environments.
The camera-tracking system consists of two webcams placed in orthogonal configuration at a distance of 13.5 cm. The orthogonal cameras employ a color segmentation algorithm to register the 3D motions of the laparoscopic instruments using colored tapes placed on the distal end. For construct validity, 31 participants (4 experts and 27 residents) performed three training tasks in a laparoscopic box trainer with the built-in orthogonal cameras system. Eleven motion-related parameters were used to evaluate their performance. Statistical analysis was performed, and results between two groups were compared using a Mann–Whitney U-test.
Construct validity results showed statistical differences in almost all motion-related parameters for assessment of laparoscopic technical skills. Results demonstrated that the orthogonal video-based tracking system was able to differentiate laparoscopic experience between experts and trainees surgeons.
The orthogonal cameras system was successfully validated in a laparoscopic box trainer. This video-based tracking system was able to distinguish performance between experts and trainees surgeons, showing its potential as a reliable tool to assess laparoscopic psychomotor skills. The orthogonal cameras allow incorporating the advantages of this video motion-tracking technology with the benefits of the traditional laparoscopic box trainers, creating realistic haptic feedback and allowing the evaluation of psychomotor skills of the surgeons.
KeywordsLaparoscopic surgery Orthogonal cameras system Video-based tracking Motion analysis Objective evaluation Validation
- 13.Sankaranarayanan G, Lin H, Arikatla VS, Mulcare M, Zhang L, Derevianko A, Lim R, Fobert D, Cao C, Schwaitzberg SD, Jones DB, De S (2010) Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer. J Laparoendosc Adv Surg Tech A 20:153–7. doi:10.1089/lap.2009.0030 CrossRefPubMedPubMedCentralGoogle Scholar
- 19.Egi H, Okajima M, Yoshimitsu M, Ikeda S, Miyata Y, Masugami H, Kawahara T, Kurita Y, Kaneko M, Asahara T (2008) Objective assessment of endoscopic surgical skills by analyzing direction-dependent dexterity using the Hiroshima University Endoscopic Surgical Assessment Device (HUESAD). Surg Today 38:705–10. doi:10.1007/s00595-007-3696-0 CrossRefPubMedGoogle Scholar
- 21.Oropesa I, Sánchez-González P, Chmarra MK, Lamata P, Fernández A, Sánchez-Margallo JA, Jansen FW, Dankelman J, Sánchez-Margallo FM, Gómez EJ (2013) EVA: laparoscopic instrument tracking based on endoscopic video analysis for psychomotor skills assessment. Surg Endosc 27:1029–39. doi:10.1007/s00464-012-2513-z CrossRefPubMedGoogle Scholar
- 23.Available from: http://opencv.willowgarage.com/
- 26.Pérez F, Sossa H, Martínez R, Lorias D, Minor A (2013) Video-based tracking of laparoscopic instruments using an orthogonal webcams system. World Acad Sci Eng Technol Int J Med Health Pharm Biomed Eng 7:184–187Google Scholar
- 27.Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967Google Scholar