Development and validation of surgical training tool: cystectomy assessment and surgical evaluation (CASE) for robot-assisted radical cystectomy for men
We aimed to develop a structured scoring tool: cystectomy assessment and surgical evaluation (CASE) that objectively measures and quantifies performance during robot-assisted radical cystectomy (RARC) for men.
A multinational 10-surgeon expert panel collaborated towards development and validation of CASE. The critical steps of RARC in men were deconstructed into nine key domains, each assessed by five anchors. Content validation was done utilizing the Delphi methodology. Each anchor was assessed in terms of context, score concordance, and clarity. The content validity index (CVI) was calculated for each aspect. A CVI ≥ 0.75 represented consensus, and this statement was removed from the next round. This process was repeated until consensus was achieved for all statements. CASE was used to assess de-identified videos of RARC to determine reliability and construct validity. Linearly weighted percent agreement was used to assess inter-rater reliability (IRR). A logit model for odds ratio (OR) was used to assess construct validation.
The expert panel reached consensus on CASE after four rounds. The final eight domains of the CASE included: pelvic lymph node dissection, development of the peri-ureteral space, lateral pelvic space, anterior rectal space, control of the vascular pedicle, anterior vesical space, control of the dorsal venous complex, and apical dissection. IRR > 0.6 was achieved for all eight domains. Experts outperformed trainees across all domains.
We developed and validated a reliable structured, procedure-specific tool for objective evaluation of surgical performance during RARC. CASE may help differentiate novice from expert performances.
KeywordsRobot-assisted Radical cystectomy Training Skill acquisition Quality Assessment
This research was supported in part by funding from the National Cancer Institute of the National Institutes of Health under Award Number: R25CA181003, and Roswell Park Alliance Foundation.
Compliance with ethical standards
Ronney Abaza: Research grant from Intuitive Surgical. Ahmed A. Hussein, Kevin J. Sexton, Paul R. May, Maxwell V. Meng, Abolfazl Hosseini, Daniel D. Eun, Siamak Daneshmand, Bernard H. Bochner, James O. Peabody, Eila C. Skinner, Richard E. Hautmann, Khurshid A. Guru have no conflicts of interest or financial ties to disclose.
- 6.Hussein AA, Hinata N, Dibaj S et al (2017) Development, validation and clinical application of Pelvic Lymphadenectomy Assessment and Completion Evaluation: intraoperative assessment of lymph node dissection after robot-assisted radical cystectomy for bladder cancer. BJU Int 119(6):879–884CrossRefPubMedGoogle Scholar
- 7.Schiffmann J, Gandaglia G, Larcher A et al (2014) Contemporary 90-day mortality rates after radical cystectomy in the elderly. Eur J Surg Oncol J Eur Soc Surg Oncol Br Assoc Surg Oncol 40(12):1738–1745Google Scholar
- 9.Hussein AA, Dibaj S, Hinata N et al. Development and validation of a quality assurance score for robot-assisted radical cystectomy: a 10-year analysis. Urology 2016Google Scholar
- 17.Apramian T, Cristancho S, Sener A, Lingard L (2017) How do thresholds of principle and preference influence surgeon assessments of learner performance? Ann SurgGoogle Scholar
- 21.Stolzenburg JU, Rabenalt R, Do M, Horn LC, Liatsikos EN (2006) Modular training for residents with no prior experience with open pelvic surgery in endoscopic extraperitoneal radical prostatectomy. Eur Urol 49(3):491–498; discussion 499–500Google Scholar