Evidence that surgical performance predicts clinical outcomes

Abstract

Purpose

Assessment of surgeon performance in the operating room has been identified as a direct method of measuring surgical quality. Studies published in urology and other surgical disciplines have investigated this link directly by measuring surgeon and team performance using methodology supported by validity evidence. This article highlights the key findings of these studies and associated underlying concepts.

Methods

​Seminal literature from urology and related areas of research was used to inform this review of the performance–outcome relationship in surgery. Current efforts to further our understanding of this concept are discussed, including relevant quality improvement and educational interventions that utilize this relationship.

Results

Evidence from multiple surgical specialties and procedures has established the association between surgeon skill and clinically significant patient outcomes. Novel methods of measuring performance utilize surgeon kinematics and artificial intelligence techniques to more reliably and objectively quantify surgical performance.

Conclusions

Future directions include the use of this data to create interventions for quality improvement, as well as innovate the credentialing and recertification process for practicing surgeons.

This is a preview of subscription content, log in to check access.

References

  1. 1.

    Gilbert SM, Penson D (2010) Outcomes research in urology. World J Urol 29(1):1–2. https://doi.org/10.1007/s00345-010-0624-5

    Article  PubMed  Google Scholar 

  2. 2.

    Krajewski W, Rodríguez Faba O, Poletajew S, Palou J (2019) New predictive nomograms for non-muscle-invasive bladder cancer: it is all about the details. World J Urol 39:135. https://doi.org/10.1007/s00345-019-02680-3

    Article  Google Scholar 

  3. 3.

    Herrmann TR, Rabenalt R, Stolzenburg JU et al (2007) Oncological and functional results of open, robot-assisted and laparoscopic radical prostatectomy: does surgical approach and surgical experience matter? World J Urol 25(2):149–160. https://doi.org/10.1007/s00345-007-0164-9

    CAS  Article  PubMed  Google Scholar 

  4. 4.

    Damani A, Van Hemelrijck M, Wulaningsih W, Crawley D, Cahill D (2017) Are you now a good surgeon? T2 positive margin status as a quality outcome measure following radical prostatectomy. World J Urol 35(1):35–43. https://doi.org/10.1007/s00345-016-1836-0

    Article  PubMed  Google Scholar 

  5. 5.

    Kretschmer A, Mandel P, Buchner A, Stief CG, Tilki D (2015) Surgical learning curve for open radical prostatectomy: is there an end to the learning curve? World J Urol 33(11):1721–1727. https://doi.org/10.1007/s00345-015-1540-5

    Article  PubMed  Google Scholar 

  6. 6.

    Özdemir-van Brunschot DMD, Warlé MC, van der Jagt MF et al (2015) Surgical team composition has a major impact on effectiveness and costs in laparoscopic donor nephrectomy. World J Urol 33(5):733–741. https://doi.org/10.1007/s00345-014-1428-9

    Article  PubMed  Google Scholar 

  7. 7.

    Pearce SM, Pariser JJ, Patel SG, Anderson BB, Eggener SE, Zagaja GP (2015) The impact of days off between cases on perioperative outcomes for robotic-assisted laparoscopic prostatectomy. World J Urol 34(2):269–274. https://doi.org/10.1007/s00345-015-1605-5

    Article  PubMed  Google Scholar 

  8. 8.

    Park J, Yoo D-S, Song C et al (2014) Comparison of oncological outcomes between retropubic radical prostatectomy and robot-assisted radical prostatectomy: an analysis stratified by surgical experience. World J Urol 32(1):193–199. https://doi.org/10.1007/s00345-013-1168-2

    Article  PubMed  Google Scholar 

  9. 9.

    Birkmeyer JD, Finks JF, O’Reilly A et al (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369(15):1434–1442. https://doi.org/10.1056/NEJMsa1300625

    CAS  Article  PubMed  Google Scholar 

  10. 10.

    Hogg ME, Zenati M, Novak S et al (2016) Grading of surgeon technical performance predicts postoperative pancreatic fistula for pancreaticoduodenectomy independent of patient-related variables. Ann Surg 264(3):482–491. https://doi.org/10.1097/SLA.0000000000001862

    Article  PubMed  Google Scholar 

  11. 11.

    Fecso AB, Bhatti JA, Stotland PK, Quereshy FA, Grantcharov TP (2018) Technical performance as a predictor of clinical outcomes in laparoscopic gastric cancer surgery. Ann Surg. https://doi.org/10.1097/sla.0000000000002741

    Article  PubMed  Google Scholar 

  12. 12.

    Goldenberg MG, Goldenberg L, Grantcharov TP (2017) Surgeon performance predicts early continence after robot-assisted radical prostatectomy. J Endourol 31(9):858–863. https://doi.org/10.1089/end.2017.0284

    Article  PubMed  Google Scholar 

  13. 13.

    Ghani KR, Comstock B, Miller DC et al (2017) PNFBA-02 technical skill assessment of surgeons performing robot-assisted radical prostatectomy: relationship between crowd sourced review and patient outcomes. JURO. https://doi.org/10.1016/j.juro.2017.02.3221

    Article  Google Scholar 

  14. 14.

    Hung A, Chen J, Che Z et al (2018) Utilizing machine learning and automated performance metrics to evaluate robot-assisted radical prostatectomy performance and predict outcomes. J Endourol. https://doi.org/10.1089/end.2018.0035

    Article  PubMed  Google Scholar 

  15. 15.

    Fecso AB, Kuzulugil SS, Babaoglu C, Bener AB, Grantcharov TP (2018) Relationship between intraoperative non-technical performance and technical events in bariatric surgery. Br J Surg 83:249–257. https://doi.org/10.1002/bjs.10811

    Article  Google Scholar 

  16. 16.

    Walsh PC, Marschke P, Ricker D, Burnett AL (2000) Use of intraoperative video documentation to improve sexual function after radical retropubic prostatectomy. Urology 55(1):62–67

    CAS  Article  Google Scholar 

  17. 17.

    Touijer K, Kuroiwa K, Saranchuk JW et al (2005) Quality improvement in laparoscopic radical prostatectomy for pT2 prostate cancer: impact of video documentation review on positive surgical margin. JURO 173(3):765–768. https://doi.org/10.1097/01.ju.0000146574.52402.d5

    Article  Google Scholar 

  18. 18.

    Hung AJ, Chen J, Ghodoussipour S et al (2019) Deep learning on automated performance metrics and clinical features to predict urinary continence recovery after robot-assisted radical prostatectomy. BJU Int. https://doi.org/10.1111/bju.14735

    Article  PubMed  Google Scholar 

  19. 19.

    Hatala R, Cook DA, Brydges R, Hawkins R (2015) Constructing a validity argument for the objective structured assessment of technical skills (OSATS): a systematic review of validity evidence. Adv Health Sci Educ 20(5):1–27. https://doi.org/10.1007/s10459-015-9593-1

    Article  Google Scholar 

  20. 20.

    Hung AJ, Chen J, Jarc A, Hatcher D, Djaladat H, Gill IS (2018) Development and validation of objective performance metrics for robot-assisted radical prostatectomy: a pilot study. J Urol 199(1):296–304. https://doi.org/10.1016/j.juro.2017.07.081

    Article  PubMed  Google Scholar 

  21. 21.

    Holst D, Kowalewski TM, White LW et al (2015) Crowd-sourced assessment of technical skills (C-SATS): differentiating animate surgical skill through the wisdom of crowds. J Endourol. https://doi.org/10.1089/end.2015.0104

    Article  PubMed  Google Scholar 

  22. 22.

    Kaler KS, Valley ZA, Bettir KC et al (2018) Crowdsourcing evaluation of ureteroscopic videos using the post-ureteroscopic lesion scale to assess ureteral injury. J Endourol 32(4):275–281. https://doi.org/10.1089/end.2017.0582

    Article  PubMed  Google Scholar 

  23. 23.

    Goldenberg MG, Nabhani J, Wallis CJD et al (2017) Feasibility of expert and crowd-sourced review of intraoperative video for quality improvement of intracorporeal urinary diversion during robotic radical cystectomy. Can Urol Assoc J. 11(10):331–336. https://doi.org/10.5489/cuaj.4442

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mitchell G. Goldenberg.

Ethics declarations

Conflict of interest

The author receives monetary compensation in his role as a Scientific Advisor for Surgical Safety Technologies©.

Human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Goldenberg, M.G. Evidence that surgical performance predicts clinical outcomes. World J Urol 38, 1595–1597 (2020). https://doi.org/10.1007/s00345-019-02857-w

Download citation

Keywords

  • Surgical performance
  • Patient outcomes
  • Assessment
  • Education