A novel assessment tool for evaluating competence in video-assisted thoracoscopic surgery lobectomy

  • Katrine Jensen
  • René Horsleben Petersen
  • Henrik Jessen Hansen
  • William Walker
  • Jesper Holst Pedersen
  • Lars Konge
Article
  • 31 Downloads

Abstract

Background

Specific assessment tools can accelerate trainees’ learning through structured feedback and ensure that trainees attain the knowledge and skills required to practice as competent, independent surgeons (competency-based surgical education). The objective was to develop an assessment tool for video-assisted thoracoscopic surgery (VATS) lobectomy by achieving consensus within an international group of VATS experts.

Method

The Delphi method was used as a structured process for collecting and distilling knowledge from a group of internationally recognized VATS experts. Opinions were obtained in an iterative process involving answering repeated rounds of questionnaires. Responses to one round were summarized and integrated into the next round of questionnaires until consensus was reached.

Results

Thirty-one VATS experts were included and four Delphi rounds were conducted. The response rate for each round were 68.9% (31/45), 100% (31/31), 96.8% (30/31), and 93.3% (28/30) for the final round where consensus was reached. The first Delphi round contained 44 items and the final VATS lobectomy Assessment Tool (VATSAT) comprised eight items with rating anchors: (1) localization of tumor and other pathological tissue, (2) dissection of the hilum and veins, (3) dissection of the arteries, (4) dissection of the bronchus, (5) dissection of lymph nodes, (6) retrieval of lobe in bag, (7) respect for tissue and structures, and (8) technical skills in general.

Conclusion

A novel and dedicated assessment tool for VATS lobectomy was developed based on VATS experts’ consensus. The VATSAT can support the learning of VATS lobectomy by providing structured feedback and help supervisors make the important decision of when trainees have acquired VATS lobectomy competencies for independent performance.

Keywords

Assessment tool VATS video-assisted thoracoscopic surgery Lobectomy Thoracic surgical training Competency-based education 

Notes

Acknowledgements

VATS lobectomy experts were kindly asked to participate as part of the expert panel, and could decline at any phase in the study. At any time, participants could withdraw their consent for participation and their data would be deleted. All data were kept strictly confidential. The questionnaires from each expert were not discussed with colleagues or other individuals. The experts were told that the answers they gave in the questionnaires were anonymous for all except the main author who was handling the data via email and Survey Monkey, but that they would be acknowledged by name in the published paper if they wished to.

VATS lobectomy assessment tool expert panel: Baste JM, Bodner J, Cao C, Casali G, D’amico T, De Ryck F, Decaluwe HMA, Decker G, Dunning J, Gossot D, Kohno T, Leschber G, Liptay MJ, Loscertales J, McKenna RJ, Mitchell JD, Oosterhuis JW, Piwkowski CT, Schmid T, Schneiter D, Shackcloth M, Siebenga J, Sihoe A, Sokolow Y, Solaini L, Wright GM, Yan TD.

Compliance with ethical standards

Disclosures

Henrik Jessen Hansen and René Horsleben Petersen are at the speaker’s bureau for Covidien. Jesper Holst Pedersen, William Walker, and Lars Konge have no conflicts of interest or financial ties to disclose.

Ethical approval

No samples from humans were used in the study and no drugs were administered; hence, this study needed no approval from The Danish National Committee on Biomedical Research Ethics.

References

  1. 1.
    Falcoz PE, Puyraveau M, Thomas PA, Decaluwe H, Hurtgen M, Petersen RH, Hansen H, Brunelli A (2016) Video-assisted thoracoscopic surgery versus open lobectomy for primary non-small-cell lung cancer: a propensity-matched analysis of outcome from the European Society of Thoracic Surgeon database. Eur J Cardiothorac Surg 49:602–609.  https://doi.org/10.1093/ejcts/ezv154 CrossRefPubMedGoogle Scholar
  2. 2.
    Laursen L, Petersen RH, Hansen HJ, Jensen TK, Ravn J, Konge L (2016) Video-assisted thoracoscopic surgery lobectomy for lung cancer is associated with a lower 30-day morbidity compared with lobectomy by thoracotomy. Eur J Cardiothorac Surg 49:870–875.  https://doi.org/10.1093/ejcts/ezv205 CrossRefPubMedGoogle Scholar
  3. 3.
    Whitson BA, Groth SS, Duval SJ, Swanson SJ, Maddaus MA (2008) Surgery for early-stage non-small cell lung cancer: a systematic review of the video-assisted thoracoscopic surgery versus thoracotomy approaches to lobectomy. Ann Thorac Surg 86:2008–2018.  https://doi.org/10.1016/j.athoracsur.2008.07.009 CrossRefPubMedGoogle Scholar
  4. 4.
    Yan TD, Cao C, D’Amico TA, Demmy TL, He J, Hansen H, Swanson SJ, Walker WS (2014) Video-assisted thoracoscopic surgery lobectomy at 20 years: a consensus statement. Eur J Cardiothorac Surg 45:633–639.  https://doi.org/10.1093/ejcts/ezt463 CrossRefPubMedGoogle Scholar
  5. 5.
    Cao C, Tian DH, Wolak K, Oparka J, He J, Dunning J, Walker WS, Yan TD (2014) Cross-sectional survey on lobectomy approach (X-SOLA). Chest 146:292–298.  https://doi.org/10.1378/chest.13-1075 CrossRefPubMedGoogle Scholar
  6. 6.
    Petersen RH, Hansen HJ (2010) Learning thoracoscopic lobectomy. Eur J Cardiothorac Surg 37:516–520.  https://doi.org/10.1016/j.ejcts.2009.09.012 CrossRefPubMedGoogle Scholar
  7. 7.
    Ferguson J, Walker W (2006) Developing a VATS lobectomy programme—can VATS lobectomy be taught? Eur J Cardiothorac Surg 29:806–809.  https://doi.org/10.1016/j.ejcts.2006.02.012 CrossRefPubMedGoogle Scholar
  8. 8.
    Carrott PW, Jones DR (2013) Teaching video-assisted thoracic surgery (VATS) lobectomy. J Thorac Dis.  https://doi.org/10.3978/j.issn.2072-1439.2013.07.31 PubMedPubMedCentralGoogle Scholar
  9. 9.
    Moorthy K, Munz Y, Sarker SK, Darzi A (2003) Clinical review objective assessment of technical skills in surgery. BMJ 327:1032–1037CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    Moon MR (2014) Technical skills assessment in thoracic surgery education: we won’t get fooled again. J Thorac Cardiovasc Surg 148:2497–2498.  https://doi.org/10.1016/j.jtcvs.2014.09.057 CrossRefPubMedGoogle Scholar
  11. 11.
    Grantcharov TP, Reznick RK (2008) Teaching procedural skills. BMJ 336:1129–1131.  https://doi.org/10.1136/bmj.39517.686956.47 CrossRefPubMedPubMedCentralGoogle Scholar
  12. 12.
    Lodge D, Grantcharov T (2011) Training and assessment of technical skills and competency in cardiac surgery. Eur J Cardiothorac Surg 39:287–293.  https://doi.org/10.1016/j.ejcts.2010.06.035 CrossRefPubMedGoogle Scholar
  13. 13.
    Gardner AK, Scott DJ, Choti M, Mansour JC (2015) Developing a comprehensive resident education evaluation system in the era of milestone assessment. J Surg Educ.  https://doi.org/10.1016/j.jsurg.2014.12.007 Google Scholar
  14. 14.
    Meyerson SL, Tong BC, Balderson SS, D’Amico TA, Phillips JD, Decamp MM, Darosa DA (2012) Needs assessment for an errors-based curriculum on thoracoscopic lobectomy. Ann Thorac Surg 94:368–373.  https://doi.org/10.1016/j.athoracsur.2012.04.023 CrossRefPubMedPubMedCentralGoogle Scholar
  15. 15.
    Öhrn A, Olai A, Rutberg H, Nilsen P, Tropp H (2011) Adverse events in spine surgery in Sweden. Acta Orthop 82:727–731.  https://doi.org/10.3109/17453674.2011.636673 CrossRefPubMedPubMedCentralGoogle Scholar
  16. 16.
    Konge L, Lehnert P, Hansen HJ, Petersen RH, Ringsted C (2012) Reliable and valid assessment of performance in thoracoscopy. Surg Endosc 26:1624–1628.  https://doi.org/10.1007/s00464-011-2081-7 CrossRefPubMedGoogle Scholar
  17. 17.
    Aggarwal R, Grantcharov T, Moorthy K, Milland T, Darzi A (2008) Toward feasible, valid, and reliable video-based assessments of technical surgical skills in the operating room. Ann Surg 247:372–379.  https://doi.org/10.1097/SLA.0b013e318160b371 CrossRefPubMedGoogle Scholar
  18. 18.
    ten Cate O, Scheele F (2007) Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med 82:542–547.  https://doi.org/10.1097/ACM.0b013e31805559c7 CrossRefPubMedGoogle Scholar
  19. 19.
    Hopmans CJ, den Hoed PT, van der Laan L, van der Harst E, van der Elst M, Mannaerts GHH, Dawson I, Timman R, Wijnhoven BPL, IJzermans JNM (2014) Assessment of surgery residents’ operative skills in the operating theater using a modified objective structured assessment of technical skills (OSATS): a prospective multicenter study. Surgery 156:1078–1088.  https://doi.org/10.1016/j.surg.2014.04.052 CrossRefPubMedGoogle Scholar
  20. 20.
    Vassiliou MC, Feldman LS (2011) Objective assessment, selection, and certification in surgery. Surg Oncol 20:140–145.  https://doi.org/10.1016/j.suronc.2010.09.004 CrossRefPubMedGoogle Scholar
  21. 21.
    Szasz P, Louridas M, Harris KA, Aggarwal R, Grantcharov TP (2015) Assessing technical competence in surgical trainees: a systematic review. Ann Surg 26:1046–1055.  https://doi.org/10.1097/SLA.0000000000000866 CrossRefGoogle Scholar
  22. 22.
    Rocco G, Internullo E, Cassivi SD, Van Raemdonck D, Ferguson MK (2008) The variability of practice in minimally invasive thoracic surgery for pulmonary resections. Thorac Surg Clin 18:235–247.  https://doi.org/10.1016/j.thorsurg.2008.06.002 CrossRefPubMedGoogle Scholar
  23. 23.
    Day J, Bobeva M (2005) A generic toolkit for the successful management of delphi studies. Electron J Bus Res Methods 3:103–116Google Scholar
  24. 24.
    Jensen K, Bjerrum F, Hansen HJ, Petersen RH, Pedersen JH, Konge L (2015) A new possibility in thoracoscopic virtual reality simulation training: development and testing of a novel virtual reality simulator for video-assisted thoracoscopic surgery lobectomy. Interact Cardiovasc Thorac Surg 21:420–426.  https://doi.org/10.1093/icvts/ivv183 CrossRefPubMedGoogle Scholar
  25. 25.
    Jensen K, Ringsted C, Hansen HJ, Petersen RH, Konge L (2014) Simulation-based training for thoracoscopic lobectomy: a randomized controlled trial: virtual-reality versus black-box simulation. Surg Endosc 28:1821–1829.  https://doi.org/10.1007/s00464-013-3392-7 CrossRefPubMedGoogle Scholar
  26. 26.
    Savran MM, Hansen HJ, Petersen RH, Walker W, Schmid T, Bojsen SR, Konge L (2015) Development and validation of a theoretical test of proficiency for video-assisted thoracoscopic surgery (VATS) lobectomy. Surg Endosc 29:2598–2604.  https://doi.org/10.1007/s00464-014-3975-y CrossRefPubMedGoogle Scholar
  27. 27.
    Meyerson SL, LoCascio F, Balderson SS, D’Amico TA (2010) An inexpensive, reproducible tissue simulator for teaching thoracoscopic lobectomy. Ann Thorac Surg 89:594–597.  https://doi.org/10.1016/j.athoracsur.2009.07.067 CrossRefPubMedGoogle Scholar
  28. 28.
    Tong BC, Gustafson MR, Balderson SS, D’Amico TA, Meyerson SL (2012) Validation of a thoracoscopic lobectomy simulator. Eur J Cardiothorac Surg 42:364–369.  https://doi.org/10.1093/ejcts/ezs012 CrossRefPubMedGoogle Scholar
  29. 29.
    Miskovic D, Ni M, Wyles SM, Kennedy RH, Francis NK, Parvaiz A, Cunningham C, Rockall TA, Gudgeon AM, Coleman MG, Hanna GB (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257:476–482.  https://doi.org/10.1097/SLA.0b013e318275b72a CrossRefPubMedGoogle Scholar
  30. 30.
    Ilgen JS, Ma IWY, Hatala R, Cook DA (2015) A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ 49:161–173.  https://doi.org/10.1111/medu.12621 CrossRefPubMedGoogle Scholar
  31. 31.
    Sharma B, Mishra A, Aggarwal R, Grantcharov TP (2011) Non-technical skills assessment in surgery. Surg Oncol 20:169–177.  https://doi.org/10.1016/j.suronc.2010.10.001 CrossRefPubMedGoogle Scholar
  32. 32.
    Barsuk JH, Cohen ER, Wayne DB, Siddall VJ, McGaghie WC (2016) Developing a simulation-based mastery learning curriculum. Simul Healthc J Soc Simul Healthc 11:52–59.  https://doi.org/10.1097/SIH.0000000000000120 CrossRefGoogle Scholar
  33. 33.
    Mcgaghie WC (2015) Mastery learning: it is time for medical education to join the 21st century. Acad Med 90:1–4.  https://doi.org/10.1097/ACM.0000000000000911 CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Cardiothoracic Surgery 2152University Hospital of Copenhagen, RigshospitaletCopenhagenDenmark
  2. 2.Copenhagen Academy for Medical Education and Simulation (CAMES) 5404University of CopenhagenCopenhagenDenmark
  3. 3.Department of Cardiothoracic SurgeryRoyal Infirmary of EdinburghEdinburghScotland, UK

Personalised recommendations