Abstract
The clinical logbook is the currently accepted tool for evaluating experiential learning (EL) in postgraduate radiology training programs internationally. The role of the picture archiving and communication system/radiology information system (PACS/RIS) in defining the complete EL portfolio of radiology residents has not been explored. To conduct a PACS/RIS-based analysis of the comprehensive clinical outputs of radiology residents, and to correlate outputs with residency recruitment criteria and exit examination performance. Retrospective, customized searches of the institutional PACS/RIS were conducted to determine the clinical outputs of radiology residents completing a standardized 4-year training program at a single institution in a middle-income country. The association between outputs and prior-to-residency radiology experience, prior-to residency completion of the primary examination, and performance in the exit examination were determined. Fifteen residents were included. Average clinical output was 8286 cases, with a wide range (6268-10460). Total output was not associated with first-time exit examination success (p=0.16). Residents with prior radiology experience tended to greater success at first exit examination attempt (10/11, 91% versus 2/4, 50%; p=0.09), despite lower average outputs (8138 versus 8695). Outputs were not associated with prior completion of the radiology primary examination (8263 versus 8378; p=0.87). This first PACS/RIS-based analysis of the complete clinical outputs of any radiology residency training program provides important baseline educational data, with the potential to inform discourses on specialty training internationally. It demonstrates the potential for the modern PACS/RIS to supersede the traditional logbook and to serve as a comprehensive EL portfolio for radiology residents.
Similar content being viewed by others
References
Accreditation Council for Graduate Medical Education (ACGME): ACGME program requirements for graduate medical education in diagnostic radiology. Chicago: ACGME, 2013, Available at: http://www.acgme.org/ (Accessed 21st September 2015)
The Royal Australian and New Zealand College of Radiologists (RANZCR): Radiodiagnosis training program curriculum. Sydney: RANZCR, 2014, Available at: http://www.ranzcr.edu.au/(Accessed 21 September 2015)
The Royal College of Radiologists (RCR): Specialty Training Curriculum for Clinical Radiology. London: RCR, 2004, Available at: https://www.rcr.ac.uk/ (Accessed 21 September 2015)
Jippes E, van Engelen JML, Brand PLP, Oudkerk M: Competency based (CanMEDS) residency training programme in radiology: systematic design procedure, curriculum and success factors. Eur Radiol 20:967–977, 2010
Janse van Rensburg J: A competency-based continuous assessment programme as part of a revised curriculum for postgraduate radiology training at the University of the Free State [PhD thesis]. Bloemfontein: University of the Free State, 2015.
European Society of Radiology (ESR): Revised European Training Curriculum for Radiology. Munich: ESR, 2015, Available at: https://www.myesr.org/ (Accessed 21 September 2015)
The Colleges of Medicine of South Africa (CMSA): Portfolio of Learning for the Fellowship of the College of Radiologists of South Africa. Johannesburg: CMSA, 2015, Available at: https://cmsa.ac.za/ (Accessed 21September 2015)
Chhem RK, Hibbert KM, van Deven T: Radiology Education: The Scholarship of Teaching and Learning. Verlag: Springer, 2009
Kolb AY, Kolb DA: Learning styles and learning spaces: Enhancing experiential learning in higher education. Acad Manag Learn Educ 4:193–212, 2005
Raghoebar-Krieger HM: The objectives-based logbook: a tool for evaluation of medical education. Groningen: University of Groningen, 2001, Available at: http://www.rug.nl/ (Accessed March 27th 2017)
Jones WG: Crossing the digital divide: moving from film to filmless radiology. J Digit Imaging 12:47–49, 1999
Mensch B, Honea R, Orand M: Care and feeding of a staff for filmless radiology. J Digit Imaging 12:38–40, 1999
Pilling J: Problems facing the radiologist tendering for a hospital wide PACS system. Eur J Radiol 32:101–105, 1999
Yamamoto I, Kaneda K: The practical use and evaluation of picture archiving and communication system in the department of orthopaedic surgery. J Digit Imaging 4:25–27, 1991
Chan L, Trambert M, Kywi A, Hartzman S: PACS in private practice—effect on profits and productivity. J Digit Imaging 15:131–136, 2002
Hirschorn DS, Hinrichs CR, Gor DM, Shah K, Visvikis G: Impact of a diagnostic workstation on workflow in the emergency department at a level I trauma center. J Digit Imaging 14:199–201, 2001
Redfern RO, Kundel HL, Polansky M, Langlotz CP, Horii SC, Lanken PN: A picture archival and communication system shortens delays in obtaining radiographic information in a medical intensive care unit. Crit Care Med 28:1006–1013, 2000
Sack D: Increased productivity of a digital imaging system: one hospital’s experience. Radiol Manage 23:14–18, 2001
Twair AA, Torregiani WC, Mahmud SM et al.: Significant savings in radiologic report turnaround time after implementation of a complete picture archiving and communication system (PACS). J Digit Imaging 13:175–177, 2000
Ruiz JG, Mintzer MJ, Leipzig RM: The impact of e-learning in medical education. Acad Med 81:207–212, 2006
Hammoud MM, Barclay ML: Development of a web-based question database for students’ self-assessment. Acad Med 77:925, 2002
European Commission: High Level Group on the Modernisation of Higher Education. Luxembourg: European Comission, 2013, Available at: http://ec.europa.eu/ (Accessed 7th October 2015)
Richarson ML: A world-wide web radiology teaching file server on the internet. AJR Am J Roentgenol 164:479–483, 1995
Siegel E, Reiner B: Electronic teaching files: seven-year experience in using a commercial picture archiving and communication system. J Digit Imaging 14:125–127, 2001
Sparacia G, Cannizzaro F, D’Alessandro DM, D’Alessandro MP, Caruso G, Lagalla R: Informatics in radiology: initial experiences in radiology e-learning. RadioGraphics 27:573–581, 2007
Greenberg SB, Long MJ, Klein SG: RadioGraphics: a web-based model for radiology resident self-education. Acad Radiol 10:1321–1323, 2003
Lim CCT, Yang GL, Nowinski WL, Hui F: Medical image resource center—making electronic teaching files from PACS. J Digit Imaging 16:331–336, 2003
Frosberg D, Rosipko B, Sunshine JL: Radiologists’ variation of time to read across different procedure types. J Digit Imaging 30:86–94, 2017
Sokolovskaya E, Shinde T, Ruchman RB, Kwak AJ, Lu S, Shariff YK, Wiggins EF, Talangbayan L: The effect of faster reporting speed for imaging studies on the number of misses and interpretation errors: a pilot study. J Am Coll Radiol 12:683–688, 2015
England E, Collins J, White RD, Seagull FJ, Deledda J: Radiology report turnaround time: effect on resident education. Acad Radiol 22:662–667, 2015
Baird R, Poenaru D, Ganey M: Partnership in fellowship: comparative analysis of pediatric surgical training and evaluation of a fellow exchange between Canada and Kenya. J Pediatr Surg 51:1704–1710, 2016
Rabin TL, Mayanja-Kizza H, Rastegar A: Medical education capacity—building partnerships for health care systems development. AMA J Ethics 18:710–717, 2016
Bodnar BE, Claassen CW, Solomon J et al.: The effect of a bidirectional exchange on faculty and institutional development in a global health collaboration. PLoS ONE 10:1–16, 2015
Waterval DG, Frambach JM, Oudkerk PA et al.: An exploration of cross border medical curriculum partnerships: balancing curriculum equivalence and local adaptation. Med Teach 38:255–262, 2016
Kim HS, Choi JA, Lee J: Asian radiology forum 2015 for building an Asian friendship: a step toward the vigorous intersociety collaboration in Asia. Korean J Radiol 17:175–181, 2016
Pitcher R, de Vries C, Lockhat Z: The FC Rad Diag(SA): stretched, but still in step—report on a Royal College observership. S Afr J Rad 21, 2017 https://doi.org/10.4102/sajr.v21i1.1092.
Schneider T, Huisman TA, Fiehler et al.: Differences in neuroradiology training programs around the world. AJNR Am J Neuroradiol 36:440–444, 2015
Rehani MM: CT imaging in a large part of the world: what we know and what we can learn. Pediatr Radiol 44:511–514, 2014
Thrall JH: Globalization of health care. Radiology 247:3–7, 2008
Kesselman A, Soroosh G, Mollura DJ, Abbey-Mensah G, Borgstede J, Bulas D, Carberry G, Canter D, Ebrahim F, Escalon J, Fuller L, Hayes C, Hope T, Kesselman A, Khandelwal N, Kim W, Mazal J, Mema E, Mikhail M, Mollura DJ, Monchil N, Morrow R, Ninalowo H, Otero H, Patel S, Quansah S, Reiter M, Schonenberger K, Shaba P, Singh T, Soroosh G, Stein-Wexler R, Walker T, Woodward A, Yang M, Yannes M: 2015 RAD-AID conference on international radiology for developing countries: the evolving global radiology landscape. J Am Coll Radiol 13:1139–1144, 2016
Culp M, Mollura DJ, Mazal J: 2014 RAD-AID conference on international radiology for developing countries: the road ahead for global health radiology. J Am Coll Radiol 12:475–480, 2015
Mollura DJ, Shah N, Mazal J: White paper report of the 2013 RAD-AID conference: improving radiology in resource-limited regions and developing countries. J Am Coll Radiol 11:913–919, 2014
Bulas D, Shah N: International pediatric radiology education: who should be trained, and how? Pediatr Radiol 44:639–641, 2014
Willatt JM, Mason AC: Comparison of radiology residency programs in ten countries. Eur Radiol 16:437–444, 2006
Rowell MR, Johnson PT, Fishman EK: Radiology education in 2005: world wide web practice patterns, perceptions, and preferences of radiologists. Radiographics 27:563–571, 2007
Acknowledgements
We acknowledge Tariq Stegmann and Lee-Roy Witbooi (Tygerberg Hospital PACS/RIS administrators) for their assistance with access to the institutional PACS/RIS.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The study was approved by the Health Research Ethics Committee of the Faculty of Medicine and Health Sciences of Stellenbosch University and TBH Management. Written informed consent was obtained from all participating residents, whose anonymity was assured through the use of unique study identifiers, known only to the principal investigator.
Conflict of Interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Greyling, A.G.W., Pitcher, R.D. Who PACS a Punch? The Role of the Picture Archiving and Communication System/Radiology Information System (PACS/RIS) in Quantifying Experiential Learning in Radiology Residency. J Digit Imaging 31, 792–798 (2018). https://doi.org/10.1007/s10278-018-0106-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-018-0106-7