Evaluation of the pediatric life support instructors courses

Abstract

Objective

To evaluate the results and quality of pediatric cardiopulmonary resuscitation (CPR) instructor training courses.

Methods

A retrospective analysis was performed of the results of 24 pediatric CPR instructor courses held over 21 years (1999 to 2019). The results of participants’ evaluation of theory and practice sessions were analyzed. In addition, participants were asked to answer an anonymous survey to assess their opinion on the quality of theory and practice lessons, course organization and methodology, and instructor training. The results were compared by professional groups.

Results

A total of 560 participants completed the instructor course. Of them, 554 passed theory and practice tests (98.9 %). The mean score obtained in theory tests was 9.2 (0.8) out of 10. The mean score obtained in all practice tests was > 3.5 out of 5. Participants evaluated all the aspects of the course (theory and practice content, organization, teaching methodology, and instructors) with mean scores over 8 out of 10.

Conclusions

Specific pediatric and neonatal CPR instructor courses are a cornerstone in the process of CPR training and ensuring the homogeneity and quality of training. Most of the participants obtained the qualification of instructors and their evaluation of the course was very positive.

Peer Review reports

Background

Training both, healthcare professionals and the general public in cardiopulmonary resuscitation (CPR) is essential to improve CPR outcomes and the prognosis of patients suffering a cardiac arrest [1,2,3].

CPR training involves different phases: a study of training needs, design of the training process, selection of teaching methods, programming of teaching activities, training of instructors, implementation of training activities and evaluation of learning outcomes (results of the participants and quality of training), and the impact of the training process on clinical practice [1,2,3,4].

In order to achieve a high-quality training process, the main scientific organizations involved in CPR have designed training courses for instructors. Some have opted for a generic course for adult or pediatric CPR instructors [1, 3, 5], while others have designed specific instructor courses for each type of CPR [2, 6, 7].

Accordingly, evaluating participants’ performance and the quality of training is essential to improve CPR outcomes.

Many studies have analyzed the learning outcomes of participants in adult and pediatric CPR courses. However, despite their importance, very few studies have analyzed outcomes of instructor training or evaluated the quality of training in instructor courses [6], although it has been observed that poor learning outcomes occur because instructors are not adequately trained [8,9,10].

Some groups recommend that adult CPR instructor courses are only offered to physicians, whereas pediatric CPR instructor courses should only be aimed at pediatricians. Nevertheless, the policy of the Spanish Pediatric and Neonatal Resuscitation Group (SPNRG) is to allow access to all health professionals who have passed the Pediatric Advanced Life Support (PALS) course and have experience in pediatric CPR.

The aim of our study was to analyze learning outcomes and the quality of pediatric and neonatal CPR instructor courses and compare the results obtained by professional groups.

Methods

Study design

A retrospective analysis of the results of pediatric and neonatal CPR instructor courses given between 1999 and 2019 and certified by the SPNRG was carried out.

Participants

The minimum requirements for the course were to have passed a SPNRG-certified PALS course and having clinical experience in pediatric and neonatal CPR. Participants were selected by the director of the course according to their previous training and experience in CPR and teaching, as well as to the educational needs of their professional area.

The number of participants ranged from 20 to 36, depending on the classrooms and instructors available, with a maximum number of six participants per practice group.

All instructors were SPNRG-certified PALS instructors.

All participants gave consent for participation in the study and publication of results.

Methodology

The methodology of the course is described elsewhere (6). The duration of the course was 26–28 h distributed over 3–4 days.

The course is divided into 2 phases: an initial preparation phase and a phase involving face-to-face sessions.

  1. a)

    In the initial phase, participants receive the Guide for Instructors and were given instructions to prepare for each practice session. In this phase, doubts are resolved by distance communication with the director of the course.

  2. b)

    The face-to-face phase consists of theory and practice sessions. Theory sessions (i.e. instructor course, organization of pediatric life support courses, teaching methods, preparation of clinical cases and practice sessions, and evaluation methodology) have a duration of 6 hours and are developed interactively, stimulating the participation of students. Practice sessions (i.e. public speaking, basic life support, airway ventilation, venous and intravenous access, arrhythmias, trauma and CPR, neonatal resuscitation, and integrated advanced resuscitation) have a duration of 20 hours. In practice sessions, the instructor first explains the material and scenario and the guide-model of practice and then each participant plays the role of instructor, while the other participants act as if they were attending a PALS course. After each performance, the participant performs self-assessment and, afterwards, the whole group analyzes how the student managed the session (i.e. presentation of the clinical case, development of the practice class, and student evaluation). Finally, the instructor makes a summary. Positive feedback is used to build up a climate of friendship and confidence within the group.

In the public speaking practice, each student gives an oral presentation using four or five slides from PALS courses which they had received in advance. After each presentation, the participant, their colleagues, and the instructor analyze the quality of the presentation, the capacity to catch and maintain attention, clarity, oral expression, and body language, among other elements.

Over time, some modifications have been made to the program, according to the evaluations made by the participants and instructors of the course, progressively increasing the workload of participants prior to the course.

Evaluation

  1. a)

    Theoretical evaluation:

The final theory test consisted of 20 items, including multiple-choice questions with 5 options and sequential-order tasks. Theory tests were scored over a 10-point scale.

  1. b)

    Practical evaluation:

The performance of each participant as an instructor at each practice session was evaluated, and an overall score ranging from 1 to 5 was obtained according to the criteria shown in Table 1.

Table 1 Evaluation criteria for the practice sessions

Theory and practice evaluations and the evaluation criteria were previously validated by the Scientific Committee of the SPNRG.

  1. iii)

    Final evaluation of the students.

At the end of the course, the instructors evaluated theory and practice test results and judged whether the participants had reached sufficient level to merit the instructor diploma. To pass the course, participants were required to have a minimum score of 6.5 in theory tests, and a mean score higher than 3.5 in practice tests. A score < 3 was not allowed in more than two practice evaluations.

  1. iv)

    Evaluation of the course by participants.

At the end of the course, participants filled in an anonymous questionnaire aimed at assessing the quality of the course, including individual evaluations of each theory and practice session, different aspects of organization, methodology and evaluation of instructors, with a score from 0 to 10.

Statistical methods

Statistical analysis of the results was performed with SPSS version 20 software (SPSS Inc, Chicago, USA). Continuous variables are expressed as mean values and standard deviations, whereas categorical variables are expressed as frequencies and percentages. The chi-square test was used to compare categorical variables. For the comparison of the scores in the different professional categories (we compared all together and one per one with the rest of categories) Student’s t-tests and ANOVA tests were applied, with Bonferroni correction or Games-Howell tests based on the homogeneity of variances. For comparison of theory and practice scores, the ANOVA test of repeated measures with Bonferroni correction was used. A p value lower than 0.05 was considered statistically significant.

Results

Twenty-four instructor courses involving 560 participants were analyzed. Participant distribution by professional group is shown in Table 2. Most of the participants were hospital pediatricians and pediatric residents.

Table 2 Student distribution by professional groups

Results of the participants

Table 3 summarizes the global results obtained in theory and practice tests, with comparisons by professional group and workplace.

Table 3 Scoring of theory and practice sessions (mean and standard deviation)

Overall, 98.9 % of all participants achieved a positive evaluation and obtained the instructor diploma. The 6 participants who did not obtain the diploma were offered to repeat the instructor course, and one did so.

Regarding theory tests, no significant differences were observed in student scores based on their professional group.

There were no significant differences in the scores obtained in the different practice tests in the global evaluation where all participants were included. Participants of all occupations obtained scores ≥ 3.2 in each practice. Individual evaluation of each practice session showed non-relevant but statistically significant differences.

Pediatric intensive care unit (PICU) pediatricians obtained slightly higher scores than the rest of professionals in most practices, although differences were not statistically significant.

When each professional professional group was compared with the rest, emergency physicians obtained a higher mean score in trauma practice, but a significant difference was only observed in comparison with primary care pediatricians (p = 0.034).

In neonatal practice, PICU pediatricians, hospital pediatricians and pediatric residents scored higher than nurses, but differences were only significant in the case of hospital pediatricians (p = 0.002) and pediatric residents (p = 0.001).

In the practice of integrated advanced CPR, PICU pediatricians scored significantly higher than hospital pediatricians (p = 0.018), nurses (p = 0.005) and primary care pediatricians (p = 0.006).

Course evaluation survey by the participants

Table 4 shows the overall evaluation and comparison by professional group of organization, teaching methodology, instructor skills, and theory and practice sessions of the 540 survey of the students.

Table 4 Evaluation of teaching methodology, teaching staff and organization
  • Organization, teaching methodology and teaching staff: All aspects of organization and teaching methodology were scored above 8. The least valued parameters were the venue, time schedules and time given to develop the contents of the course. All items regarding the teaching staff received a mean score above 8.8. Most participants feel that, although the course is long, the duration of practice sessions should be prolonged to be able to practice as instructors in all modalities.

  • Theory and practice sessions: All theory and practice sessions were evaluated with a mean score above 8.3, although there were significant differences in the evaluation of the different theory classes (p < 0.001) and practice sessions (p < 0.001). The theory sessions about updates in CPR and teaching techniques and the practice sessions on integrated advanced CPR and expression techniques were the most valued.

Discussion

This is the first study to extensively analyze the results of pediatric CPR instructor courses and assess participants’ opinion about the course received, over a long period of time with a significant number of participants.

Course methodology

The practice methodology of the instructor course is a crucial aspect and is primarily based on simulation [11]. The participants are the protagonists since they are the ones who develop the practices, evaluate themselves and participate in peer-assessment. The instructors act as facilitators and advisors, and direct and organize the practice session so that it reproduces a practice from a PALS course. Instructors also facilitate that conclusions are draw by all participants. Public speaking practices help participants improve their communication skills and solve problems related to communication and group management.

Some institutions, such as the European Resuscitation Council (ERC), consider that a general instructor course is sufficient to train professionals in teaching any type of CPR course [1, 3, 5]. However, the SPNRG considers that instructors should be trained in each practice session of the pediatric CPR course [6], and the results of our study and the participants’ opinion support this view.

Practice sessions related to neonatal and integrated resuscitation were the most highly rated by participants, perhaps because in these practices they can best perform all instructor functions and manage a group. Although these practices are the most complex, they allow a better assessment of the ability of the instructor to teach CPR in an integrated manner.

An essential aspect of the methodology is the use of structured and supported debriefing [12]. In debriefing, correction and positive feedback are very important. Analyzing mistakes is the best way to improve our competence, correcting performance without making the student feel personalized. Self-assessment and peer-assessment help create a climate of trust that favors the acceptance of feedback and helps participants learn this methodology.

Results of the course

Our results show that a specific pediatric CPR instructor course focused mainly on practice simulation methods is adequate for instructor training, since 98.9 % of participants achieved the learning objectives.

Most participants passed the course, which confirms its usefulness and the fact that a good selection of candidates had been previously made. A large proportion of participants were hospital pediatricians, including PICU and senior pediatric residents. Most nurses worked in PICUs and other special units and had extensive experience in pediatric CPR. Emergency care physicians were professionals who performed CPR in their regular practice.

Our study shows that students receive sufficient global training as pediatric CPR instructors. However, some of the professional groups them (i.e. primary care nurses and pediatricians) have more difficulties in certain practices, such as in the management of arrhythmias, CPR, and trauma, and neonatal CPR in the case of nurses, or advanced CPR in the case of primary care pediatricians. This is likely because they have less clinical experience in such tasks, which reinforces the relevance that instructors are experts in the subject they teach and the fact that not all instructors can teach all practices.

The training provided in instructor courses is necessary, but not sufficient. That is why the SPNRG requires that instructors who pass the course be supervised by expert instructors for at least two PALS courses over the next two years to reinforce training. Participants’ feedback confirms this view. On the other hand, in the long term, periodic re-training and updating of instructors is necessary to maintain their competence.

Evaluation of the course by participants

The evaluation of the course by participants is a cornerstone of course quality control. This process serves to detect weaknesses and propose modifications in the organization, methodology and teaching staff for successive editions, in addition to integrating the participants in the training process [13].

The participants rated very positively organizational and methodological aspects, theory and practice sessions, and the teaching skills and attitude of instructors. Some aspects of the organization along with time schedule were among the worst rated aspects of the course. Due to the long duration of the course, the face-to-face phase has a duration of 26 to 28 h, sessions are very long, which increases participants’ fatigue and reduces their learning capacity. Thus, it is not surprising that this aspect was the worst rated. On the other hand, participants consider very important not to reduce the number of practice hours of the course and that all participants play the role of instructor in all practice sessions. Therefore, the practice phase cannot be replaced with distance training.

Taking into account that it is increasingly easier to offer distance learning through digital platforms, it is necessary to consider reducing the duration of the theory part of the course in favor of practice sessions. However, we consider that theory should not be completely eliminated because interaction between the instructor and the student in theory sessions is also essential.

It is worth noting the excellent evaluation of instructor teaching skills, coordination and attitude, which supports the usefulness of the training system for pediatric CPR instructors developed by the SPNRG.

Limitations

Our study has some limitations. In the first place, it is a single-center study, which favors the homogeneity of the results; therefore, other training groups should confirm our results. However, the number of courses analyzed, the variety of professions of participants, and the venues where the course took place allow us to assume that the sample is representative of all the courses given in our country.

On the other hand, our study only analyzes the opinions of participants. In order to have a more comprehensive evaluation, it would have been necessary to analyze the opinions of instructors as well.

Finally, the satisfaction survey of participants did not correlate with the results obtained in the course because the survey was anonymous. Nevertheless, since the vast majority of participants passed the course, it is likely that this fact is not a critical factor in the evaluation of the course. The performance of participants as simulated instructors was not analyzed.

Conclusions

We conclude that a specific pediatric and neonatal CPR instructor course focused mainly on practice simulation methods is an adequate method for training health professionals to teach pediatric resuscitation and it is well valued by the students. Our experience and methodology can be useful for other teaching groups [14,15,16].

This course is adequate to different health professional groups but some of the them have more difficulties in certain practices.

The involvement of all participants in all practice sessions reinforces learning, since participants mainly learn by acting and correcting themselves.

Availability of data and materials

Anonymous data of the results of the evaluations could ask for the authors.

Abbreviations

CPR:

Cardiopulmonary resuscitation

ERC:

European Resuscitation Council

PALS:

Pediatric Advanced Life Support

PICU:

Pediatric intensive care unit

SPNRG:

Spanish Pediatric and Neonatal Resuscitation Group

References

  1. 1.

    Finn JC, Bhanji F, Lockey A, Monsieurs K, Frengley R, Iwami T, et al. Education, Implementation, Teams Chapter Collaborators. Part 8: Education, implementation, and teams: 2015 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science with Treatment Recommendations. Resuscitation. 2015;95:e203-24.

    Article  Google Scholar 

  2. 2.

    Bhanji F, Donoghue AJ, Wolff MS, Flores GE, Halamek LP, Berman JM, et al. American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular CarePart 14: Education. Circulation. 2015;132(suppl 2):S561–73.

    Article  Google Scholar 

  3. 3.

    Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG; Education and implementation of resuscitation section collaborators. Resuscitation. 2015; 95:288-301

  4. 4.

    López-Herce J, Carrillo A. Iberoamerican Network for Study of Cardiorespiratory Arrest in Childhood. A survey on training in pediatric cardiopulmonary resuscitation in Latin America, Spain, and Portugal. Pediatr Crit Care Med. 2011;12:e200-4.

    Article  Google Scholar 

  5. 5.

    Davis M, Conaghan P. An examination of the theory perspectives underlying the ALSG Generic Instructors Course. Med Teach. 2002;24:85–9.

    Article  Google Scholar 

  6. 6.

    López-Herce J, Carrillo A, Rodriguez A, Calvo C, Delgado MA, Tormo C. Paediatric life support instructors courses in Spain. Spanish Paediatric and Neonatal Resuscitation Group. Resuscitation. 1999;41:205–9.

    Article  Google Scholar 

  7. 7.

    Wada M, Tamura M. Training of neonatal cardiopulmonary resuscitation instructors. Pediatr Int. 2015;57:629–32.

    Article  Google Scholar 

  8. 8.

    Wynne G, Marteau T, Evans TR. Instructors–a weak link in resuscitation training. J R Coll Physicians Lond. 1992;26:372–3.

    Google Scholar 

  9. 9.

    Brennan RT. Student, instructor, and course factors predicting achievement in CPR training classes. Am J Emerg Med. 1991;9:220–4.

    Article  Google Scholar 

  10. 10.

    Kaye W, Rallis SF, Mancini ME, Linhares KC, Angell ML, Donovan DS, Zajano. NC, Finger JA. The problem of poor retention of cardiopulmonary resuscitation skills may lie with the instructor, not the learner or the curriculum. Resuscitation. 1991;21:67-87.

  11. 11.

    Mundell WC, Kennedy CC, Szostek JH, Cook DA. Simulation technology for resuscitation training: a systematic review and meta-analysis. Resuscitation. 2013;84:1174–83.

    Article  Google Scholar 

  12. 12.

    Cheng A, Rodgers DL, van der Jagt É, Eppich W, O’Donnell J. Evolution of the Pediatric Advanced Life Support course: enhanced learning with a new debriefing tool and Web-based module for Pediatric Advanced Life Support instructors. Pediatr Crit Care Med. 2012;13:589–95.

    Article  Google Scholar 

  13. 13.

    Stempien J, Betz M. A prospective study of participants’ and instructors’ opinions on Advanced Cardiac Life Support course teaching methods. CJEM. 2009;11:57–63.

    Article  Google Scholar 

  14. 14.

    López-Herce J, Matamoros MM, Moya L, Almonte E, Coronel D, Urbano J, Carrillo Á; Red de Estudio Iberoamericano de estudio de la parada cardiorrespiratoria en la infancia (RIBEPCI), Del Castillo J, Mencía S, Moral R, Ordoñez F, Sánchez C, Lagos L, Johnson M, Mendoza O, Rodriguez S. Paediatric cardiopulmonary resuscitation training program in Latin-America: the RIBEPCI experience. BMC Med Educ. 2017;17:161.

  15. 15.

    Urbano J, Matamoros MM, López-Herce J, Carrillo AP, Ordóñez F, Moral R, Mencía S. A paediatric cardiopulmonary resuscitation training project in Honduras. Resuscitation. 2010;81:472–6.

    Article  Google Scholar 

  16. 16.

    Young S, Hutchinson A, Nguyen VT, Le TH, Nguyen DV, Vo TK. Teaching paediatric resuscitation skills in a developing country: introduction of the Advanced Paediatric Life Support course into Vietnam. Emerg Med Australas. 2008;20:271–5.

    Google Scholar 

Download references

Acknowledgements

Grupo Madrileño de Cuidados Intensivos Pediátricos (Maria José Santiago, Maria José Solana, Jimena del Castillo, Rafael González, Jorge López, César Sánchez, Andrés Alcaraz, Amelia Sánchez, Sarah Fernández).

Funding

No funds have received for this article.

Author information

Affiliations

Authors

Consortia

Contributions

J LH: concept and design, supervision, drafting the article, final approval of the version to be published. AC: concept and design, supervision, writing review, final approval of the version to be published. JU: concept and design, supervision, writing review, final approval of the version to be published. SM: concept and design, acquisition of data, writing review, final approval of the version to be published. GM: acquisition of data, statistical analysis, interpretation of data, writing review, final approval of the version to be published.

Corresponding author

Correspondence to Jesús López-Herce.

Ethics declarations

Ethics approval and consent to participate

The Ethical Committee of Gregorio Marañón Hospital approved the study.

Participants agree to participate in the study and signed informed consent.

Consent for publication

Not Applicable.

Competing interests

Authors declare no financial conflicts of interest related to this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

López-Herce, J., Carrillo, A., Urbano, J. et al. Evaluation of the pediatric life support instructors courses. BMC Med Educ 21, 71 (2021). https://doi.org/10.1186/s12909-021-02504-2

Download citation

Keywords

  • Cardiopulmonary resuscitation
  • Cardiopulmonary resuscitation instructors
  • Children
  • Pediatric cardiopulmonary resuscitation instructors