Effectiveness of an app-based intervention for unintentional injury among caregivers of preschoolers: protocol for a cluster randomized controlled trial
- 512 Downloads
Each year, over 15,000 preschoolers die from unintentional injuries in China. Many interventions proven to work in other nations have not been implemented nationwide in China. The rapid popularity of smartphones offers an opportunity to overcome this limitation and disseminate evidence-based interventions to the large population of China. This study aims to assess the effectiveness of an app-based intervention for caregivers of preschoolers to prevent unintentional injury among young Chinese children.
A single-blinded, 6-month, parallel-group cluster randomized controlled trial with 1:1 allocation ratio will be conducted in Changsha, China. In total, 2626 caregivers of preschoolers ages 3–6 years old who own a smartphone will be recruited from 20 preschools. Clusters will be randomized at the preschool level and allocated to either the control group (routine education plus app-based parenting education excluding unintentional injury prevention) or the intervention group (routine education plus app-based parenting education including unintentional injury prevention). The app-based injury prevention program was developed based on the Theory of Planned Behavior, the Haddon Matrix, the Mobile Learning framework, and a needs assessment. Data collection will be conducted at baseline, 3-month, and 6-month follow-up via app-based survey plus printed questionnaire survey. The primary outcome measure is unintentional injury incidence among preschoolers in the past 3 months. Secondary outcome measures include economic losses due to unintentional injury in the past 3 months, the Incremental Cost-Effectiveness Ratios (ICERs), and parent’s attitudes and behaviors concerning supervision to prevent preschooler unintentional injury in the past week. An intention-to-treat approach will be used to evaluate outcome measures. Chi-square tests will examine differences for outcome measures between groups at each time point and generalized estimation equations (GEE) will test the overall effectiveness of the app-based intervention. Missing outcome data will be imputed using the Expectation Maximization algorithm (EM).
This trial will examine evidence concerning the effectiveness of an innovative app-based intervention for caregivers of Chinese preschoolers. If effective, the app-based intervention could offer an effective population-based intervention option to cost-effectively promote unintentional injury prevention in countries and regions where injury control is under-supported.
ChiCTR-IOR-17010438. Registered 15 January 2017.
KeywordsUnintentional injury Preschoolers Cluster randomized controlled trial Application (app) Mobile health Intervention
Consolidated standards of reporting trials
Expectation maximization algorithm
Frequently asked questions
Generalized estimation equation
International statistical classification of diseases and related health problems 10th revision
The incremental cost and effectiveness ratios
National institute for health and clinical excellence
Standard protocol items: recommendations for interventional trials
Unintentional injury is a major public health problem for children in China. In 2016, over 15,000 children under five years old died from unintentional injury in China .
Poor supervision skills, poor caregiver perception of child injury risk, and risky child behaviors are reported as major risk factors for preschooler unintentional injury [2, 3, 4]. A systematic review indicated the most effective parenting interventions to reduce young children’s injuries were provided within the home using multi-faceted interventions . However, interventions that have proven effective in other countries – including both multifaceted home-based interventions as well as other programs (e.g., child restraint legislation ; providing safe places away from water for young children; installing barriers controlling access to water ) – have not been widely implemented in China, largely due to lack of governmental support for injury control [8, 9, 10].
The rapid development of mobile health (mHealth) strategies, plus extensive smartphone penetration among Chinese parents, offers an opportunity to overcome barriers to child injury prevention in China since empirically-supported parenting interventions could be delivered broadly and cost-effectively to caregivers using mobile health technology. According to official statistics, over 1.2 billion Chinese were accessing to internet through smartphones in March, 2018 . A recent systematic review by Omaki et al.  provides evidence of the effectiveness of computer-based communication in conveying information and influencing risk perception and safety behaviors; the review is support by empirical research from an RCT that concluded an intervention with web-based, tailored, safety advice combined with personal counseling is more effective than generic written materials to promote parents’ safety behavior for safe staircases, storage of cleaning products, bathing, drinking hot fluids, and cooking .
Few smartphone app interventions have been developed to help parents prevent unintentional injuries among their children, and most existing app-based interventions focus on a specific injury cause such as road traffic injury [14, 15, 16], or fire  and burn  prevention. All were conducted in high-income countries (HICs) and all were assessed only with knowledge, perception and behavioral outcomes. The present study extends the field to a middle-income country  and includes injury morbidity as a primary outcome.
This proposed study aims to evaluate the effectiveness of an app-based intervention developed based on relevant scientific theories (e.g., Theory of Planned Behavior, the Haddon Matrix, and the Mobile Learning framework) to prevent unintentional injury incidence among preschoolers through changing parental behavior. We also sought to improve safety-related knowledge, attitudes, and behaviors of the caregivers.
A single-blinded, 6-month follow-up, parallel-group cluster randomized controlled trial with 1:1 allocation ratio will be implemented in Changsha, China. This study will be conducted, analyzed and reported according to the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement: extension to cluster randomized trials  and strict adherence to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guidelines (Details of the SPIRIT 2013 Checklist is provided in Additional file 1) . Ethical approval for the study was obtained from the Ethics Committee of Xiangya School of Public Health, Central South University (No. XYGW-2017-02). All participants will be adults who provide informed consent online prior to receiving the interventions in both groups and all data will be analyzed anonymously.
All schools involved in the study will receive honoraria at months 1, 3, and 5, when assigned tasks are completed (recruiting study participants, sending messages to participants to promote regular app use).
All primary caregivers of preschoolers from participating schools will be eligible to participate in the study. We will exclude caregivers who do not own smartphones. We will include any adult who serves as primary caregiver for preschoolers aged 3–6 years old; most participants are expected to be parents or grandparents, but other family members, friends of the family, and baby-sitters or nannies will be eligible . One teacher will be recruited at each selected school to inform eligible caregivers about the study via existing school-family communication channels, including social media platforms (WeChat and QQ), school apps, printed hand-outs, and oral notification. Caregivers who agree to consider participation will be provided a leaflet with an invitation letter, an information sheet outlining the benefits and responsibilities of project participation, and instructions to download, install and use the app.
Upon downloading the app for the first time, participants will view an online informed consent. Consenting participants will then be asked to complete an online baseline survey that collects information on demographic characteristics, attitudes toward child injury prevention, supervision behaviors in the prior week, and occurrence and details (including related costs) about any unintentional injury to their child in the past 3 months.
Sample size was calculated based on our primary hypothesis, to detect a difference between the intervention and control groups in unintentional injury incidence among preschoolers in the prior 3 months. Previous studies reported an unintentional injury incidence of 25.5% among preschoolers in central China in the past 1 year  and an effect size of 0.64 between intervention and control groups . Considering 1 year recall periods underestimate injury rates by 55 and 72% (most are minor injuries) compared with one-month recall periods [24, 25], and use of a strict operational definition that restricts injury events to those that cause activity restriction of 1 day or longer or are treated by a doctor or other medical professional substantially undercounts injury events (typically minor or moderate injuries) , we assume unintentional injury incidence among preschoolers in the past 3 months will be 23%. On the basis of a previous report , we estimate an intra-class correlation (ICC) of 0.005 within a preschool of 140 students. Predicting an incidence of 23% in the control group, an effect size of 0.75 between intervention and control groups, and an ICC of 0.005, α = 0.05, 1-ß = 0.80, a minimum sample size of 1181 caregivers is needed for each group. Conservatively estimating an attrition rate of 10% in the six-month follow-up study, we will require a recruited sample size of 1323 each group. In total, therefore, we will enroll 2626 participants. Since most preschools have far more than 100 students enrolled, 20 preschools are amply sufficient to recruit the needed sample size.
Randomization and blinding
Once recruited, each preschool will be randomly allocated to a group by an independent (masked) researcher. The allocation sequence will be generated by SAS 9.2 software and the sequence will be sequentially numbered, opaque, sealed envelopes until interventions assigned. The contents of the app-based interventions prohibit masking of randomized condition to participants. Group allocation will be masked during data analysis.
Interventions for control and intervention groups
We will provide the participants in both experimental groups with an app-based parenting education program that targets training on pediatric diseases and parenting skills but excludes information about unintentional injury prevention. The education program will use short essays, games, cartoons and videos to disseminate knowledge and skills about optimal parenting of young children. The content, interaction, survey and feedback, and personal module of app will be identical for both groups.
The intervention group’s app will have additional components that are focused on unintentional injury prevention. As detailed below, the intervention group’s app will have features geared particularly toward parenting and education on child injury prevention, including some features that rotate seasonally (e.g., drowning prevention in summer).
Both parenting and injury prevention features in the app will be available throughout the intervention time period so that the users can retrieve any information they want on a repeated basis.
The intervention was developed based on the Theory of Planned Behavior , the Haddon Matrix , the Mobile Learning framework , and a needs assessment that consists of focus groups and online surveys among key stakeholders (including local caregivers of preschoolers and preschool teachers).
Content learning: Content learning includes lessons to teach caregivers basic knowledge concerning prevention of ten common causes of unintentional injuries: exposure to animate mechanical forces (including animal bites and being trampled or bumped into by another person); exposure to inanimate mechanical forces (including pinched, cut or punctured by lifts and other objects); falls (including falls from heights); contact with heat and hot substances; exposure to smoke, fire and flames; transport accidents; accidental threats to breathing; unintentional poisoning by and exposure to noxious substances; unintentional drowning and submersion; and exposure to electric currents.
We will convey empirically-supported injury prevention knowledge to caregivers using strategies developed through focus groups among caregivers, discussion among content experts, and pilot testing. The needs assessment will guide decisions concerning the modes of training (e.g., through short written statements with pictures, cartoon vignettes, video testimonials, interactive games) and the length of each aspect of knowledge disseminations (expected to be somewhere in the 2–5 min range).
Interaction: Three modules will be created to facilitate communication between users (study participants) and between users and injury prevention experts: the forum module, the expert consultation module, and the user comments module. The forum module (Fig. 3d) will allow users to read and discuss specific topics with each other. Two forum topics will be released each week, one for parenting skills outside injury prevention (released to both intervention and control group) and the other focused specifically on unintentional injury prevention (intervention group only). A week later, discussion records will be reviewed by an expert in injury prevention and parenting, who will answer questions presented on each topic and provide expertise on the matter.
The online expert consultation module (Fig. 3e) will be organized to focus on a particular topic related to injury prevention for the intervention group each month. In it, caregivers will ask experts questions through online chatting and the expert will provide private and individualized responses.
Survey and feedback: The questionnaire module (Fig. 3f) will support online data collection. The module will incorporate several strategies to encourage questionnaire completion. If an online questionnaire is not completed, a reminder notice will appear on the scroll screen when the user turns on the app. Further, automated text messages will be delivered to users 1 week before completion deadlines.
Personal modules: Research suggests health education compliance and health behavior change is more likely if users can engage personally and feel “connected” to the program . Thus, we will allow participants to select the color of the interface in their app according to their preferences (e.g., pink, yellow, blue) (Fig. 3h).
Approaches to increase compliance to the intervention
Four approaches will be implemented to encourage participation and increase compliance with using the app. First, participants will be awarded virtual currency during use, which can be exchanged for incentives such as wireless internet fees for smartphone and data use. Second, participants who complete log-ins for 7 days, as recommended, will be entered into a lottery to win additional virtual currency prizes. Third, coordinating teachers at each preschool will remind participants to use the app through multiple school-family communication platforms weekly (e.g., social media platforms). Finally, we will offer monthly awards to the three students in each classroom whose caregivers use the app with the greatest frequency with a small gift (about 5 Chinese Yuan).
Prior to the formal experiment, 20 caregivers of preschoolers will be recruited for feasibility testing, 10 in the intervention group and 10 in the control group. Following a two-week pilot testing period, participants will be asked to complete an online usability/feasibility questionnaire that addresses their evaluations of the contents, readability, app functions, app interfaces and operability of the app. The results of testing will guide refinement of the app and survey questionnaires prior to the full study.
Primary outcome measure
The primary outcome measure will be the incidence of unintentional injury among preschoolers in the prior 3 months, as collected both at 3-month and 6-month follow-up visits. Following previous epidemiological studies , we define an injury event as one that meets any of the following criteria: (i) child receives medical treatment by a doctor or other medical professional following an injury; (ii) child receives first aid by a family member, teacher or other non-medical staff following an injury (e.g. takes medication, receives massage or hot compress); and/or (iii) child is restricted from school or other activities, or is kept in bed/rest for more than a half-day following an injury.
Given cultural patterns in China, we anticipate most participants will be caregivers who oversee one single child who meets inclusion criteria, and most families will have just one preschooler when the caregivers are recruited. If an adult caregiver takes care of more than one preschooler, we will enroll only the youngest child when calculating injury incidence. Along with recording injury counts (frequency), we will code external causes of unintentional injury based on the International statistical Classification of Diseases and related health problems 10th revision (ICD-10) .
Secondary outcome measures
Caregiver attitudes toward unintentional injury prevention and safety behaviors among preschoolers will be assessed through a 17-item questionnaire. Items will focus on attitudes over the past week; the instrument was validated in previous epidemiological studies and is considered reliable and valid [34, 35]. Two items focus on caregivers’ attitudes for unintentional injury prevention and are assessed using a 4-point scale (completely, partly, not at all, don’t know): (a) Do you think child unintentional injury is largely preventable? and (b) Do you think you can help keep your child free from unintentional injuries? The remaining fifteen items assess caregiver report on the frequency of child’s risky behaviors over the past week, both indoors and outdoors (e.g., leave the child alone in the bathtub; require the child to use a helmet, wrist guard and other protective equipment when riding a bicycle, e-bike, or motorcycle).
Caregiver report on economic losses due to unintentional injury will be measured through a 5-item questionnaire that assesses both direct economic costs caused by unintentional injury (medical treatment expenses; transportation expenses to and from hospital/clinic; payment to hire other persons to take care of the injured child; accommodation expenses for the caregivers who look after hospitalized children) and indirect economic costs that are the consequence of unintentional injury events (e.g., caregiver economic loss from being off work).
We will also consider the Incremental Cost-Effectiveness Ratios (ICERs) for the app-based unintentional injury intervention. Cost-effectiveness analysis of the app-based unintentional injury intervention will follow National Institute for Health and Clinical Excellence (NICE) guidance on cost-effectiveness evaluation of public health interventions . We will collect data on capital and time costs. Economic costs will consist of subsidies to the researchers and teachers paid by this project, costs for developing and maintaining the app-based interventions, and costs for efforts to increase compliance to using the app-based interventions Caregiver’s time costs will be collected retrospectively for the 6-month follow-up. Because many caregivers may be reluctant or untruthful in reporting their exact wages (individual incomes are regarded as highly private information by many adults in China), we will use the average salary in Changsha, China to calculate the product of total lost months due to taking care of the injured children to estimate the indirect economic loss for adult caregivers because of being off work.
The app-based unintentional injury intervention will be compared to app-based non-injury intervention to assess the incremental costs and benefits of implementing the intervention . The ICERs are calculated as the cost difference between the intervention group and the control group divided by the difference in the number of children experiencing unintentional injury events between the two arms during the prior 6 months (after combining data from the two follow-up surveys). Bootstrap sampling will be used to calculate 95% uncertain interval of the ICERs.
Data will be collected at three time points: baseline, 3 months post-intervention, and 6 months post-intervention. All data will be collected through app-based online surveys and will be stored in the backend database of app with password limiting the access. If caregivers fail to complete app-based surveys, we will provide printed paper questionnaires to participants through the support of facilitating teachers. In addition, an independent app-based survey among a sample of 100 caregivers will be conducted at each time period to test the reproducibility of collected data.
We also will collect compliance data through electronic strategies embedded in the app. These will include frequency of login, length of time using the app at each log-in, the number of knowledge disseminations used and listed as bookmarks, the number of published comments, and so on.
Data analysis plan
Analysis will follow the intention-to-treat approach . Descriptive data (mean, standard deviation, median, inter-quartile range, proportion) will be calculated to describe the characteristics of primary and secondary outcome measures and covariates. Chi-square test (categorical outcomes) and two sample independent t-test (continuous outcomes) will examine differences in unintentional injury incidence and other outcome indicators between the two arms at each time point (baseline, 3 months, 6 months). Chi-square test (categorical outcomes) and analysis of variance for repeated measurement data (continuous outcomes) will detect differences across the three time points for each arm.
The primary analysis will be conducted through Generalized Estimation Equation (GEE) models, which will test the effectiveness of the app-based intervention based on the interaction of group (intervention vs. control) with time (baseline, 3 months, 6 months) after adjusting for socio-demographic variables (age, sex, household income) and compliance to the intervention (use of the app-based interventions).
Missing values will be imputed using the Expectation Maximization algorithm (EM). To test the robustness of results, sensitivity analysis will be conducted by comparing primary and secondary outcome data collected through the online app-based survey and those completed using a printed questionnaire survey. Statistical analysis will be performed through Stata/IC 12.1. Statistical significance will be based on 2-sided tests at the level of 0.05.
Planned subgroup analysis
Subgroup analyses will be performed to assess the impact of demographic factors, including gender, age, type of children’s caregivers (e.g., parents, grandparents, others), education level of caregivers, and household income per capita per month. Subgroup analyses will follow primary analyses.
Smartphone apps are emerging as an effective, low-cost platform to disseminate health and safety information [39, 40]. They offer great potential for injury prevention, particularly in countries and regions where injury control resources are limited but smartphone penetration is high.
This trial is designed to evaluate the effectiveness of an app-based intervention to prevent unintentional injuries to preschool-aged children in Changsha, China. The app-based intervention targets caregivers by educating them about the most common unintentional injury causes for Chinese preschoolers. It is developed based on relevant theories [28, 29, 30], empirical research evidence, and a systematic needs assessment, and it is anticipated that it will result in both knowledge acquisition and behavior change on the part of the caregivers. Unlike most published trials, it will use injury incidence as the primary outcome measure.
We also will conduct economic analyses to demonstrate the cost benefit of the app. If our hypotheses prove true, we anticipate the app could be readily and cost-effectively disseminated across China, yielding substantial public health benefit by reducing unintentional injuries among preschoolers .
This project is funded by the National Natural Science Foundation of China (No: 81573260). The funding body had no role in the design, collection, analysis or interpretation of this study.
Availability of data and materials
Raw data will be uploaded to the ResMan sharing platform within 6 months after the trial ends.
GH received funding for the project and contributed to the design of the trial with assistance from PN, PC, YY, DCS, JD, RY and SL; PN and BC drafted the manuscript, CPX, YY, JD, RY and SL substantially contributed to the writing of the manuscript, and GH and DCS finalized the manuscript; GH and YY will lead the statistical analysis and the randomisation procedure. All authors read and approved this final manuscript.
Ethics approval and consent to participate
Ethical approval for the study was obtained from the Ethics Committee of Xiangya School of Public Health, Central South University (No. XYGW-2017-02). All participants will provide informed consent online prior to commencing the study.
Consent for publication
Guoqing Hu is an Associate Editor for BMC Public Health, none of the other authors have any competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 1.GBD compare. Institute for Health Metrics and Evaluation. 2017. https://vizhub.healthdata.org/gbd-compare/. Accessed 4 May 2018.
- 2.Khatlani K, Alonge O, Rahman A, Hoque DME, Bhuiyan AA, Agrawal P, et al. Caregiver supervision practices and risk of childhood unintentional injury mortality in Bangladesh. Int J Environ Res Public Health. 2017;14(5) https://doi.org/10.3390/ijerph14050515.
- 6.Global Status Report on Road Safety 2015. World Health Organization. 2015. http://www.who.int/violence_injury_prevention/road_safety_status/2015/en/. Accessed 6 May 2018.
- 7.Preventing drowning: an implementation guide. World Health Organization. 2017. http://apps.who.int/iris/bitstream/handle/10665/255196/9789241511933-eng.pdf?sequence=1. Accessed 6 May 2018.
- 9.Hu G, Li L. Strengthen the role of the health sector in injury prevention and controlling of injuries. Injury Medicine (Electronic Edition). 2016;5(1):1–3. https://doi.org/10.3868/j.issn.2095-1566.2016.01.001.CrossRefGoogle Scholar
- 11.The Economic Operation of the Communications Industry in March 2018. Ministry of Industry and Information Technology of the People's Republic of China. 2018. http://www.miit.gov.cn/n1146312/n1146904/n1648372/c6145488/content.html. Accessed 4 May 2018.
- 14.Gielen AC, Bishai DM, Omaki E, Shields WC, McDonald EM, Rizzutti NC, et al. Results of an RCT in two pediatric emergency departments to evaluate the efficacy of an m-health educational app on car seat use. Am J Prev Med. 2018;3797(18):31587–3. https://doi.org/10.1016/j.amepre.2018.01.042.CrossRefGoogle Scholar
- 19.Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomized trials. BMJ. 2010; https://doi.org/10.1136/bmj.c869.
- 20.Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-JerićK, et al. Spirit 2013 statement: defining standard protocol items for clinical trials. Rev Panam Salud Publica. 2015;38(6):506–14. https://doi.org/10.7326/0003-4819-158-3-201302050-00583. PubMedPubMedCentralCrossRefGoogle Scholar
- 21.Guardianship of children. Community Law. 2004. http://communitylaw.org.nz/community-law-manual/chapter-26-parents-guardians-and-caregivers/guardianship-of-children-chapter-26/. Accessed 20 Dec 2017.
- 22.Yin L, Li F, Chen L. A meta-analysis of incidence rate of injuries among preschool children in China. Chin J Control Prev. 2017;21(10):1022–6. https://doi.org/10.16462/j.cnki.zhjbkz.2017.10.013.CrossRefGoogle Scholar
- 23.Li L, Wang G, Zhao D, Qu J. Effectiveness evaluation for preschool children with health education to reduce unintentional injuries. CJCHC NOV. 2011;19(11):1056–7.Google Scholar
- 26.Tian D, Deng X, Li L, Yang J, Gao L, Huang Y, et al. Influence of operational injury definitions on the injury incidence in urban residents 18 years and older. Injury Medicine (Electronic Edition). 2013;2(2):32–5. https://doi.org/10.3868/j.issn.2095-1566.2013.02.007.CrossRefGoogle Scholar
- 27.Coupland C, DiGuiseppi C. The design and use of cluster randomised controlled trials in evaluating injury prevention interventions: part 2. Design effect,sample size calculations and methods for analysis. Inj Prev. 2010;16(2):132–6. https://doi.org/10.1136/ip.2009.023127.CrossRefPubMedGoogle Scholar
- 28.IcekAjzen. The theory of planned behavior. In: Gino F, Brown D, editors. Organizational Behavior and Human Decision Processes. Massachusetts: Academic; 1991. p. 179–211.Google Scholar
- 30.Yin C, Song Y, Tabata Y, Ogata H, Hwang G-J. Developing and implementing a framework of participatory simulation for mobile learning using scaffolding. Educational Technology & Society. 2012;16(3):137–50.Google Scholar
- 33.International statistical classification of diseases and related health problems 10th revision (ICD-10) for 2016. 2016. http://apps.who.int/classifications/icd10/browse/2016/en. Accessed 14 Jan 2018.
- 36.Methods for the development of NICE public health guidance (third edition). National Institute for health and care excellence. London. 2012. https://www.nice.org.uk/. Accessed 24 Sept 2017.
- 37.Breheny K, Adab P, Passmore S, Martin J, Lancashire E, Hemming K, et al. A cluster randomized controlled trial evaluating the effectiveness and cost-effectiveness of the daily mile on childhood obesity and wellbeing; the Birmingham daily mile protocol. BMC Public Health. 2018;18(1):126. https://doi.org/10.1186/s12889-017-5019-8.CrossRefPubMedPubMedCentralGoogle Scholar
- 39.Abroms L, Padmanabhan P, Evans W. Mobile phones for health communication to promote behavior change. In: Noar S, Harrington N, editors. E-health applications: promising strategies for behavior change, vol. 1. New York, NY: Routledge; 2012. p. 147–66.Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.