Systems Science for Caribbean Health: the development and piloting of a model for guiding policy on diabetes in the Caribbean
- 819 Downloads
Diabetes is highly prevalent in the Caribbean, associated with a high morbidity and mortality and is a recognised threat to economic and social development. Heads of Government in the Caribbean Community came together in 2007 and declared their commitment to reducing the burden of non-communicable diseases (NCDs), including diabetes, by calling for a multi-sectoral, systemic response. To facilitate the development of effective policies, policymakers are being engaged in the development and use of a system dynamics (SD) model of diabetes for Caribbean countries.
Previous work on a diabetes SD model from the United States of America (USA) is being adapted to a local context for three countries in the region using input from stakeholders, a review of existing qualitative and quantitative data, and collection of new qualitative data. Three country models will be developed using one-on-one stakeholder engagement and iterative revision. An inter-country model will also be developed following a model-building workshop. Models will be compared to each other and to the USA model. The inter-country model will be used to simulate policies identified as priorities by stakeholders and to develop targets for prevention and control. The model and model-building process will be evaluated by stakeholders and a manual developed for use in other high-burden developing regions.
SD has been applied with success for health policy development in high-income country settings. The utility of SD in developing countries as an aid to policy decision-making related to NCDs has not been tested. This study represents the first of its kind.
KeywordsSystem dynamics modelling Health policy Policy simulation Non-communicable disease Developing countries Diabetes
Centers for Disease Control
low- and middle-income countries
Port of Spain Declaration
United States of America
Diabetes, the vast majority of which is type 2 diabetes, is estimated to affect over 8% of the global adult population, with 80% of all cases in low- and middle-income countries (LMICs) . Diabetes is associated with a marked increased mortality, particularly in younger and middle-aged adults , and with healthcare costs that are on average two to three times higher than in age- and sex-matched individuals without diabetes . In common with many other middle-income regions and countries, the Caribbean has high diabetes prevalence, estimated to affect between 10% and 20% of most adult populations [1, 4]. Age-adjusted mortality from diabetes in the Caribbean is 35% higher than in the neighbouring United States of America (USA)  and complication rates, where they have been studied, such as lower extremity amputation , are among the highest recorded rates. The prevalence of diabetes continues to rise in the Caribbean, as it does in other LMICs , associated with an increasing prevalence of the major risk factors for type 2 diabetes, especially overweight and obesity, and physical inactivity [7, 8]. The prevention of type 2 diabetes, and the management of people with diabetes, present major challenges to health systems in LMICs.
The threat posed to the economic and social development of the Caribbean by diabetes and related non-communicable diseases (NCDs) was recognised by the Heads of Government summit of the Caribbean Community (CARICOM) in 2007, resulting in the Port of Spain Summit Declaration on NCDs (POSD) . This was a world first for intergovernmental action on NCDs in a middle-income region, and it strongly influenced the initiation and content of the United Nations High Level Meeting on NCDs in September 2011. Both the POSD and United Nations meeting outputs (including the subsequent WHO Global Action Plan ) strongly emphasise the importance of policy measures for reducing NCD risk factors. However, evidence on how to achieve a reduction in overweight/obesity and physical inactivity at the population level is scarce. Despite the fact that governments in CARICOM are publically and officially committed to addressing NCDs, progress on achieving the goals set forth in the POSD has been varied .
It is increasingly acknowledged that the determinants of obesity and physical inactivity are embedded in the organisation of modern societies . Systems science offers advantages over other multilevel or ecological frameworks in identifying the most effective points to intervene . System dynamics modelling has established a methodology for engaging with policymakers and other stakeholders to facilitate broader thinking on the mechanisms and effects of complex problems such as type 2 diabetes and other NCDs. This includes the use of stakeholder in-depth interviews and group model building workshops to build and refine qualitative conceptual system models and quantitative models, and can use games or ‘flight simulators’ for appraising the potential impact of different policy options as an aid to policy decision-making .
System dynamics models in diabetes and NCDs
System dynamics models have been recognised for their importance and potential in public health  and successfully used in high-income settings, especially in the USA, in guiding policy for the prevention and control of NCDs. The Centers of Disease Control and Prevention (CDC) sponsored the development of disease models for diabetes  and obesity , as well as a national chronic disease strategy  that enabled simulation of the trajectories of NCDs and supported appropriate public health planning in the country. Another more locally-based model looked at health planning and system structure for NCD management and prevention  in Washington State. Beyond the USA, New Zealand adapted the USA Cardiovascular Disease Prevention model  to its context and used it for health planning, while a team in Canada developed a stratified model to look at the social determinants of disease in Toronto and its effects on underserved populations . While all of these models show promise in using system dynamics methodologies for health policy and planning, none have been extended to NCDs in LMICs or engaged directly with policymakers.
The study described here is adapting and developing a system dynamics model to guide policy on the prevention and control of diabetes in a middle-income region, using a process designed to fully engage with policymakers and other multi-sectoral stakeholders, and evaluate the utility of the process and resulting simulation model from their perspective.
The overarching aim of the study is to use system dynamics modelling to explain the rise in the diabetes burden for middle-income countries in the Caribbean and assist in policy decision-making through appraising the potential impact of different strategies and policies for prevention and control.
Undertake, with policymakers and other stakeholders, in-depth interviews and a quantitative data evidence review on the systems driving obesity, physical inactivity and access to effective diabetes care
Accordingly develop a model for use in the Caribbean, based on the conceptual models and evidence reviews
Use, along with policymakers, the simulation model to explore the potential impacts and interactions of different policy options, including the feasibility of achieving relevant targets from the WHO Global Monitoring Framework 
Evaluate from the perspectives of the policymakers and stakeholders the utility of both the qualitative and quantitative aspects of the modelling process
Setting and target populations: building on the POSD evaluation study
Middle-income countries were chosen to evaluate system dynamics methodologies in health in resource-limited settings. One country is Jamaica, as the largest English-speaking middle-income country in the Caribbean. The second is Belize, which is politically and culturally part of the Caribbean, but has a unique environment being a Central American mainland, English-speaking middle-income country with access to data on diabetes prevalence, risk factors and its effects from continuing monitoring in the country. The third is St Vincent and the Grenadines, a small, middle-income island nation.
Development of an initial conceptual model
This initial concept model will be used to engage stakeholders and promote systems thinking during in-depth interviews. The model focuses explicitly on incorporating shared risk factors for NCDs and their upstream determinants, which are potential targets of policy interventions. Total diabetes prevalence will be used as the primary outcome measure of interest (in system dynamics referred to as the ‘reference mode’) for policy interventions.
The interviews will be used to gather qualitative data from stakeholders on their perspectives regarding diabetes, its determinants, and effects in their own countries and the region. The development will be an iterative process with each phase informing the other, thus refining the model. As part of this iterative process, the model structure will be compared to the CDC diabetes model . This will provide an additional way of promoting critical consideration of the model structure through understanding the basis and the consequences of any differences.
Review of existing qualitative data and stakeholder selection
The POSD evaluation study conducted in-depth interviews with NCD experts in countries on their views regarding progress on policies laid out by the POSD. Using data collected from the evaluation the investigators will undertake a formal thematic qualitative analysis of existing interview data as it relates to drivers and determinants of the diabetes system in the region, particularly to the upstream determinants of diet and physical activity through obesity. The review will also be used to identify stakeholders to be invited to participate in and for follow-up in-depth interviews, and insights from the prior interviews will be revisited and discussed in these planned follow-ups. Further stakeholders will be identified using snowball sampling and referral from contacts within and using the existing POSD network in the three project countries. For practical reasons, and in keeping with recommendations for model building , no more than 10 stakeholders will be selected for each country.
Review of quantitative evidence
A systematic literature review will provide evidence on the quantitative historical relationships between variables in the model. The empirical data will be used to calibrate the model. A systematic review is being conducted of studies performed within the last 10 years in the Caribbean describing the prevalence of type 2 diabetes, its risk factors and their social determinants, and healthcare coverage and outcomes in people with diabetes. This evidence review will build upon recent scoping and systematic reviews into the social determinants of diabetes in the Caribbean . In addition, any available, unpublished, datasets in the three project countries will be identified. This will be facilitated by the POSD evaluation and ongoing work collating mortality and risk factor datasets within the CARICOM countries. In addition, stakeholders will be asked during the qualitative interviews, if they know of any local datasets.
In the absence of sufficient quantitative data from the Caribbean for a relationship within the conceptual model, it will be necessary to use data for calibration from other parts of the world. Care will be taken to use data matching a context and ethnic mix as close as possible to the Caribbean populations and such data will be assumed to come with greater uncertainty in the calibration exercise.
Stakeholder interviews and new data collection
Stakeholders for the in-depth qualitative interviews will involve members of the Ministries of Health, including the Chief Medical Officer or NCD focal point, other relevant government ministries, such as education, transport and agriculture; leaders from civil society organisations, including diabetes organisations and church groups; and prominent private sector leaders.
A semi-structured interview guide will be used, eliciting stakeholders’ estimation and gaining feedback on the draft preliminary model, and contextual information of trends in diabetes, obesity and physical inactivity, and the underlying determinants in their settings; similarly, stakeholder views on trends in access to diabetes care and determinants of blood glucose, pressure, and lipid control and their determinants will be explored. All interviews will be recorded, transcribed verbatim and analyzed thematically , and used to generate causal maps .
Country-level model building
A conceptual model will be developed for each of the three study countries using stakeholder input and data gathered from the evidence review. Stakeholders will be given a report of the conceptual model and given an opportunity to submit changes for one round of iteration. The models will be finalised and a quantitative model produced for each country using country-level data where possible. The models will be compared and simulations will be produced using a single set of policies and scenarios for testing.
Group model building and an inter-country regional model
The investigators will use a revised conceptual model to include input from country-level work as the basis for the development of an inter-country regional model. The model development will include stakeholders with regional expertise who will meet for a group model building workshop. Over 2 days, the workshop will provide an introduction to system dynamics modelling and systems thinking to stakeholders to develop a regional diabetes model. Following the model building workshop, stakeholders will be given two opportunities for revision and feedback. These comments will be included in the revision and development of the model. Once there is general agreement from stakeholders on the conceptual model, evidence from quantitative data collection will be applied to develop a quantitative model.
Quantitative inter-country regional model, validation and policy simulations
Once the conceptual model has been finalised, estimates for each of the parameters and variables will be incorporated using data obtained from the quantitative data collection. The model will be used to try and replicate trends in risk factors and outcomes available from studies in the region as much as possible from 2000 to the present. One of the time frames that will be used for simulations is to 2025 in order to help guide potential policies for achieving relevant targets of the WHO Global Monitoring Framework . The model will also be extended to 2050 to give enough time to assess the presence and influence of slow feedback mechanisms. Testing the model will involve undertaking sensitivity analyses for the parameters included and also ‘extreme case’ modelling  will help to assess the plausibility of the simulations being produced.
The primary targets for the option appraisal and simulation will be centred on policy recommendations generated from the POSD evaluation study, relevant targets in the Global Monitoring Framework, and policies identified by stakeholders, including no increase in obesity or diabetes prevalence by 2025, and a reduction in premature diabetes mortality by 25%. Various alternative scenarios, including adoption and implementation of policies related to risk factors and treatment, exogenous scenarios and testing one against the other, will be evaluated using the simulations. Potential policies will be evaluated alone and in plausible combinations, as guided by stakeholders, against a timeline of achievement by 2025, without a time horizon, and estimating a time horizon for achievement.
Special attention will be put into stratifying the model by gender and socioeconomic status to explore how the potential interventions for the prevention and control of diabetes impact on health equity.
Stakeholder model evaluation
Once the quantitative model has been tested, a simulation test environment (management flight simulator) will be developed for stakeholders to interact with the model. Stakeholders will be interviewed and surveyed to gather feedback on the model building process, utilisation of the simulation tool, and how process and outputs could be made more useful to them.
The study has been submitted for ethical review and approved by the University of the West Indies, Cave Hill/Barbados Ministry of Health Research Ethics Committee/Institutional Review board.
The model is being constructed as part of a development project with a view toward expanding in the future. One area of particular interest is the incorporation of economic and cost estimates to the simulations to better serve policymakers in understanding ‘best buys’ and the cost-benefit relationships related to the policy choices being modelled. As part of this effort, the project is looking to establish external collaborations with economists in the region and those with expertise in systems thinking.
Diabetes shares risk factors and outcomes with the other three major classes of NCDs (cardiovascular disease, chronic lung diseases and cancers). Together, these four disease categories make up 82% of all deaths due to chronic disease and the burden is especially high in LMICs . It is of high public health importance to consider the burden and effects of all NCDs in the CARICOM region. As a result, any further development of the model must take into account how interventions affect the shared risk factors and outcomes of all of these diseases. In addition, in keeping with system dynamics methodology, the model will be considered as in development with further iteration, adaptation and modification encouraged for its improvement.
The model is designed to promote the engagement of policymakers in evidence-based decision-making and policy design. Collaboration between researchers and policymakers and skills-building are major determinants influencing the use of evidence for supporting policy . The protocol described here makes explicit these interactions through group model building and integrates learning in systems modelling and interpretation for policymakers. Furthermore, the continued development of the model with stakeholders will provide a platform for sustained interaction and engagement in policy development and support.
The methodology used for the development of the model may also be of interest to other developing countries facing a similar diabetes burden under constrained resources. The methodology will be written up as a manual for use by other interested regions and in particular Small Island Developing States, including in the Western Pacific and Indian Ocean, faced with similar disease burdens, policy issues and resource constraints as the Caribbean region.
The authors would like to thank contributions from colleagues at the University of the West Indies Chronic Disease Research Centre.
The project is funded by a health initiatives development grant sponsored by the DFID/MRC/Wellcome Trust/ESRC. Reference: MR/N005384/1.
Availability of data and material
Upon completion, the model and its supporting data will be made available through a publicly accessible website. Please contact the corresponding author for details.
NU (principal investigator) had the original idea for the study and led the design of the study and the writing of the original protocol, the applications for grant funding and ethical approval, and this manuscript. CG, LG, JW and ER (co-investigators) contributed to the design and the writing of the original protocol and grant application. CG devised the qualitative data collection, sampling and analysis element of the study. JW and ER contributed to the development of the design for model development and group model building. IH (co-investigator) contributed to the development of the quantitative data collection and analysis. TAS (co-investigator) contributed to the policy analysis and stakeholder identification and engagement strategy. LG (study coordinator and research lead) contributed to the design, protocol and applications for ethical approval for parts of the study. All authors contributed to the critical revision of the paper and approved the final version.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study has received ethical approval from the University of the West Indies Cave Hill/Barbados Ministry of Health Research Ethics Committee/Institutional Review Board. Written informed consent will be sought from study participants.
- 7.Ng M, Fleming T, Robinson M, Thomson B, Graetz N, Margono C, et al. Global, regional, and national prevalence of overweight and obesity in children and adults during 1980–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384(9945):766–81.CrossRefPubMedPubMedCentralGoogle Scholar
- 9.Declaration of Port-of-Spain : Uniting to stop the Epidemic of Chronic NCDs. 2007. http://caricom.org/media-center/communications/statements-from-caricom-meetings/declaration-of-port-of-spain-uniting-tostop-the-epidemic-of-chronic-ncds. Accessed 11 Mar 2016.
- 13.Kumanyika SK, Parker L, Sim LJ. Committee on an Evidence Framework for Obesity Prevention Decision Making; Food and Nutrition Board; Institute of Medicine. Bridging the Evidence Gap in Obesity Prevention: A Framework to Inform Decision Making. Washington, DC: National Academies Press; 2010.Google Scholar
- 14.Vennix JAM. Group Model Building: Facilitating Team Learning Using System Dynamics. New Jersey: Wiley; 1996.Google Scholar
- 17.Homer J, Milstein B, Dietz W, Buchner D, Majestic E. Obesity population dynamics: exploring historical growth and plausible futures in the US. http://www2.cdc.gov/syndemics/pdfs/Obesity%20population%20dynamics%20(Homer,%20ISDC-06).pdf. Accessed 11 Mar 2016.
- 22.World Health Organization. Draft comprehensive global monitoring framework and targets for the prevention and control of noncommunicable diseases. Geneva: WHO; 2013. (Sixty-sixth World Health Assembly). Report No.: A66/8.Google Scholar
- 24.Hovmand P. Community Based System Dynamics. Berlin: Springer Science & Business Media; 2013.Google Scholar
- 26.Green J, Thorogood N. Qualitative Methods for Health Research. Thousand Oaks: SAGE Publications; 2004.Google Scholar
- 28.Barlas Y. Model validation in system dynamics. In: Proceedings of the 1994 International System Dynamics Conference. Scotland: Sterling; 1994. p. 1–10. http://www.systemdynamics.org/conferences/1994/proceed/papers_vol_1/barla002.pdf. Accessed 11 Mar 2016.Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.