Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

The role of causal inference in health services research I: tasks in health services research

Introduction

In a recent issue of the American Journal of Public Health, Hernán and other colleagues strongly plea for causal thinking in scientific research where the research question investigates consequences of decisions and interventions (Ahern 2018; Begg and March 2018; Chiolero 2018; Glymour and Hamad 2018; Hernán 2018a, b; Jones and Schooling 2018). Hernán argues that causal reasoning improves quality of observational research; however, the causal terminology is often loomed by the ‘association is not causation’ argument and is viewed with skepticism (Hernán 2018b). Health services research (HSR) supports decision making by investigating the effect of complex ‘interventions’ or ‘policies’ on different healthcare system outcomes (Glass et al. 2013). Thus, some of the research questions in HSR are inherently causal. Surprisingly, there is no consensus on how to integrate causal inference into tasks of HSR (Dowd 2011; O’Malley 2011; Pearl 2011; Hernán et al. 2019). Typically, tasks in data science are classified into ‘description’, ‘modeling’ and ‘causal inference’ (Hernán et al. 2019). In the present Hints and Kinks, we explain why a solidly principled causal inference framework should be integrated into the tasks of HSR.

Tasks in health services research

Table 1 shows three examples of healthcare system interventions (HSIs). We use those examples to highlight the differences between the ‘core’ tasks in HSR.

Table 1 Examples of healthcare system interventions, by health services research tasks

The first example in Table 1 mentions the shift from inpatient to outpatient care, which has been successfully implemented in many low- and high-income countries (Yuan et al. 2017; Vogenberg and Santilli 2018; Bhatt and Bathija 2018). Switzerland, for example, published a list of mandatory outpatient treatments and surgeries in 2019 (Swiss Federal Office of Public Health 2019). As outpatient surgeries come with lower (official) reimbursement values, this shift will result automatically in lower reimbursement costs. But it might come with more complications such as surgical site infections which might add downstream costs. Such a HSI requires that involved stakeholders (for example, hospitals and health insurers), policy makers (for example, the government and regulators) and the public (i.e., patients and medical personnel) are informed about the status quo of the current healthcare system–in this example—of selected inpatient and outpatient treatments for a comparison. Obviously, they need a ‘description’ of population outcomes, say, rates of meniscectomy procedures. The ‘description’ of a study population and population outcomes is unquestioned a main task in HSR.

The second example in Table 1 is about task shifting, i.e., the shift of selected healthcare tasks among healthcare professionals. For example, nurses perform certain post-surgical treatments more efficiently than medical doctors. Task shifting has been implemented in low-, middle- and high-income countries worldwide (Ogedegbe et al. 2014; Seidman and Atun 2017; Orkin et al. 2019). Involved aspects of HSR in this HSI include the role of medical personnel and patients in shared decision making processes, hospitals as policy makers which implement work policies, but also authorities for ensuring patient safety and quality of treatments. Besides a ‘description’ of how often healthcare tasks are performed by different medical personnel, it is also of interest which predictors are associated (say, skill-grade) with a specific healthcare outcome (say, length of hospital stay). In brief, ‘description’ summarizes the study setting, whereas ‘modeling’ quantifies associations among a study outcome and certain characteristics to make predictions for other–possibly future—settings (Hernán et al. 2019). There is no doubt that to ‘describe’ and to ‘model’ are important tasks in HSR. But, obviously, answering the questions in the first two columns of Table 1 only in part supports decision making—a process of actions or ‘doing’ (Pearl 2009)—which is ultimately linked to a causal ‘what-if’ question: What is the effect of an intervention when everything happened under a situation, say A, versus when everything happened under a situation B. Let us consider the third example in Table 1, which focuses on hospital mergers, for a better explanation. Over the past years, consolidation efforts between hospitals have been implemented in many countries to optimize patient treatments, quality outcomes and economic outcomes (Kristensen et al. 2010; Hayford 2012; Giancotti et al. 2017). Let us consider in the following the situation that two hospitals merged. A natural question for stakeholders (i.e., a hospital group) and policy makers (i.e., health system authorities and regulators) is then: What would have happened to the outcome of quality indicators (say, hospital readmissions) when the merger would not have been implemented? For a hospital group this is a key question to justify a consolidation effort, whereas for authorities and regulators an answer to this question is needed for health system planning and evaluation, but actually is not available when the decisions need to be taken. Importantly, such a question moves away from ‘observing’ or ‘modeling’ to a situation of ‘understanding’ the effect of an action, i.e., what is the effect of the hospital merger on quality outcomes? This is a causal question and can often not be answered by associational effect summaries from ‘descriptive’ or ‘modeling’ approaches.

The need for a causal inference framework in health services research

Unfortunately, public health decisions on interventions or policies are often only based on ‘descriptive’ and ‘modeled’ results, without the integration of a solidly principled causal inference framework. Despite both, ‘traditional’ and ‘causal inference’, approaches have their proper legitimation in the investigation of specific research questions, many researchers and students in the field of HSR are not trained to the notions of causal inference. Modern causal inference identifies effects of interventions by using the concept of counterfactuals, which are a key component of a causal inference framework (Hernán 2004; Glass et al. 2013; Zwahlen and Salanti 2018). A counterfactual outcome is an outcome which is ‘counter to the fact’, that is, a hypothetical outcome which is actually not observed (Rubin 1974; Hernán 2004). In the example of the above hospital merger, one likes to compare the actual—under the situation of the hospital merger–observed hospital readmissions with hospital readmissions when the hospital merger would not have been implemented, i.e., outcomes which are actually never observed. Counterfactuals allow to mathematically define a causal effect, which is conceptually different from an associational effect. In a follow-up Hint and Kinks, we continue on the introduction of a principled framework for causal inference in HSR (Moser et al. 2020).

Discussion

As Hernán and others, we believe that causal reasoning plays an important role in HSR to support public health decision making. This can only be done by using an explicit ‘causal inference’ framework, besides the traditional tasks of ‘description’ and ‘modeling’. None of these tasks should be viewed superior to another, but each should be adequately chosen, related to the intended research question (Hernán et al. 2019). Unfortunately, the concept of causal inference is not a regular part in the curriculum of researchers (Dowd 2011; Glass et al. 2013; Begg and March 2018; Chiolero 2018). We plea for an integration of causal concepts in the education of health services researchers, epidemiologists, public health practitioners, and other related professions, to foster future HSR.

References

  1. Ahern J (2018) Start with the ‘C-Word’ follow the roadmap for causal inference. Am J Public Health 108:621. https://doi.org/10.2105/AJPH.2018.304358

  2. Begg MD, March D (2018) Cause and association: missing the forest for the trees. Am J Public Health 108:620. https://doi.org/10.2105/AJPH.2018.304366

  3. Bhatt J, Bathija P (2018) Ensuring access to quality health care in vulnerable communities. Acad Med 93:1271–1275. https://doi.org/10.1097/ACM.0000000000002254

  4. Chiolero A (2018) Data are not enough-hurray for causality! Am J Public Health 108:622. https://doi.org/10.2105/AJPH.2018.304379

  5. Dowd BE (2011) Separated at birth: statisticians, social scientists, and causality in health services research. Health Serv Res 46:397–420. https://doi.org/10.1111/j.1475-6773.2010.01203.x

  6. Giancotti M, Guglielmo A, Mauro M (2017) Efficiency and optimal size of hospitals: results of a systematic search. PLoS ONE 12:e0174533. https://doi.org/10.1371/journal.pone.0174533

  7. Glass TA, Goodman SN, Hernán MA, Samet JM (2013) Causal inference in public health. Annu Rev Public Health 34:61–75. https://doi.org/10.1146/annurev-publhealth-031811-124606

  8. Glymour MM, Hamad R (2018) Causal thinking as a critical tool for eliminating social inequalities in health. Am J Public Health 108:623. https://doi.org/10.2105/AJPH.2018.304383

  9. Hayford TB (2012) The impact of hospital mergers on treatment intensity and health outcomes. Health Serv Res 47:1008–1029. https://doi.org/10.1111/j.1475-6773.2011.01351.x

  10. Hernán MA (2004) A definition of causal effect for epidemiological research. J Epidemiol Community Health 58:265–271. https://doi.org/10.1136/jech.2002.006361

  11. Hernán M (2018a) The C-word: the more we discuss it, the less dirty it sounds. Am J Public Health 108:625–626. https://doi.org/10.2105/AJPH.2018.304392

  12. Hernán MA (2018b) The C-word: scientific euphemisms do not improve causal inference from observational data. Am J Public Health 108:616–619. https://doi.org/10.2105/AJPH.2018.304337

  13. Hernán MA, Hsu J, Healy B (2019) A second chance to get causal inference right: a classification of data science tasks. Chance 32:42–49. https://doi.org/10.1080/09332480.2019.1579578

  14. Jones HE, Schooling CM (2018) Let’s require the “T-Word”. Am J Public Health 108:624. https://doi.org/10.2105/AJPH.2018.304365

  15. Kristensen T, Bogetoft P, Pedersen KM (2010) Potential gains from hospital mergers in Denmark. Health Care Manag Sci 13:334–345. https://doi.org/10.1007/s10729-010-9133-8

  16. Moser A, Puhan MA, Zwahlen M (2020) The role of causal inference in health services research II: a framework for causal inference. Int J Public Health. https://doi.org/10.1007/s00038-020-01334-1

  17. O’Malley J (2011) Commentary on Bryan Dowd’s Paper ‘“Separated at Birth: statisticians, social scientists, and causality in health services research”. Health Serv Res 46:430–436. https://doi.org/10.1111/j.1475-6773.2010.01203.x

  18. Ogedegbe G, Gyamfi J, Plange-Rhule J et al (2014) Task shifting interventions for cardiovascular risk reduction in low-income and middle-income countries: a systematic review of randomised controlled trials. BMJ Open 4:e005983. https://doi.org/10.1136/bmjopen-2014-005983

  19. Orkin AM, McArthur A, Venugopal J et al (2019) Defining and measuring health equity in research on task shifting in high-income countries: a systematic review. SSM Popul Heal 7:100366. https://doi.org/10.1016/j.ssmph.2019.100366

  20. Pearl J (2009) Causality. Cambridge University Press, Cambridge

  21. Pearl J (2011) Statistics and causality: separated to reunite-commentary on Bryan Dowd’s “separated at Birth”. Health Serv Res 46:421–429. https://doi.org/10.1111/j.1475-6773.2011.01243.x

  22. Rubin DB (1974) Estimating causal effects of treatments in randomized and nonrandomized studies. J Educ Psychol 66:688–701

  23. Seidman G, Atun R (2017) Does task shifting yield cost savings and improve efficiency for health systems? A systematic review of evidence from low-income and middle-income countries. Hum Resour Health 15:29. https://doi.org/10.1186/s12960-017-0200-9

  24. Swiss Federal Office of Public Health (2019) Änderung der Krankenpflege-Leistungsverordnung (KLV) betreffend “Ambulant vor Stationär.” https://www.bag.admin.ch/bag/de/home/themen/versicherungen/krankenversicherung/krankenversicherung-revisionsprojekte/konsultation-ambulant-vor-stationaer.html. Accessed 19 Sep 2019

  25. Vogenberg FR, Santilli J (2018) Healthcare trends for 2018. Am Heal drug Benefits 11:48–54

  26. Yuan B, He L, Meng Q, Jia L (2017) Payment methods for outpatient care facilities. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD011153.pub2

  27. Zwahlen M, Salanti G (2018) Causal inference from experiment and observation. Evid Based Ment Heal 21:34–38. https://doi.org/10.1136/eb-2017-102859

Download references

Author information

Correspondence to André Moser.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Moser, A., Puhan, M.A. & Zwahlen, M. The role of causal inference in health services research I: tasks in health services research. Int J Public Health (2020). https://doi.org/10.1007/s00038-020-01333-2

Download citation