Skip to main content

Complexity and Management and Policy: Why Our Interventions Go Astray

  • Chapter
  • First Online:
Complex Systems in Medicine
  • 519 Accesses

Abstract

The increasing number of administrators in healthcare reflects a mental model of managerialism – a belief in the value of professional managers and of the concepts and methods they use. Among these methods is the use of “performance indicators.” These performance indicators are part of the control systems that administrators use to keep the health care “machine” running. This image of a machine emphasizes the aspects of the organization that are (supposedly) predictable, controllable and reproducible. While it is often hard to see the similarities between health care systems and other systems, such control systems are manifest in the hormonal axes that endocrinologists deal with every day. This chapter shows how a cybernetic model of hormonal axes involved in insulin secretion can serve as an analogy for the development and operation of performance measures for diabetes including some of the unintended consequences. Unintended consequences of actions in complicated or complex systems are a fact of life. Simple systems are predictable. Complicated systems may be computationally tractable and therefore predictable, although expertise is required. Lacking that expertise or the correct computer model, unintended consequences may come as a surprise. Unintended (and often unexpected) consequences are characteristic of action on complex systems; they emerge.

This chapter is to a large extent based on reference 5.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    State legislation establishing Medi-Cal enacted November 15, 1965; implemented March 1, 1966. It is California’s version of the Nation’s major publicly financed health care program providing benefits to low-income individuals, including families, seniors, persons with disabilities, children in foster care, pregnant women, and childless adults with incomes below a certain percentage of federal poverty level.

  2. 2.

    Bureau of Labor Statistics, the National Center for Health Statistics, and the United States Census Bureau’s Current Population Survey. Himmelstein and Woolhandler analysis of current population survey. http://www.pnhp.org/. 4 Aug 15.

  3. 3.

    Cybernetics is the science of communications and automatic control systems in both machines and living things. The term itself goes back to the ancient Greeks and was borrowed by Norbert Weiner in his book Wiener, Norbert (1948). Hermann & Cie, ed. Cybernetics; or, Control and communication in the animal and the machine. Paris: Technology Press. Weiner was a leader in establishing the discipline of cybernetics. https://en.wikipedia.org/wiki/Cybernetics. 10 July 18.

  4. 4.

    Of course, in this circumstance the insulin is provided to and not made by the pump, but the insulin could be synthesized in a cell-free system. When I was an endocrine fellow 40 years ago, we had an artificial pancreas. It was about the size of a dormitory room refrigerator and was transported on a wheeled cart. It was a royal pain to use and required an intravenous line as well as the equivalent of an arterial line. The latter was achieved by an IV in the subject’s hand that was warmed up to get “arteriolized” blood. You had to keep a close eye on the subject’s hand because the heat could result in burns if you weren’t careful. (You can figure out for yourself why I know this.) What was more of a pain was that the sensor lasted only a day so the whole device was useful only for experiments. Practical, implantable closed-loop systems are now coming into use. See: [40].

  5. 5.

    A 2006 conference on assessing quality of care for diabetes sponsored by Agency for Research on Healthcare Quality, the National Institute for Diabetes and Digestive and Kidney Diseases, and the VA Office of Quality and Performance (OQP) identified the characteristics of good measures and recommended that performance measures should: (1) give credit for achieving the measure that is commensurate with the likelihood of benefit to the patient, consistent with the Institute of Medicine definitions of quality, i.e., the most credit should be given for achieving goals or clinical actions with large potential benefits in downstream outcomes for the patient (e.g., based on life expectancy, comorbidity, etc.); (2) be applied such that the eligible population reflects the population(s) that will receive the benefit; (3) motivate improvements in quality while minimizing problems with patient safety and unintended consequences; (4) incorporate, when possible, considerations of patient preferences and patient choice; and (5) incorporate patient assessments of quality.

  6. 6.

    The classic joke about cost goes something like this: An administrator wants to know how much something in the hospital costs, e.g., a procedure, so she asks an accountant in the finance department. The accountant replies: How much do you want it to cost? (Costs can be allocated any way you like.)

  7. 7.

    It is useful to make a distinction between their use for public accountability and their use to support internal quality improvement efforts. First, the measures might be different. In general, accountability measures which are used in public reporting and pay-for-performance require higher levels of validity, i.e., greater strength of evidence that the intervention or treatment will have population benefit, that the measure has scientific soundness, and that the data are feasible to collect. Of critical importance is their independence from effects of patient characteristics on measures of quality. This means having a robust method of adjustment for case mix. Measures for quality improvement efforts need only “satisfice,” i.e., be good enough, although it is critical that those using the measures understand their limitations. Second, even if the measure itself is the same, the different uses mandate different interpretations of and action in response to the numbers. When one’s salary or market share depends upon how close to 100% one’s measured performance is, it is more difficult to take into account the difference between population measures, which are good “on the average,” but may not be good for a particular patient. Achieving the measure for all might actually harm specific individuals, as illustrated by the history of the A1C <7% measure for glycemic control. See: [23, 41].

References

  1. https://marginalrevolution.com/marginalrevolution/2008/01/the-law-of-unin.html. 9 July 18.

  2. https://en.wikipedia.org/wiki/Campbell%27s_law. 9 July 18.

  3. http://ccat.sas.upenn.edu/goldenage/intro/intro.htm. 10 July 18.

  4. https://en.wikipedia.org/wiki/Managerialism. 9 July 18.

  5. Aron DC. Quality indicators and performance measures in diabetes care. Curr Diab Rep. 2014;14(3):472.

    Article  Google Scholar 

  6. Steinman MA, Fischer MA, Shlipak MG, Bosworth HB, Oddone EZ, Hoffman BB, Goldstein MK. Clinician awareness of adherence to hypertension guidelines. Am J Med. 2004;117(10):747–54.

    Article  Google Scholar 

  7. Mata-Cases M, Benito-Badorrey B, Roura-Olmeda P, et al. Clinical inertia in the treatment of hyperglycemia in type 2 diabetes patients in primary care. Curr Med Res Opin. 2013;29:1495–502.

    Article  CAS  Google Scholar 

  8. Phillips LS, Branch WT Jr, Cook C, et al. Clinical inertia. Ann Intern Med. 2001;135:825–34.

    Article  CAS  Google Scholar 

  9. Pantalone KM, Misra-Hebert AD, Hobbs TM, Ji X, Kong SX, Milinovich A, Weng W, Bauman J, Ganguly R, Burguera B, Kattan MW. Clinical inertia in type 2 diabetes management: evidence from a large, real-world data set. Diabetes Care. 2018;41(7):e113–4.

    Article  Google Scholar 

  10. Pogach L, Aron D. Quality of diabetes care. (Current levels, distribution, and trends) and challenges in measuring quality of care. In: Moran S, Gregg E, Williams D, Cowie C, Narayan K, editors. Diabetes and public health: from data to policy. New York: Oxford University Press; 2010. p. 373.

    Chapter  Google Scholar 

  11. Lamb GC, Smith MA, Weeks WB, Queram C. Publicly reported quality-of-care measures influenced Wisconsin physician groups to improve performance. Health Aff. 2013;32(3):536–43.

    Article  Google Scholar 

  12. Frakt AB, Jha AK. Face the facts: we need to change the way we do pay for performance. Ann Intern Med. 2018;168:291.

    Article  Google Scholar 

  13. Ordonez L, Schweitzer M, Galinsky ABM. Goals gone wild: the systematic side effects of overprescribing goal setting. Acad Manag Perspect. 2009;23:6–16.

    Article  Google Scholar 

  14. Wadhera RK, Maddox KE, Wasfy JH, Haneuse S, Shen C, Yeh RW. Association of the Hospital Readmissions Reduction Program with mortality among Medicare beneficiaries hospitalized for heart failure, acute myocardial infarction, and pneumonia. JAMA. 2018;320(24):2542–52.

    Article  Google Scholar 

  15. Hayward RA, Kent DM. 6 EZ steps to improving your performance: (or how to make P4P pay 4U). JAMA. 2008;300:255–6.

    Article  CAS  Google Scholar 

  16. Powell AA, White KM, Partin MR, Halek K, Christianson JB, Neil B, et al. Unintended consequences of implementing a national performance measurement system into local practice. J Gen Intern Med. 2012;27(4):405–12.

    Article  Google Scholar 

  17. Rambur B, Vallett C, Cohen JA, Tarule JM. Metric-driven harm: an exploration of unintended consequences of performance measurement. Appl Nurs Res. 2013;26(4):269–72.

    Article  Google Scholar 

  18. Mannion R, Braithwaite J. Unintended consequences of performance measurement in healthcare: 20 salutary lessons from the English National Health Service. Intern Med J. 2012;42(5):569–74.

    Article  CAS  Google Scholar 

  19. Power M. Organized uncertainty: designing a world of risk management. Oxford: Oxford University Press; 2008.

    Google Scholar 

  20. Mendelson A, Kondo K, Damberg C, Low A, Motúapuaka M, Freeman M, O’Neil M, Relevo R, Kansagara D. The effects of pay-for-performance programs on health, health care use, and processes of care: a systematic review. Ann Intern Med. 2017;166(5):341–53.

    Article  Google Scholar 

  21. Kizer KW, Dudley RA. Extreme makeover: transformation of the Veterans health care system. Annu Rev Public Health. 2009;30:313–39.

    Article  Google Scholar 

  22. Kizer KW, Kirsh SR. The double edged sword of performance measurement. J Gen Intern Med. 2012;27:395–7.

    Article  Google Scholar 

  23. Aron DC. No “Black swan”: unintended but not unanticipated consequences of diabetes performance measurement. Jt Comm J Qual Patient Saf. 2013;39(3):106–8.

    Article  Google Scholar 

  24. Wilson B, Tseng CL, Soroka O, Pogach LM, Aron DC. Identification of outliers and positive deviants for healthcare improvement: looking for high performers in hypoglycemia safety in patients with diabetes. BMC Health Serv Res. 2017;17(1):738.

    Article  Google Scholar 

  25. Pogach L, Aron DC. The other side of quality improvement in diabetes for seniors: a proposal for an over-treatment glycemic measure. Arch Intern Med. 2012:1–3.. online prior to print

    Google Scholar 

  26. Tseng C-L, Soroka O, Maney M, Aron DC, Pogach LM. Assessing potential glycemic overtreatment in persons at hypoglycemic risk. JAMA-Int Med. 2014;174(2):259–68.

    Article  Google Scholar 

  27. Merton R. The unanticipated consequences of purposive social action. Am Sociol Rev. 1936;1(6):894.

    Article  Google Scholar 

  28. Tenner E. Why things bite back: technology and the revenge of unintended consequences. New York: A.A. Knopf; 1996.

    Google Scholar 

  29. Baert P. Unintended consequences: a typology and examples. Int Sociol. 1991;6(2):201–10.

    Article  Google Scholar 

  30. Lipsitz LA. Understanding health care as a complex system: the foundation for unintended consequences. JAMA. 2012;308(3):243–4.

    Article  CAS  Google Scholar 

  31. Charney FA. Unintended consequences of modeling damping in structures. J Struct Eng. 2008;134(4):581–92.

    Article  Google Scholar 

  32. Alex Tabarrok. The law of unintended consequences. 24 Jan 2008 at 7:47 am in Economics. https://marginalrevolution.com/marginalrevolution/2008/01/the-law-of-unin.html.

  33. Tolk A, Koehler MT, Norman MD. Epistemological constraints when evaluating ontological emergence with computational complex adaptive systems. https://www.researchgate.net/profile/Michael_Norman5/publication/325573017_Epistemological_Constraints_when_Evaluating_Ontological_Emergence_with_Computational_Complex_Adaptive_Systems/links/5b1684684585151f91fb8e23/Epistemological-Constraints-when-Evaluating-Ontological-Emergence-with-Computational-Complex-Adaptive-Systems.pdf. 11 July 18.

  34. Maier MW. The role of modeling and simulation in system of systems development. In: Rainey LB, Tolk A, editors. Modeling and simulation support for system of systems engineering applications. Hoboken: Wiley; 2015.

    Google Scholar 

  35. https://en.wikiquote.org/wiki/Donald_Rumsfeld. 11 July 18

  36. https://en.wikipedia.org/wiki/Cold_fusion. 11 July 18

  37. Carlisle Y. Complexity dynamics: managerialism and undesirable emergence in healthcare organizations. J Med Market. 2011;11(4):284–93.

    Article  Google Scholar 

  38. Lega F, Vendramini E, Festa G, Coscioni E. Myth# 4: the healthcare system can be fixed by treating it more as a business. In: Adinolfi P, Borgonovi E. editors. The myths of health care. Cham: Springer; 2018. p. 103–21.

    Google Scholar 

  39. Lettieri E, Masella C, Cuccurullo C, Giancotti F. Myth# 2: the healthcare system can be fixed by clever social engineering. In: Adinolfi P, Borgonovi E. editors. The myths of health care. Cham: Springer; 2018. p. 67–86.

    Google Scholar 

  40. Aleppo G, Webb KM. Integrated insulin pump and continuous glucose monitoring technology in diabetes care today: a perspective of real-life experience with the minimed™ 670G hybrid closed-loop system. Endocr Pract. 2018;24(7):684–92.

    Article  Google Scholar 

  41. Pogach L, Aron DC. Sudden acceleration of diabetes quality measures. JAMA. 2011;305:709–10.

    Article  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Aron, D.C. (2020). Complexity and Management and Policy: Why Our Interventions Go Astray. In: Complex Systems in Medicine. Springer, Cham. https://doi.org/10.1007/978-3-030-24593-1_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-24593-1_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-24592-4

  • Online ISBN: 978-3-030-24593-1

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics