Dynamic Influence Diagrams: Applications to Medical Decision Modeling

  • Gordon B. Hazen
Part of the International Series in Operations Research & Management Science book series (ISOR, volume 70)


Influence diagrams are now a well established tool for modeling in decision analysis. Recently, dynamic influence diagrams have been applied to help structure stochastic processes. This chapter discusses dynamic influence diagrams for structuring continuous-time Markov chains, with particular focus on medical decision modeling. We describe our freely available Excel-based software package StoTree, in which dynamic influence diagram models may be readily formulated and solved. We present medical applications as examples, including a previously published cost-effectiveness analysis for total hip replacement.

Key words

Influence diagram Stochastic tree Dynamic Bayes net Medical decision analysis Medical cost-effectiveness Total hip arthroplasty 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Boyen, X. and D. Koller (1998). Tractable inference for complex stochastic processes. In Uncertainty in Artificial Intelligence: Proceedings of the Fourteenth Conference (UAI-1998), Morgan Kaufmann Publishers, San Francisco, CA, 33–42.Google Scholar
  2. [2]
    Chang, R.W., Pellissier, J.M., and G.B. Hazen (1996). A cost-effectiveness analysis of total hip arthroplasty for osteoarthritis of the hip. Journal of the American Medical Association, 275, 858–865.CrossRefPubMedGoogle Scholar
  3. [3]
    Clemen, R.L. (1996). Making Hard Decisions: An Introduction to Decision Analysis. Duxbury Press, Belmont, CA.Google Scholar
  4. [4]
    Cowell, R.G., Dawid, P.A., Lauritzen, S.L., and D.J. Spiegelhalter (1999). Probabilistic Networks and Expert Systems. Springer Publishers.Google Scholar
  5. [5]
    Cox, D.R. (1959). A use of complex probabilities in the theory of stochastic processes. Proceedings of the Cambridge Philosophical Society, 51, 313–319.Google Scholar
  6. [6]
    Dean, T. and K. Kanazawa (1989). A model for reasoning about persistence and causation. Artificial Intelligence, 93, 1–27.Google Scholar
  7. [7]
    Dennis, D.A., Clayton, M.L., O’Donnell, S., Mack, R.P., and E.A. Stringer (1992). Posterior cruciate condylar total knee arthroplasty. Average 11-year follow-up evaluation. Clinical Orthopedics, 281, 168–176.Google Scholar
  8. [8]
    Glasserman, P. (1990). Gradient Estimation via Perturbation Analysis. Kluwer Academic Publishers, Boston, MA.Google Scholar
  9. [9]
    Gottlob, C.A., Pellissier, J.M., Wixson, R.L., Stern, S.H., Stulberg, S.D., and R.W. Chang (1996). The long-term cost-effectiveness of total knee arthroplasty for osteoarthritis. Working paper, Department of Preventive Medicine, Northwestern University Medical School, Chicago, IL.Google Scholar
  10. [10]
    Harris, W.H. and C.B. Sledge (1990). Total hip and total knee replacement. New England Journal of Medicine, 323, 725–731.PubMedGoogle Scholar
  11. [11]
    Hazen, G.B. (1992). Stochastic trees: A new technique for temporal medical decision modeling. Medical Decision Making, 12, 163–178.PubMedGoogle Scholar
  12. [12]
    Hazen, G.B. (1993). Factored stochastic trees: a tool for solving complex temporal medical decision models. Medical Decision Making, 13, 227–236.PubMedGoogle Scholar
  13. [13]
    Hazen, G.B. and J.M. Pellissier (1996). Recursive utility for stochastic trees. Operations Research, 44, 788–809.Google Scholar
  14. [14]
    Hoffman, A.A., Rubash, H.E., Crofford, T.W., Fletcher, F.J., and L.S. Crosset (1993). Knee and leg: reconstruction. In Orthopaedic Knowledge Update 4, Frymoye, J.W., Ed. Rosemont, American Academy of Orthopaedic Surgeons, 603–624.Google Scholar
  15. [15]
    Liang, M.H., Cullen, K.E., Larson, M.G., Thompson, M.S., Schwartz, J.A., Fossel, A.H., Roberts, W.N., and C.B. Sledge (1986). Cost-effectiveness of total joint arthroplasty in osteoarthritis. Arthritis and Rheumatology, 29, 937–943.Google Scholar
  16. [16]
    Murphy, K. (In press). Dynamic Bayesian Networks (Draft). Probabilistic Graphical Models, Joran, M., Ed.Google Scholar
  17. [17]
    Nease R.F. and D.K. Owens (1997). Use of influence diagrams to structure medical decisions. Medical Decision Making, 17, 263–275.PubMedGoogle Scholar
  18. [18]
    Neuts, M.F. (1994). Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Dover Publications, New York.Google Scholar
  19. [19]
    NIH Consensus Development Panel on Total Hip Replacement (1995). Total hip replacement. Journal of the American Medical Association, 273, 1950–1956.Google Scholar
  20. [20]
    Owens, D.K., Shachter, R.D., and R.F. Nease (1997). Representations and analysis of medical decision problems with influence diagrams. Medical Decision Making, 17, 241–262.PubMedGoogle Scholar
  21. [21]
    Pearl, J. (1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufman Publishers, San Francisco, CA.Google Scholar
  22. [22]
    Pellissier, J.M. and G.B. Hazen (1994). Coxian mortality factors for stochastic tree modeling (abstract). Medical Decision Making, 14, 439.Google Scholar
  23. [23]
    Quam, J.P., Michet, C.J., Wilson, M.G., Rand, J.A., Ilstrup, D.M., Melton, L.J., and S.L. Wallrichs (1991). Total knee arthroplasty: a population based study. Mayo Clinic Proceedings, 66, 589–595.PubMedGoogle Scholar
  24. [24]
    Ranawat, C.S., Flynn, W.F., Saddler, S., Hansraj, K.K., and M.J. Maynard (1993). Long-term results of the total condylar knee arthroplasty. A 15-year survivorship study. Clinical Orthopedics, 286, 94–102.Google Scholar
  25. [25]
    Scuderi, G.R., Insall, J.N., Windsor, R.E., and M.B. Moran (1989). Survivorship of cemented knee replacements. Journal of Bone and Joint Surgery, 710B, 798–803.Google Scholar
  26. [26]
    Shachter, R.D. (1986). Evaluating influence diagrams. Operations Research, 34, 871–882.MathSciNetGoogle Scholar
  27. [27]
    Stern, S.H. and J.N. Insall (1992). Posterior stabilized prosthesis. Results after follow-up of nine to twelve years. Bone and Joint Surgery, 74-A, 980–986.Google Scholar
  28. [28]
    Steinbroker, O., Traeger, C.H., and R.C. Batterman (1949). Therapeutic criteria in rheumatoid arthritis. Journal of the American Medical Association, 140, 659–662.Google Scholar
  29. [29]
    Whitt, W. (1980). Continuity of generalized semi-Markov processes. Mathematics of Operations Research, 5, 494–501.zbMATHMathSciNetGoogle Scholar

Copyright information

© Springer Science + Business Media, Inc. 2005

Authors and Affiliations

  • Gordon B. Hazen
    • 1
  1. 1.Department of Industrial Engineering and Management SciencesNorthwestern UniversityEvanston

Personalised recommendations