Skip to main content

Bellman Equation

  • Reference work entry
  • First Online:
The New Palgrave Dictionary of Economics
  • 41 Accesses

Abstract

Dynamic programming is a method that solves a complicated multi-stage decision problem by first transforming it into a sequence of simpler problems. Bellman equations, named after the creator of dynamic programming Richard E. Bellman (1920–1984), are functional equations that embody this transformation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 6,499.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 8,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Bibliography

  • Bellman, R. 1957. Dynamic programming. Princeton: Princeton University Press.

    Google Scholar 

  • Benveniste, L., and J. Scheinkman. 1979. On the differentiability of the value function in dynamic models of economics. Econometrica 47: 727–732.

    Article  Google Scholar 

  • Bertsekas, D.P. 1976. Dynamic programming and stochastic control. New York: Academic Press.

    Google Scholar 

  • Blackwell, D. 1965. Discounted dynamic programming. Annals of Mathematical Statistics 36: 226–235.

    Article  Google Scholar 

  • Brock, W.A., and L. Mirman. 1972. Optimal economic growth and uncertainty: The discounted case. Journal of Economic Theory 4: 479–513.

    Article  Google Scholar 

  • Ljungqvist, L., and T.J. Sargent. 2004. Recursive macroeconomic theory. 2nd ed. Cambridge, MA: MIT Press.

    Google Scholar 

  • Miller, B.L. 1974. Optimal consumption with a stochastic income stream. Econometrica 42: 253–266.

    Article  Google Scholar 

  • Stokey, N.L., and R.E. Lucas Jr. 1989. Recursive methods in economic dynamics. Cambridge: Harvard University Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Copyright information

© 2018 Macmillan Publishers Ltd.

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Shin, Y. (2018). Bellman Equation. In: The New Palgrave Dictionary of Economics. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-349-95189-5_2392

Download citation

Publish with us

Policies and ethics