Skip to main content

Dynamic Programming

  • Chapter
  • First Online:
Assessment of Power System Reliability
  • 3337 Accesses

Abstract

Dynamic programming is an optimization method that transforms a complex problem into a sequence of simpler problems. A sequence of simpler problems can be dealt with a variety of optimization techniques that can be employed to solve particular aspects of a more general formulation. Dynamic programming can be top-down or bottom-up oriented. Three most important characteristics of dynamic programming problems are the following:

  • Multiple stages, which are solved sequentially one stage at a time.

  • States, which reflect the information required to assess the consequences that the current decision has on future actions.

  • Recursive optimization, which builds to a solution of the overall N-stage problem by first solving a one-stage problem and sequentially including one stage at a time and solving one-stage problems until the overall optimum has been found.

No human investigation can be called real science if it cannot be demonstrated mathematically

Leonardo da Vinci

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bellman R (2003) Dynamic programming. Denardo

    Google Scholar 

  2. Bellman R (1957) Dynamic programming. Princeton University Press, Princeton, NJ

    MATH  Google Scholar 

  3. Momoh JA (2005) Electric power system applications of optimization. Marcel Dekker, New York

    Google Scholar 

  4. Wood AJ, Woolenberg BF (1996) Power generation operation and control. Wiley, New York

    Google Scholar 

  5. Bradley S, Hax A, Magnanti T (1977) Applied mathematical programming. Addison-Wesley, Reading, MA

    Google Scholar 

  6. Dasgupta S, Papadimitriou CH, Vazirani UV (2008) Algorithms. McGraw-Hill, Boston, MA

    Google Scholar 

  7. Sniedovich M (2010) Dynamic programming: foundations and principles. Taylor & Francis.

    Google Scholar 

  8. Bertsekas DP (2007) Dynamic programming and optimal control. Athena Scientific, Belmont, MA

    Google Scholar 

  9. Borkar VS (2000) Average cost dynamic programming equations for controlled Markov chains with partial observations. SIAM J Contr Opt 39:673?681

    Article  MathSciNet  MATH  Google Scholar 

  10. Zhu J (2009) Optimization of power system operation. Wiley, New York

    Book  Google Scholar 

  11. Howard RA (1960) Dynamic programming and Markov processes. Wiley, New York

    MATH  Google Scholar 

  12. Hadley G (1962) Nonlinear and dynamic programming. Addison-Wesley, London

    Google Scholar 

  13. Zietz J (2004) Dynamic programming: an introduction by example. http://frank.mtsu.edu/~berc/working/Zietz-DP-1.pdf. Accessed 14 Jan 2011

  14. Introduction to dynamic programming http://www.webmath.iitkgp.ernet.in/breadth/ma23011/lectnotes07/Dynamic_Programming-4.pdf. Accessed 14 Jan 2011

  15. Chinneck JV (2006) Practical optimization: a gentle introduction. http://www.sce.carleton.ca/faculty/chinneck/po.html. Accessed 14 Jan 2011

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marko Čepin .

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Čepin, M. (2011). Dynamic Programming. In: Assessment of Power System Reliability. Springer, London. https://doi.org/10.1007/978-0-85729-688-7_17

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-688-7_17

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-687-0

  • Online ISBN: 978-0-85729-688-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics