Dynamic Programming

  • Marko Čepin


Dynamic programming is an optimization method that transforms a complex problem into a sequence of simpler problems. A sequence of simpler problems can be dealt with a variety of optimization techniques that can be employed to solve particular aspects of a more general formulation. Dynamic programming can be top-down or bottom-up oriented. Three most important characteristics of dynamic programming problems are the following:
  • Multiple stages, which are solved sequentially one stage at a time.

  • States, which reflect the information required to assess the consequences that the current decision has on future actions.

  • Recursive optimization, which builds to a solution of the overall N-stage problem by first solving a one-stage problem and sequentially including one stage at a time and solving one-stage problems until the overall optimum has been found.


Dynamic Programming Decision Variable Formal Statement Previous Equation Simple Problem 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bellman R (2003) Dynamic programming. DenardoGoogle Scholar
  2. 2.
    Bellman R (1957) Dynamic programming. Princeton University Press, Princeton, NJMATHGoogle Scholar
  3. 3.
    Momoh JA (2005) Electric power system applications of optimization. Marcel Dekker, New YorkGoogle Scholar
  4. 4.
    Wood AJ, Woolenberg BF (1996) Power generation operation and control. Wiley, New YorkGoogle Scholar
  5. 5.
    Bradley S, Hax A, Magnanti T (1977) Applied mathematical programming. Addison-Wesley, Reading, MAGoogle Scholar
  6. 6.
    Dasgupta S, Papadimitriou CH, Vazirani UV (2008) Algorithms. McGraw-Hill, Boston, MAGoogle Scholar
  7. 7.
    Sniedovich M (2010) Dynamic programming: foundations and principles. Taylor & Francis.Google Scholar
  8. 8.
    Bertsekas DP (2007) Dynamic programming and optimal control. Athena Scientific, Belmont, MAGoogle Scholar
  9. 9.
    Borkar VS (2000) Average cost dynamic programming equations for controlled Markov chains with partial observations. SIAM J Contr Opt 39:673?681MathSciNetCrossRefMATHGoogle Scholar
  10. 10.
    Zhu J (2009) Optimization of power system operation. Wiley, New YorkCrossRefGoogle Scholar
  11. 11.
    Howard RA (1960) Dynamic programming and Markov processes. Wiley, New YorkMATHGoogle Scholar
  12. 12.
    Hadley G (1962) Nonlinear and dynamic programming. Addison-Wesley, LondonGoogle Scholar
  13. 13.
    Zietz J (2004) Dynamic programming: an introduction by example. Accessed 14 Jan 2011
  14. 14.
  15. 15.
    Chinneck JV (2006) Practical optimization: a gentle introduction. Accessed 14 Jan 2011

Copyright information

© Springer-Verlag London Limited  2011

Authors and Affiliations

  1. 1.Faculty of Electrical EngineeringUniversity of LjubljanaLjubljanaSlovenia

Personalised recommendations