Skip to main content
SpringerLink
Log in

Linear Programming Methods for Solving Finite Markovian Decision Problems

  • Conference paper
DGOR

Part of the book series: Operations Research Proceedings 1980 ((ORP,volume 1980))

Summary

An overview is given of linear programming methods for solving (semi-) Markov decision problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • De Ghellinck, G.T. [ 1960 ]. Les problèmes de décisions sequentielles. Cahiers du Centre d’Etudes de Recherche Opérationelle, 2, 161–179.

    Google Scholar 

  • De Ghellinck, G.T. and G.D. Eppen [ 1967 ]. Linear programming solutions for separable Markovian decision problems. Management Science, 13, 371–394.

    Article  Google Scholar 

  • Denardo, E.V. and B.L. Fox [ 1968 ]. Multichain Markov renewal programs. Siam Journal on Applied Mathematics, 16, 468–487.

    Article  Google Scholar 

  • Denardo, E.V. and U.G. Rothblum [ 1979 ]. Optimal stopping, exponential utility, and linear programming. Mathematical Programming, 16, 228–244.

    Article  Google Scholar 

  • D’Epenoux, F. [1960]. Sur un problème de production et de stockage dans l’aléatoire. Revue Française de Recherche Opérationelle, 14, 3–16.

    Google Scholar 

  • Derman, C. [ 1970 ]. Finite state Markovian decision processes. Academic Press, New York.

    Google Scholar 

  • Derman, C. and A.F. Veinott Jr. [ 1972 ]. Constrained Markov decision chains. Management Science, 19, 389–390.

    Article  Google Scholar 

  • Heilmann,W.-R. [ 1977 ]. Lineare Programmierung stochastischer dynamischer Entscheidungsmodelle. Thesis, University of Hamburg.

    Google Scholar 

  • Heilmann,W.-R. [ 1978 ]. Solving stochastic dynamic programming problems by linear programming - An annotated bibliography. Zeitschrift für Operations Research 22, 43–53.

    Article  Google Scholar 

  • Hordijk, A. and L.C.M. Kallenberg [ 1979 ]. Linear programming and Markov decision chains. Management Science, 25, 352–362.

    Article  Google Scholar 

  • Kallenberg, L.C.M. [ 1980 ]. Linear programming and finite Markovian control problems Thesis, University of Leiden.

    Google Scholar 

  • Manne, A.S. [1960]. Linear programming and sequential decisions. Management Science, 6, 259–267.

    Article  Google Scholar 

  • Mine, H. and S. Osaki [ 1970 ]. Markovian decision processes. Elsevier, New York.

    Google Scholar 

  • Schweitzer, P.J. [ 1971 ]. Iterative solution of the functional equations of undiscounted Markov renewal programming. Journal of Mathematical Analysis and Applications, 34, 495–501.

    Article  Google Scholar 

  • Wessels, J. and J.A.E.E. van Nunen [ 1975 ]. Discounted semi-Markov decision processes: linear programming and policy iteration. Statistica Neerlandica, 29, 1–7.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics, University of Leiden, Wassennaarseweg 80, 2300 RA, Leiden, The Netherlands

    Prof. Dr. A. Hordijk & L. C. M. Kallenberg

Authors
  1. Prof. Dr. A. Hordijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. L. C. M. Kallenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Fernuniversität Hagen, Roggenkamp 6, D-5800, Hagen 1, Deutschland

    Günter Fandel (Lehrstuhl für Betriebswirtschaft) (Lehrstuhl für Betriebswirtschaft)

  2. Industrieanlagen Betriebsgesellschaft mbH, Einsteinstraße 20, D-8012, Ottobrunn, Deutschland

    Dietrich Fischer

  3. Universität Essen, FB 5, Postfach 6843, D-4300, Essen 1, Deutschland

    Hans-Christian Pfohl

  4. Philips GmbH, Operations Research, Billstraße 80, D-2000, Hamburg 28, Deutschland

    Karl-Peter Schuster

  5. Technische Universität Braunschweig, Postfach 3329, D-3300, Braunschweig, Deutschland

    Jochen Schwarze

Rights and permissions

Reprints and permissions

Copyright information

© 1981 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hordijk, A., Kallenberg, L.C.M. (1981). Linear Programming Methods for Solving Finite Markovian Decision Problems. In: Fandel, G., Fischer, D., Pfohl, HC., Schuster, KP., Schwarze, J. (eds) DGOR. Operations Research Proceedings 1980, vol 1980. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-68118-9_89

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-68118-9_89

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-10801-6

  • Online ISBN: 978-3-642-68118-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation