Fuzzy Dynamic Programming in the Stochastic Environment

  • Seiichi Iwamoto
Part of the Studies in Fuzziness and Soft Computing book series (STUDFUZZ, volume 73)


From a viewpoint of stochastic dynamic programming, we develop “De -cision-making in a fuzzy environment” in Bellman and Zadeh’s seminal paper (1970). We present three dynamic programming approaches (1) membership-parametric method, (2) history-parametric method and (3) multi-stage stochastic decision tree-table method —, which yield a common optimal solution. We also introduce a dynamic programming approach to both fuzzy system and an a posteriori conditional decision process. We show that their stochastic decision process is the a posteriori conditional decision process.


Fuzzy System Optimal Policy Stochastic System Recursive Formula General Policy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baldwin, J. F. Pilsworth, B. W. (1982) Dynamic programming for fuzzy systems with fuzzy environment. J. Math. Anal. Appl. 85, 1–23Google Scholar
  2. 2.
    Bellman, R. E. (1957) Dynamic Programming. Princeton Univ. Press, NJGoogle Scholar
  3. 3.
    Bellman, R. E., Zadeh, L. A. (1970) Decision-making in a fuzzy environment. Manag. Sci. B 17, 141–164Google Scholar
  4. 4.
    Esogbue, A. O. Hellman, R. E. (1984) Fuzzy dynamic programming and its extensions, TIMS/Studies in the Management Sciences. 20, 147–167Google Scholar
  5. 5.
    Fujita, T., Iwamoto S. (2000) An optimistic decision-making in fuzzy environment. Ed. J.L. Casti, Proceedings of International Workshop on Computation, Optimization and Control (The Seventh Bellman Continuum), The Santa Fe Institute, USA, 1999; Applied Mathematics and Computation, to appearGoogle Scholar
  6. 6.
    Howard, R. (1960) Dynamic Programming and Markov Processes. MIT Press, MassGoogle Scholar
  7. 7.
    Iwamoto, S. (1987) Theory of Dynamic Program (in Japanese). Kyushu Univ. Press, FukuokaGoogle Scholar
  8. 8.
    Iwamoto, S. (1998) Decision-making in fuzzy environment: A survey from stochastic decision process. Ed. L.C. Jain and R.K. Jain, Proceedings of The Second International Conference on Knowledge-based Intelligent Electronics Systems (KES ‘88), Adelaide, 542–546Google Scholar
  9. 9.
    Iwamoto, S. (1999) Conditional decision processes with recursive reward function. J. Math. Anal. Appl. 230, 193–210CrossRefGoogle Scholar
  10. 10.
    Iwamoto, S. (2000) A class of dual fuzzy dynamic programs. Ed. J.L. Casti, Proceedings of The Seventh Bellman Continuum Workshop, The Santa Fe Institute, USA, 1999;Applied Mathematics and Computation, to appearGoogle Scholar
  11. 11.
    Iwamoto, S., Fujita, T. (1995) Stochastic decision-making in a fuzzy environment. J. Operations Res. Soc. Japan 38, 467–482Google Scholar
  12. 12.
    Iwamoto, S., Tsurusaki, K., Fujita, T. (1999) Conditional decision-making in a fuzzy environment. J. Operations Res. Soc. Japan 42, 198–218CrossRefGoogle Scholar
  13. 13.
    Iwamoto, S., Tsurusaki, K., Fujita, T. (2000) On Markov policies for minimax decision processes. J. Math. Anal. Appl. to appearGoogle Scholar
  14. 14.
    Iwamoto, S., Sniedovich, M. (1998) Sequential decision making in fuzzy environment. J. Math. Anal. Appl. 222, 208–224CrossRefGoogle Scholar
  15. 15.
    Iwamoto, S., Ueno, T., Fujita, T. (1999) Controlled Markov chains with utility functions. International Workshop on Markov Processes and Controlled Markov Chains, Changsha, Hunan, China, AugustGoogle Scholar
  16. 16.
    Kacprzyk, J. (1977) Multistage control of a stochastic system under fuzzy goals and constraints using a generic algorithm. Seventh IFSA World Congress, Prague, 2, 306–311Google Scholar
  17. 17.
    Kacprzyk, J. (1978) Decision-making in a fuzzy environment with fuzzy termination time. Fuzzy Sets and Systems 1, 169–179CrossRefGoogle Scholar
  18. 18.
    Kacprzyk, J. (1992) Fuzzy optimal control revisited: Toward a new generation of fuzzy control. Proceedings of the 2nd International Conference on Fuzzy Logic Neural Networks ( Iizuka, Japan ), 429–432Google Scholar
  19. 19.
    Kacprzyk, J., Esogbue, A. O. (1996) Fuzzy dynamic programming: Main developments and applications. Fuzzy Sets and Systems 81, 31–45CrossRefGoogle Scholar
  20. 20.
    Kacprzyk, J., Staniewski, P. (1980) A new approach to the control of stochastic systems in a fuzzy environment. Archiwum Automatyki i Telemechaniki 25, 443444Google Scholar
  21. 21.
    Lee, E. S. (1968) Quasilinearization and Invariant Imbedding Academic Press, NYGoogle Scholar
  22. 22.
    Puterman, M. (1994) Markov Decision Processes: discrete stochastic dynamic programming. Wiley Sons, NYGoogle Scholar
  23. 23.
    Sniedovich, M. (1992) Dynamic Programming, Marcel Dekker,Inc., NYGoogle Scholar
  24. 24.
    Scott, M. R. (1973) Invariant Imbedding and its Applications to Ordinary Differential Equations: An introduction. Addison-Wesly, LondonGoogle Scholar
  25. 25.
    Stein, W. E. (1980) Optimal stopping in a fuzzy environment. Fuzzy Sets and Systems 3, 253–259CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Seiichi Iwamoto
    • 1
  1. 1.Department of Economic EngineeringGraduate School of EconomicsHigashiku, FukuokaJapan

Personalised recommendations