Abstract
We provide a brief review of basic problem classes and developments of fuzzy dynamic programming which is a promising tool for dealing with multistage decision making and optimization problems under fuzziness (under fuzzy constraints on decisions made and fuzzy goals on states attained). We discuss cases of a deterministic, stochastic, and fuzzy state transitions, and of the fixed and specified, implicitly given, fuzzy, and infinite termination times.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baldwin, J. F. and Pilsworth, B. W. (1982). Dynamic programming for fuzzy systems with fuzzy environment. J. Math. Anal. and Appls., 85, 1–23.
Bellman, R. E. (1957). Dynamic Programming. Princeton Univ. Press, Princeton, NJ.
Bellman, R. E. and Zadeh, L. A. (1970). Decision-making in a fuzzy environment. Management Sci., 17, 141–164.
Chang, S. S. L. (1969b). Fuzzy dynamic programming and the decision making process. Proc. 3rd Princeton Conf. on Inf. Sci. and Syst. (Princeton, NJ, USA), 200–203.
Esogbue A. O. (1983) Dynamic programming, fuzzy sets and the modelling of R&D management control systems. IEEE Transactions on Systems, Man, and Cybernetics SMC-13: 18–30.
Esogbue A. O. (1984) Some novel applications of fuzzy dynamic programming. Proceedings of IEEE Systems, Man, and Cybernetics Conference (Bombay, India).
Esogbue A. O. (1985) A fuzzy dynamic programming model of intra-operative anesthesia administration. In J. Kacprzyk and R.R. Yager (Eds.): Management Decision Support Systems using Fuzzy Sets and Possibility Theory. Verlag TÜV Rheinland, Cologne, 155–161.
Esogbue A. O. (1986) Optimal clustering of fuzzy data via fuzzy dynamic programming. Fuzzy Sets and Systems 18:283–298.
Esogbue A. O. (1989) Dynamic Programming for Optimal Water Resources Systems Analysis. Prentice-Hall, Englewood Cliffs, NJ.
Esogbue A. O. (1991a) Computational and data acquisition issues in fuzzy dynamic programming. Proceedings of ORSA/TIMS Conference (Anaheim, CA).
Esogbue A. O. (1991b) Computational aspects and applications of a branch and bound algorithm for fuzzy multistage decision processes. Computers and Mathematics with Applications 21, 117–127.
Esogbue, A. O. (1995) On the computational complexity of fuzzy dynamic programs. Proc. 6th International Association World Congress, Sao Paolo, Brazil, July, 1995, 217–220.
Esogbue A. O. and Z. M. Ahipo (1982a) Fuzzy sets in water resources planning. In R. R. Yager (Eds.): Recent Developments in Fuzzy Sets and Possibility Theory, Pergamon Press, New York, 450–465.
Esogbue A. O. and Z. M. Ahipo (1982b) A fuzzy sets model for measuring the effectiveness of public participation in water resources planning. Water Resources Bulletin 18:451–456.
Esogbue A. O. and R. E. Bellman (1981) A fuzzy dynamic programming algorithm for clustering non-quantitative data arising in water pollution control planning. Proceedings of Third International Conference on Mathematical Modelling (Los Angeles, CA).
Esogbue A. O. and R. E. Bellman (1984) Fuzzy dynamic programming and its extensions. TIMS/Studies in the Management Sciences 20:147–167.
Esogbue A. O. and R. C. Elder (1983) Measurement and valuation of a fuzzy mathematical model for medical diagnosis. Fuzzy Sets and Systems 10:223–242.
Esogbue A. O., M. Fedrizzi and J. Kacprzyk (1988) Fuzzy dynamic programming with stochastic systems. In J. Kacprzyk and M. Fedrizzi (Eds.): Combining Fuzzy Imprecision with Probabilistic Uncertainty in Decision Making. Springer-Verlag, Berlin/New York, 266–285.
Esogbue A. O. and B. Liu (1996) On fuzzy criterion set dynamic programming. Proc. 1996 Biennial Conference of the North American Fuzzy Information Processing Society, Berkeley, CA, June 19–22, 1996, 70–74.
Esogbue A. O. and B. Liu (1997a) On stochastic multistage decision making under fuzzy criteria. Proc. International Conference on Fuzzy Logic and Applications, Zichron-Ya’akov, Israel, May 11–14, 1997.
Esogbue A. O. and B. Liu (1997b) Stochastic multi-joint reservior operation via fuzzy criterion dynamic programming. Proc. 7th International Fuzzy Systems Association (IFSA) World Congress, Prague, Czech Republic, June 25–29, 1997.
Esogbue A. O. and B. Liu (1997c) Fuzzy criterion dynamic programming and optimal control of multi-dimensional open inventory networks. Proc. Sixth IEEE International Conference on Fuzzy Systems, Barcelona, Spain, July 1–5, 1997.
Esogbue A. O. and V. Ramesh (1970) Dynamic programming and fuzzy allocation processes. Technical Memo No. 202, Dept. of Operations Research, Case Western University, Cleveland, OH.
Esogbue A. O., M. Theologidu and K. Guo (1992) On the application of fuzzy sets theory to the optimal flood control problem arising in water resources systems. Fuzzy Sets and Systems 48:155–172.
Fung, L. W. and Fu, K. S. (1977). Characterization of a class of fuzzy optimal control problems. In M. M. Gupta, G. N. Saridis and B. R. Gaines (Eds.): Fuzzy Automata and Decision Processes. North-Holland, Amsterdam, 205–220.
Huang C. J., Lin, C. E. and Huang, C. L. (1992) Fuzzy approach for generator maintenance scheduling. Electric Power Systems Research, 24, 31–38.
Hussein, M. L. and Abo-Sinna, M. A. (1993) Decomposition of multiobjective programming problems by hybrid fuzzy dynamic programming. Fuzzy Sets and Systems, 60, 25–32, 1993.
Kacprzyk, J. (1977). Control of a nonfuzzy system in a fuzzy environment with fuzzy termination time. Systems Sci., 3, 325–341.
Kacprzyk, J. (1978a). A branch-and-bound algorithm for the multistage control of a nonfuzzy system in a fuzzy environment. Control and Cybern., 7, 51–64.
Kacprzyk, J. (1978b). Control of a stochastic system in a fuzzy environment with fuzzy termination time. Systems Sci., 4, 291–300.
Kacprzyk, J. (1978c). Decision making in a fuzzy environment with fuzzy termination time. Fuzzy Sets and Systems, 1, 169–179.
Kacprzyk, J. (1979). A branch-and-bound algorithm for the multistage control of a fuzzy system in a fuzzy environment. Kybernetes, 8, 139–147.
Kacprzyk, J. (1983a). A generalization of fuzzy multistage decision making and control via linguistic quantifiers. Int. J. of Control, 38, 1249–1270.
Kacprzyk, J. (1983b). Multistage Decision-Making under Fuzziness. Verlag TÃœV Rheinland, Cologne.
Kacprzyk, J. (1993). Interpolative reasoning in optimal fuzzy control, Proc. of Second IEEE International Conference on Fuzzy Systems (FUZZ-IEEE ′93), Vol. II, 1259–1263.
Kacprzyk, J. (1994a). Fuzzy dynamic programming-basic issues, In M. Delgado, J. Kacprzyk, J.-L. Verdegay and M. A. Vila (Eds.): Fuzzy Optimization: Recent Advances, Physica-Verlag, Heidelberg, 321–331.
Kacprzyk, J. (1997). Multistage Fuzzy Control: A Model-Based Approach to Control and Decision Making. Wiley, Chichester.
Kacprzyk, J. and Esogbue, A.O. (1996). Fuzzy dynamic programming: Main developments and applications. Fuzzy Sets and Systems, 81:1, 31–45.
Kacprzyk, J., Safteruk, K. and Staniewski, P. (1981). On the control of stochastic systems in a fuzzy environment over infinite horizon, Systems Sci., 7, 121–131.
Kacprzyk, J. and Staniewski P. (1980). A new approach to the control of stochastic systems in a fuzzy environment, Arch. Automat. i Telemech., XXV, 443–444.
Kacprzyk, J. and Staniewski, P. (1982). Long-term inventory policy-making through fuzzy decision-making models. Fuzzy Sets and Systems, 8, 117–132.
Kacprzyk, J. and Staniewski, P. (1983). Control of a deterministic system in a fuzzy environment over an infinite planning horizon, Fuzzy Sets and Systems, 10, 291–298.
Kacprzyk J. and A. Straszak (1981) Application of fuzzy decision-making models for determining optimal policies in’ stable’ integrated regional development. In P. P. Wang and S. K. Chang (Eds.): Fuzzy Sets Theory and Applications to Policy Analysis and Information Systems, Plenum Press, New York, 321–328.
Kacprzyk J. and A. Straszak (1982a) A fuzzy approach to the stability of integrated regional development. In G. E Lasker (Ed.): Applied Systems and Cybernetics, Vol. 6, Pergamon Press, New York, 2997–3004.
Kacprzyk J. and A. Straszak (1982b) Determination of’ stable’ regional development trajectories via a fuzzy decision-making model. In R.R. Yager (Ed.): Recent Developments in Fuzzy Sets and Possibility Theory, Pergamon Press, New York, 531–541
Kacprzyk J. and A. Straszak (1984) Determination of stable trajectories for integrated regional development using fuzzy decision models. IEEE Transactions on Systems, Man and Cybernetics SMC-14: 310–313.
Klein, C.M. (1991). A model for the transportation of hazardous waste. Decision Sciences, 22, 1091–1108.
Komolov, S. V. et al. (1979). On the problem of optimal control of a finite automaton with fuzzy constraints and fuzzy goal (in Russian), Kybernetika (Kiev), 6, 30–34.
Kraslawski, A., A. Górak and A. Vogelpohl (1989) Fuzzy dynamic programming in the synthesis of distillation column systems. Computers and Chemical Engineering, 13, 611–618.
Liu, B. and A. O. Esogbue (1996) Fuzzy criterion set and fuzzy criterion dynamic programming. Journal of Mathematical Analysis and Applications, 199:1, 293–311.
Narshima Sastry, V., Tiwari, R. N., and Sastry, K. S.(1993) Dynamic programming approach to multiple objective control problems having deterministic or fuzzy goals. Fuzzy Sets and Systems, 57, 195–202, 1993.
Stein, W. E. (1980). Optimal stopping in a fuzzy environment, Fuzzy Sets and Systems, 3, 252–259.
Sugianto, L. F. and W., Mielczarski (1995a) A fuzzy logic approach to optimize inventory. In G. F. Forsyth and M. Ali (Eds.): Proceedings of Eighth International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, Gordon and Breach (Australia), 419–424.
Sugianto, L. F. and W. Mielczarski (1995b) Control of power station inventory by optimal allocation process with fuzzy logic approach. Proceedings of Control ′95 Conference (Australia), Vol. 2, 529–533.
Yuan, Y. and Z. Wu (1991) Algorithm of fuzzy dynamic programming in AGV scheduling. Proceedings of the International Conference on Computer Integrated Manufacturing — ICCIM ′91, 405–408.
Zadeh, L. A. (1968). Probability measures of fuzzy events, J. of Math. Anal. and Appls., 23, 421–427.
Zimmermann, H.-J. (1987). Fuzzy Sets, Decision Making, and Expert Systems. Kluwer, Dordrecht.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer Science+Business Media New York
About this chapter
Cite this chapter
Esogbue, A.O., Kacprzyk, J. (1998). Fuzzy Dynamic Programming. In: Słowiński, R. (eds) Fuzzy Sets in Decision Analysis, Operations Research and Statistics. The Handbooks of Fuzzy Sets Series, vol 1. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-5645-9_9
Download citation
DOI: https://doi.org/10.1007/978-1-4615-5645-9_9
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-7583-8
Online ISBN: 978-1-4615-5645-9
eBook Packages: Springer Book Archive