Abstract
Continuing the central themes of this book, as an application of the asymptotic properties of singularly perturbed Markov chains, this chapter focuses on hierarchical controls for a class of Markov decision problems. Our main attention is on finite-state continuous-time Markov decision processes (MDP) having weak and strong interactions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer Science+Business Media New York
About this chapter
Cite this chapter
Yin, G.G., Zhang, Q. (1998). Markov Decision Problems. In: Continuous-Time Markov Chains and Applications. Applications of Mathematics, vol 37. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-0627-9_8
Download citation
DOI: https://doi.org/10.1007/978-1-4612-0627-9_8
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4612-6844-4
Online ISBN: 978-1-4612-0627-9
eBook Packages: Springer Book Archive