Skip to main content

A Risk-Sensitive Generalization of Maximum APosterior Probability (MAP) Estimation

  • Conference paper
  • First Online:
Stochastic Theory and Control

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 280))

  • 836 Accesses

Abstract

A sequential filtering scheme for the risk-sensitive state estimation of partially observed Markov chains is presented. The previously introduced risk-sensitive filters are unified in the context of risk-sensitive Maximum A Posterior Probability (MAP) estimation. Structural results for the filter banks are given. The influence of the availability of information and the transition probabilities on the decision regions and the behavior of risk-sensitive estimators are studied.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Vahid R. Ramezani. PhD dissertation (2001). Dept. of Electrical and Computer Engineering, University of Maryland, College Park. Institute for Systems Research Technical Reports PhD 2001-7. http://www.isr.umd.edu/TechReports/ISR/2001/PhD_2001-7

  2. D. H. Jacobson. Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic games, IEEE Trans. Aut. Control, vol. AC-18, no. 2, April 1973.

    Google Scholar 

  3. R. J. Elliot, L. Aggoun, and J. B. Moore. Hidden Markov Models: Estimation and control. Springer, Berlin, Heidelberg, New York, 1994.

    Google Scholar 

  4. M. R. James, J. S. Baras, and R. J. Elliot. Risk sensitive Control and dynamic games for partially Observed Discrete-Time Nonlinear Systems. IEEE Trans. Aut. Control, vol. 39(4), pp. 780–792, 1994.

    Article  MATH  Google Scholar 

  5. J. S. Baras and M. R. James. Robust and Risk-sensitive Output Feedback Control for Finite State Machines and Hidden Markov Models. Institute for Systems Research, University of Maryland at college Park, Technical Research Reports T. R. 94-63.

    Google Scholar 

  6. J. L. Spyer, C. Fan and R. N. Banava. Optimal Stochastic Estimation with Exponential Cost Criteria. Proceedings of 31th conference on decision and control. pp. 2293–2298, 1992.

    Google Scholar 

  7. S. Dey and J. Moore. Risk sensitive filtering and smoothing for hidden Markov models. Systems and control letters. vol. 25, pp. 361–366, 1995.

    Article  MATH  MathSciNet  Google Scholar 

  8. S. Dey and J. Moore. Risk sensitive filtering and smoothing via reference probability methods. IEEE Trans. Aut. Control. vol. 42, no. 11 pp. 1587–91, 1997.

    Article  MATH  MathSciNet  Google Scholar 

  9. R. K. Boel, M. R. James, and I. R. Petersen. Robustness and risk-sensitive filtering. Proceedings of the 36th IEEE Conference on Decision and Control. Cat. No. 97CH36124, 1997.

    Google Scholar 

  10. H. Vincent Poor. An introduction to signal detection and estimation. Springer Verlag, 1994.

    Google Scholar 

  11. P. Whittle. Risk-sensitive optimal control. John Wiley & sons, 1990.

    Google Scholar 

  12. E. Fernandez-Gaucherand and S. I. Marcus. Risk-sensitive optimal control of Hidden Markov Models: a case study. IEEE Transactions on Automatic Control, vol. 42, no. 10, pp. 1418–1422, 1997.

    Article  MATH  MathSciNet  Google Scholar 

  13. R. J. Elliot. Stochastic Calculus and Applications. New York: Springer-Verlag, 1982.

    Google Scholar 

  14. A. N. Shiryayev. probability. New York: Springer-Verlag, 1984.

    MATH  Google Scholar 

  15. P. Whittle. Risk-sensitive optimal control. John Wiley & sons, 1990.

    Google Scholar 

  16. P. Whittle. Risk-sensitive linear/quadratic/Gaussian control. Adv. Applied probability. 13, 746–777, 1981, applied probability trust.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ramezani, V.R., Marcus, S.I. (2002). A Risk-Sensitive Generalization of Maximum APosterior Probability (MAP) Estimation. In: Pasik-Duncan, B. (eds) Stochastic Theory and Control. Lecture Notes in Control and Information Sciences, vol 280. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48022-6_28

Download citation

  • DOI: https://doi.org/10.1007/3-540-48022-6_28

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43777-2

  • Online ISBN: 978-3-540-48022-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics