Skip to main content
SpringerLink
Log in

Generalized Bellman-Hamilton-Jacobi equations for piecewise deterministic Markov processes

  • Contributed Papers
  • Conference paper
  • First Online:
System Modelling and Optimization

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 197))

  • 1307 Accesses

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. L.D. Berkovitz, Optimal feedback controls, SIAM Journal of Control and Optimization 27 (1989), 991–1006.

    Article  MATH  MathSciNet  Google Scholar 

  2. F.H. Clarke, Optimization and Nonsmooth Analysis, John Wiley & Sons, New York, 1983.

    MATH  Google Scholar 

  3. M. C. Crandall and P.-L. Lions, Viscosity solutions of Hamilton-Jacobi equations. Trans. Amer. Math. Soc. 227(1983), 1–42.

    Article  MathSciNet  Google Scholar 

  4. M. H. A. Davis, Piecewise-deterministic Markov processes: A general class of non-diffusion stochastic models. J. Roy. Statist. Soc. B46(1984), 353–388.

    Google Scholar 

  5. M.H.A. Davis, Markov Models and Optimization, Chapman and Hall, London. To appear.

    Google Scholar 

  6. M. A. H. Dempster, Optimal control of piecewise deterministic Markov processes, Proceedings of the Imperial College Workshop on Applied Stochastic Analysis London, April 5–7, 1989 (M. H. A. Davis and R.J. Elliott, eds.), Gordon & Breach, London, 1991.

    Google Scholar 

  7. M.A.H. Dempster and J.J. Ye, Generalized Bellman-Hamilton-Jacobi optimality conditions for a control problem with a boundary condition, Submitted for publication.

    Google Scholar 

  8. M.A.H. Dempster and J.J. Ye, Necessary and sufficient optimality condition for control of piecewise deterministic Markov processes, Stochastics and Stochastics reports 40(1992), 125–145.

    Article  MATH  MathSciNet  Google Scholar 

  9. H.M. Soner, Optimal control with state space constraint II. SIAM J. Control and Optimization 24(1986), 1110–1122.

    Article  MATH  MathSciNet  Google Scholar 

  10. D. Vermes, Optimal control of piecewise deterministic Markov processes, Stochastics 14 (1985), 165–208.

    Article  MATH  MathSciNet  Google Scholar 

  11. J.J. Ye. Optimal control of piecewise deterministic Makov processes. Ph.D. Dissertation, Dept. of Math., Stats. & C.S., Dalhousie University, Halifax, Canada, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and Statistics, University of Victoria, V8W 3P4, Victoria, B.C., Canada

    J. J. Ye

Authors
  1. J. J. Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Jacques Henry Jean-Pierre Yvon

Rights and permissions

Reprints and permissions

Copyright information

© 1994 Springer-Verlag

About this paper

Cite this paper

Ye, J.J. (1994). Generalized Bellman-Hamilton-Jacobi equations for piecewise deterministic Markov processes. In: Henry, J., Yvon, JP. (eds) System Modelling and Optimization. Lecture Notes in Control and Information Sciences, vol 197. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0035503

Download citation

  • DOI: https://doi.org/10.1007/BFb0035503

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-19893-2

  • Online ISBN: 978-3-540-39337-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation