Skip to main content

Computing Moments of the Exit Distribution for Diffusion Processes Using Linear Programming

  • Conference paper
Operations Research Proceedings 1998

Part of the book series: Operations Research Proceedings 1998 ((ORP,volume 1998))

Summary

We present a new approach to the numerical computation of (higher) moments of the exit time distribution of diffusion processes. The method relies on a linear programming (LP) formulation of a process exiting from a bounded domain. The LP formulation characterizes the evolution of the stopped process through the moments of the induced occupation measure and leads to an infinite dimensional LP problem on a space of measures. Our functional method yields finite dimensional linear programs which approximate the infinite dimensional problem. An important aspect of our approach is the fact that excellent software is readily available.

We shall illustrate the method by looking at some examples. We shall specifically report on numerical computations and results related to change-point detection methods for drifted Brownian motion. Procedures for detecting changes in these models, such us CUSUM, EWMA and the Roberts-Shiryaev procedure, can be described in terms of one-dimensional diffusion processes and lead to exit time problems. Important operating characteristics for all of these procedures are the mean exit time and higher moments of the exit distributions of the diffusion processes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. Baxter and A. Rennie, Financial calculus: An introduction to derivative pricing, Cambridge University Press, Cambridge (1996).

    Google Scholar 

  2. A. G. Bhatt and V. S. Borkar, Occupation measures for controlled Markov processes: Characterization and optimality, Ann. Probab., 24 (1996), pp. 1531–1562.

    Article  Google Scholar 

  3. A. I. Dale, Two-dimensional moment problems, Math. Scientist, 12 (1987), pp. 21–29.

    Google Scholar 

  4. S.N. Ethier and T.G. Kurtz, Markov Processes: Characterization and Convergence, Wiley, New York (1986).

    Google Scholar 

  5. W. Feller, An Introduction to Probability Theory and its Applications, Vol. 2, Wiley, New York (1965).

    Google Scholar 

  6. K. Helmes, S. Rühl and R. Stockbridge, Computing moments of the exit time distribution forMarkov processes by linear programming, (submitted for publication).

    Google Scholar 

  7. O. Hernandez-Lerma, J. C. Hennet and J. B. Lasserre, Average Cost Markov Decision Processes: Optimality Conditions, J. Math. Anal. Appi, 158 (1991), pp. 396–406.

    Article  Google Scholar 

  8. T. G. Kurtz and R. H. Stockbridge, Existence of Markov Controls and Characterization of Optimal Markov Controls, to appear in SIAM J. Control. Optim..

    Google Scholar 

  9. A.S. Manne, Linear programming and sequential decisions, Management Sci., 6 (1960), 259–267.

    Article  Google Scholar 

  10. M.S. Srivastava and Y. Wu, Dynamic sampling plan in Shiryaev-Roberts procedure for detecting a change in the drift of Brownian motion, Ann. Stat., 22 (1994), pp. 805–823.

    Article  Google Scholar 

  11. D. W. Stroock and S. R. S. Varadhan, Multidimensional diffusion processes, Springer-Verlag, Berlin (1979).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Helmes, K. (1999). Computing Moments of the Exit Distribution for Diffusion Processes Using Linear Programming. In: Kall, P., Lüthi, HJ. (eds) Operations Research Proceedings 1998. Operations Research Proceedings 1998, vol 1998. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-58409-1_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-58409-1_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65381-3

  • Online ISBN: 978-3-642-58409-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics