Summary
We present a new approach to the numerical computation of (higher) moments of the exit time distribution of diffusion processes. The method relies on a linear programming (LP) formulation of a process exiting from a bounded domain. The LP formulation characterizes the evolution of the stopped process through the moments of the induced occupation measure and leads to an infinite dimensional LP problem on a space of measures. Our functional method yields finite dimensional linear programs which approximate the infinite dimensional problem. An important aspect of our approach is the fact that excellent software is readily available.
We shall illustrate the method by looking at some examples. We shall specifically report on numerical computations and results related to change-point detection methods for drifted Brownian motion. Procedures for detecting changes in these models, such us CUSUM, EWMA and the Roberts-Shiryaev procedure, can be described in terms of one-dimensional diffusion processes and lead to exit time problems. Important operating characteristics for all of these procedures are the mean exit time and higher moments of the exit distributions of the diffusion processes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
M. Baxter and A. Rennie, Financial calculus: An introduction to derivative pricing, Cambridge University Press, Cambridge (1996).
A. G. Bhatt and V. S. Borkar, Occupation measures for controlled Markov processes: Characterization and optimality, Ann. Probab., 24 (1996), pp. 1531–1562.
A. I. Dale, Two-dimensional moment problems, Math. Scientist, 12 (1987), pp. 21–29.
S.N. Ethier and T.G. Kurtz, Markov Processes: Characterization and Convergence, Wiley, New York (1986).
W. Feller, An Introduction to Probability Theory and its Applications, Vol. 2, Wiley, New York (1965).
K. Helmes, S. Rühl and R. Stockbridge, Computing moments of the exit time distribution forMarkov processes by linear programming, (submitted for publication).
O. Hernandez-Lerma, J. C. Hennet and J. B. Lasserre, Average Cost Markov Decision Processes: Optimality Conditions, J. Math. Anal. Appi, 158 (1991), pp. 396–406.
T. G. Kurtz and R. H. Stockbridge, Existence of Markov Controls and Characterization of Optimal Markov Controls, to appear in SIAM J. Control. Optim..
A.S. Manne, Linear programming and sequential decisions, Management Sci., 6 (1960), 259–267.
M.S. Srivastava and Y. Wu, Dynamic sampling plan in Shiryaev-Roberts procedure for detecting a change in the drift of Brownian motion, Ann. Stat., 22 (1994), pp. 805–823.
D. W. Stroock and S. R. S. Varadhan, Multidimensional diffusion processes, Springer-Verlag, Berlin (1979).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Helmes, K. (1999). Computing Moments of the Exit Distribution for Diffusion Processes Using Linear Programming. In: Kall, P., Lüthi, HJ. (eds) Operations Research Proceedings 1998. Operations Research Proceedings 1998, vol 1998. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-58409-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-58409-1_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65381-3
Online ISBN: 978-3-642-58409-1
eBook Packages: Springer Book Archive