We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Stochastic Processes | SpringerLink

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Skip to main content

Stochastic Processes

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

  • First Online:
  • 1423 Accesses

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

Stochastic processes are defined and grouped into different classes, their basic properties are listed and compared. The Chapman–Kolmogorov equation is introduced, transformed into a differential version, and used to classify the three major types of processes: (i) drift and (ii) diffusion with continuous sample paths, and (iii) jump processes which are essentially discontinuous. In pure form these prototypes are described by Liouville equations, stochastic diffusion equations, and master equations, respectively. The most popular and most frequently used continuous equation is the Fokker–Planck (FP) equation, which describes the evolution of a probability density by drift and diffusion. The pendant to FP equations on the discontinuous side are master equations which deal only with jump processes and represent the appropriate tool for modeling processes described by discrete variables. For technical reasons they are often difficult to handle unless population sizes are relatively small. Particular emphasis is laid on modeling conventional and anomalous diffusion processes. Stochastic differential equations (SDEs) model processes at the level of random variables by solving ordinary differential equations upon which a diffusion process, called a Wiener process, is superimposed. Ensembles of individual trajectories of SDEs are equivalent to time dependent probability densities described by Fokker–Planck equations.

With four parameters I can fit an elephant

and with five I can make him wiggle his trunk.

                           Enrico Fermi quoting John von Neumann 1953 [119].

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Identical conditions means that all parameters are the same except for the random fluctuations. In computer simulations this is achieved by keeping everything precisely the same except the seeds for the pseudorandom number generator.

  2. 2.

    By general we mean here methods that are widely applicable and not tailored specifically for deriving stochastic solutions for a single case or a small number of cases.

  3. 3.

    The Russian mathematician Andrey Markov (1856–1922) was one of the founders of Russian probability theory and pioneered the concept of memory-free processes, which are named after him. He expressed more precisely the assumptions that were made by Albert Einstein [133] and Marian von Smoluchowski [559] in their derivation of the diffusion process.

  4. 4.

    For the moment we need not specify whether \(\mathcal{X}(t)\) is a simple random variable or a random vector \(\boldsymbol{\mathcal{X}}(t) ={\bigl ( \mathcal{X}_{k}(t); k = 1,\mathop{\ldots },M\bigr )}\), so we drop the index k determining the individual component. Later on, for example in chemical kinetics where the distinction between different (chemical) species becomes necessary, we shall make clear the sense in which \(\mathcal{X}(t)\) is used, i.e., random variable or random vector.

  5. 5.

    Here we shall use the notion of phase space in a loose way to mean an abstract space that is sufficient for the characterization of the system and for the description of its temporal development. For example, in a reaction involving n chemical species, the phase space will be a Cartesian space spanned by n axes for n independent concentrations. In classical mechanics and in statistical mechanics, the phase space is precisely defined as a—usually Cartesian—space spanned by the 3n spatial coordinates and the 3n coordinates of the linear momenta of an n-particle system.

  6. 6.

    The different numberings for the elements of trajectories should not be confused with forward and backward processes (Fig. 3.2), to be discussed in Sect. 3.3.

  7. 7.

    In order to leave the subscript free to indicate discrete times or different chemical species, we use the somewhat clumsy superscript notation \(\mathcal{X}^{(i)}\) or x (i) (\(i = 1,\mathop{\ldots },N\)), to specify individual trajectories, and we use the physical numbering of times t 0 → t n .

  8. 8.

    The joint density p is defined as in (1.36) and in Sect. 1.9.3 We use it here with a slightly different notation, because in stochastic processes we are always dealing with pairs (x, t), which we separate by a semicolon: ; x k , t k ; x k+1, t k+1; .

  9. 9.

    For convenience we change the numbering of times here and apply the notation of (3.3 ).

  10. 10.

    The term càdlàg is an acronym from French which stands for continue à droite, limites à gauche. The English expression is right continuous with left limits (RCLL). It is a common property of step functions in probability theory (Sect. 1.6.2). We shall reconsider the càdlàg property in the context of sampling trajectories (Sect. 4.2.1).

  11. 11.

    The Russian mathematician Andrey Markov (1856–1922) was one of the founders of Russian probability theory and pioneered the concept of memory-free processes which is named after him. Among other contributions he expressed the assumptions that were made by Albert Einstein [133] and Marian von Smoluchowski [559] in their derivation of the diffusion process in more precise terms.

  12. 12.

    The notion of autocovariance reflects the fact that the process is correlated with itself at another time, while cross-covariance implies the correlation of two different processes (for the relation between autocorrelation and autocovariance, see Sect. 3.1.6).

  13. 13.

    The notation used for time dependent variables is explained in Fig. 3.4. For convenience and readability, we write x for \(z + \Delta z\).

  14. 14.

    Later on we shall discuss the limit of the random walk for vanishing step size in more detail and call it a Wiener process (Sect. 3.2.2.2).

  15. 15.

    We remark that this definition of the Fourier transform is used in signal processing and differs from the convention used in modern physics (see [568] and Sect. 2.2.3).

  16. 16.

    Here, we need not yet specify whether the sample space is discrete as in P n (t), or continuous as in P(x, t), and we indicate this by the notation P(n, t). However, we shall specify the variables in Sect. 3.2.1.

  17. 17.

    The derivation is already contained in the first edition of Gardiner’s Handbook of Stochastic Methods [193], and it was Crispin Gardiner who coined the term differential Chapman–Kolmogorov equation.

  18. 18.

    It is important to note a useful trick in the derivation: by substituting the 1, the time order is reversed in the integral.

  19. 19.

    The notation ∥ ⋅ ∥ refers to a suitable vector norm, here the L 1 norm given by ∥ y ∥ =  k  | y k  | . In the one-dimensional case, we would just use the absolute value | y | .

  20. 20.

    Differentiation with respect to x has to be done with respect to the components x i . Note that u vanishes through integration.

  21. 21.

    A positive definite matrix has exclusively positive eigenvalues λ k  > 0, whereas a positive semidefinite matrix has nonnegative eigenvalues λ k  ≥ 0.

  22. 22.

    The idea of the Liouville equation was first discussed by Josiah Willard Gibbs [202].

  23. 23.

    Phase space is an abstract space, which is particularly useful for visualizing particle motion. The six independent coordinates of particle S k are the position coordinates q k  = (q k1, q k2, q k3) and the (linear) momentum coordinates p k  = (p k1, p k2, p k3). In Cartesian coordinates, they are q k  = (x k , y k , z k ) and p k  = m k v k , where v = (v x , v y , v z ) is the velocity vector.

  24. 24.

    For simplicity, we write p(x, t) instead of the conditional probability p(x, t | x 0, t 0) whenever the initial condition (x 0, t 0) refers to the sharp density p(x, t 0) = δ(xx 0).

  25. 25.

    We distinguish the two formally identical equations (3.55) and (3.56), because the interpretation is different: the former describes the evolution of a probability distribution with the conservation relation dwp(w, t) = 1, whereas the latter deals with a concentration profile, which satisfies \(\int \mathrm{d}x\,c(x,t) = c_{\mathrm{tot}}\) corresponding to mass conservation. In the case of the heat equation, the conserved quantity is total heat. It is worth considering dimensions here. The coefficient 1∕2 in (3.55) has the dimensions [t−1] of a reciprocal time, while the diffusion coefficient has dimensions [l2t−1], and the commonly used unit is [cm2/s].

  26. 26.

    Integration by parts is a standard integration method in calculus. It is encapsulated in the formula

    $$\displaystyle{ \int _{a}^{b}u(x)v'(x)\,\mathrm{d}x = u(x)v(x)\Big\vert _{a}^{b} -\int _{a}^{b}u'(x)v(x)\,\mathrm{d}x\phantom{0}. }$$

    Characteristic functions are especially well suited to partial integration, because exponential functions v(x) = exp(isx) can be easily integrated, and probability densities u(x) = p(x, t) as well as their first derivatives u(x) = ∂ p(x, t)∕∂ x vanish in the limits x → ±.

  27. 27.

    Integral transformations, in particular the Fourier and the Laplace transform, are standard techniques for solving ODEs and PDEs. For details, we refer to mathematics handbooks for the scientist such as [149, pp. 89–96] and [467, pp. 449–451, 681–686].

  28. 28.

    For a system in 3D space, the wave vector in reciprocal space is denoted by k, and its length | k | = k is called the wave number.

  29. 29.

    An autoregressive process of order n is denoted by AR(n). The order n implies that n values of the stochastic variables at previous times are required to calculate the current value. An extension of the autoregressive model is the autoregressive moving average (ARMA) model.

  30. 30.

    The variance of the Wiener process diverges, i.e., \(\lim _{t\rightarrow \infty }\mathrm{var}{\bigl (\mathcal{W}(t)\bigr )} = \infty\). The same is true for the Poisson process and the random walk, which are discussed in the next two sections.

  31. 31.

    From here on, unless otherwise stated, we shall consider cases in which the limits lim | xz | → 0 W(x | z, t) and lim | xz | → 0 W(z | x, t) of the transition probabilities are finite and the principal value integral can be replaced by a conventional integral. Riemann–Stieltjes integration converts the integral into a sum, and since we are dealing exclusively with discrete events, we use an index on the probability P n (t).

  32. 32.

    The notation δ ij denotes the Kronecker delta , named after the German mathematician Leopold Kronecker , which means

    $$\displaystyle{\delta _{ij} = \left \{\begin{array}{@{}l@{\quad }l@{}} 1\,,\ \ \quad &\mathrm{if}\ \ i = j\,,\\ 0\,,\ \ \quad &\mathrm{if }\ \ i\neq j\,. \end{array} \right.}$$

    It is the discrete analogue of the Dirac delta function.

  33. 33.

    In the literature both expressions, waiting time and arrival time, are common. An inter-arrival time is a waiting time.

  34. 34.

    The litter size is defined as the mean number of offspring produced by an animal in a single birth.

  35. 35.

    Exceptions with only one transition are the lowest and the highest state, n = n min and n = n max, which are the boundaries of the system. In biology, the notation w n + ≡ λ n and w n  ≡ μ n for death and birth rates is common.

  36. 36.

    An excellent tutorial on this subject by Bahram Houchmandzadeh can be found at http://www.houchmandzadeh.net/cours/Master_Eq/master.pdf. Retrieved 2 May 2014.

  37. 37.

    In general these equations hold also for summations from 0 to + if the corresponding physically meaningless probabilities are set equal to zero by definition: \(P_{n}(t) = 0\,,\;\forall \,n \in \mathbb{Z}_{<0}\).

  38. 38.

    The probability of extinction from state Σ i is the probability of proceeding one step down multiplied by the probability of extinction from state Σ i−1 plus the probability of going one step up times the probability of becoming extinct from Σ i+1.

  39. 39.

    It is worth pointing out a subtle difference between (3.109) and (3.9): the term containing − 2P n (t) is missing in the latter, because motion is obligatory in the discrete time model. The walker is not allowed to take a rest.

  40. 40.

    The most straightforward way to take the limit is to introduce a scaling assumption , using a variable γ such that Δx = γ Δx 0 and \(\Delta t =\gamma ^{2}\Delta t_{0}\). Then we have \(\varDelta \,x^{2}/2\Delta t =\varDelta \, x_{0}^{2}/2\Delta t_{0} = D\) and the limit γ → 0 is trivial.

  41. 41.

    If the jump lengths and waiting times were coupled, we would have to deal with φ(ξ, τ) = φ(ξ | τ)ψ(τ) = φ(τ | ξ)f(ξ). Coupling between space and time could arise, for example, from the fact that it is impossible to jump a certain distance within a time span shorter than some minimum time.

  42. 42.

    As in the previous examples, we assume that the random walk is symmetric and started at the origin. Then the expectation value of the location of the particle stays at the origin and we have \(\left <\xi \right> = 0\), \(\left <\xi \right>^{2} = 0\), and hence \(\mathrm{var}(\xi ) = \left <\xi ^{2}\right>\).

  43. 43.

    For Lévy processes in general it will be necessary to replace the integral by a principal value integral because they may lead to a singularity at the origin, i.e., lim z → x w(xz) = , and this prohibits conventional integration.

  44. 44.

    The discreteness of u would require here a Stieltjes integral with dW(u) but the trick with a Dirac delta function allows one to use the differential expression w(u)du.

  45. 45.

    The Laurent series is an extension of the Taylor series to negative powers of (zz 0), named in honor of the French mathematician Pierre Alphonse Laurent .

  46. 46.

    Although the value α = 2 leads to divergence in the regular derivation, applying α = 2, β = 0, and γ = 1∕2 yields the probability density of the normal diffusion process.

  47. 47.

    We use the relations lim α → 1 Γ(−α) = ±, but lim α → 1 Γ(−α)cos(π α∕2) = −π∕2, which are easy to check.

  48. 48.

    The absolute value of the wave number | k | is sometimes used in all expressions, which is necessary when complex k values are admitted, or in the multidimensional case where k is the wave vector. Here we use real k values in one dimension and we need | k | only to express a cusp at k = 0.

  49. 49.

    Because of this similarity we called the α = 2 Pareto process a Lev́y walk.

  50. 50.

    In order to avoid confusion we shall reserve the variable y(τ) and y(0) = y 0 for backward computation.

  51. 51.

    Boundaries are also called barriers in the literature and the notions are taken to be synonymous. We shall use here exclusively the word boundary. The term barrier will be reserved for obstacles to motion inside the domain of the random variable.

  52. 52.

    We remark that the relation between the diffusion functions in the Fokker–Planck equation and the SDE, B(x, t) and b(x, t), is more subtle, and involves a square root according to (3.42), as will be discussed later on here in this section.

  53. 53.

    In a telescopic sum, all terms except the first and the last summand cancel.

  54. 54.

    To derive this relation, we use the fact that the stochastic variables of the Wiener process at different times are uncorrelated, i.e., \(\left <\mathcal{W}(t_{i})\mathcal{W}(t_{j})\right> = 0\), and the variance is \(\mathrm{var}{\bigl (\mathcal{W}(t_{i})\bigr )} = \left <\mathcal{W}(t_{i})^{2}\right> -\left <\mathcal{W}(t_{i})\right>^{2} = \left <\mathcal{W}(t_{i})^{2}\right> - (t_{i} - t_{0})^{2}\). We simplify the expressions in the derivation and write from here on \(\mathcal{W}_{i}\) for \(\mathcal{W}(t_{i})\) and \(\Delta \mathcal{W}_{i}\) for \(\Delta \mathcal{W}(t_{i})\).

  55. 55.

    Every deterministic process is nonanticipating: in order to calculate the value G(t + dt) of a function t → G(t), no value G(τ) with τ > t is required.

  56. 56.

    A function assigns a value to the argument of the function, x 0 → f(x 0), whereas a functional relates a function to the value of a function, f → f(x 0).

  57. 57.

    In order to distinguish the two versions of stochastic integrals we use the symbol \(\int _{t_{0}}^{t}\) for the Itō integral and \(\mbox{ s}\!\!\!\!\int _{t_{0}}^{t}\) for the Stratonovich integral [277, p. 86]. The distinction from ordinary integrals is automatically provided by the differential \(\mathrm{d}\mathcal{W}(t)\).

  58. 58.

    We use here the sanserif font for the diffusion matrix in order to distinguish it from the conventional diffusion matrix B = B t B in the Fokker–Planck equation.

  59. 59.

    In order to prove the conjecture, one makes use of the fact that all cumulants κ n with n > 2 vanish (see Sect. 2.3.3). The reader is encouraged to complete the proof.

  60. 60.

    A Poissonian distribution depends on a single parameter \({\bigl (\alpha (\tau ),\tau \bigr )}\equiv \alpha (\tau )\tau\). For simplicity, we shall write α instead of α(τ) from now on.

  61. 61.

    We use here α{(n(t))} for the propensity function in order to show the relationship with a Poisson process. In chemical kinetics (Chap. 4), it will be denoted by χ{(n(t))}.

  62. 62.

    Under certain rather rare circumstances, modeling reactions with time dependent reaction rate parameters may be advantageous.

References

  1. Anderson, B.D.O.: Reverse-time diffusion equation models. Stoch. Process. Appl. 12, 313–326 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  2. Anderson, P.W.: More is different. Broken symmetry and the nature of the hierarchical stucture of science. Science 177, 393–396 (1972)

    Google Scholar 

  3. Applebaum, D.: Lévy processes – From probability to finance and quantum groups. Not. Am. Math. Soc. 51, 1336–1347 (2004)

    MathSciNet  MATH  Google Scholar 

  4. Arfken, G.B., Weber, H.J.: Mathematical Methods for Physicists, fifth edn. Harcourt Academic Press, San Diego (2001)

    Google Scholar 

  5. Arnold, L.: Stochastic Differential Equations. Theory and Applications. Wiley, New York (1974)

    MATH  Google Scholar 

  6. Bachelier, L.: Théorie de la spéculation. Annales scientifiques de l’É.N.S. 3e série 17, 21–86 (1900)

    Google Scholar 

  7. Bergström, H.: On some expansions of stable distribution functions. Ark. Math. 2, 375–378 (1952)

    Article  MathSciNet  MATH  Google Scholar 

  8. Birkhoff, G.D.: Proof of the ergodic theorem. Proc. Natl. Acad. sci. USA 17, 656–660 (1931)

    Article  ADS  MATH  Google Scholar 

  9. Bouchaud, J.P., Georges, A.: Anomalous diffusion in disordered madia: Statistical mechanisms, models and physical applications. Phys. Rep. 195, 127–293 (1990)

    Article  ADS  MathSciNet  Google Scholar 

  10. Brockmann, D., Hufnagel, L., Geisel, T.: The scaling laws of human travel. Nature 439, 462–465 (2006)

    Article  ADS  Google Scholar 

  11. Brockwell, P.J., Davis, R.A.: Introduction to Time Series and Forecasting. Springer, New York (1996)

    Book  MATH  Google Scholar 

  12. Brockwell, P.J., Davis, R.A., Yang, Y.: Continuous-time Gaussian autoregression. Stat. Sin. 17, 63–80 (2007)

    MATH  Google Scholar 

  13. Brown, R.: A brief description of microscopical observations made in the months of June, July and August 1827, on the particles contained in the pollen of plants, and on the general existence of active molecules in organic and inorganic bodies. Phil. Mag. Ser. 2 4, 161–173 (1828). First Publication: The Edinburgh New Philosophical Journal. July-September 1828, pp. 358–371

    Google Scholar 

  14. Chechkin, A.V., Metzler, R., Klafter, J., Gonchar, V.Y.: Introduction to the theory of Lévy flights. In: R. Klages, G. Radons, I.M. Sokolov (eds.) Anomalous Transport: Foundations and Applications, chap. 5, pp. 129–162. Wiley-VCH Verlag GmbH, Weinheim, DE (2008)

    Google Scholar 

  15. Cox, D.R., Miller, H.D.: The Theory of Stochastic Processes. Methuen, London (1965)

    MATH  Google Scholar 

  16. Crank, J.: The Mathematics of Diffusion. Clarendon Press, Oxford (1956)

    MATH  Google Scholar 

  17. Devroye, L.: Non-Uniform Random Variate Generation. Springer, New York (1986)

    Book  MATH  Google Scholar 

  18. Dyson, F.: A meeting with Enrico Fermi. How one intuitive physicist rescued a team from fruitless research. Nature 427, 297 (2004)

    Google Scholar 

  19. Eigen, M.: Selforganization of matter and the evolution of biological macromolecules. Naturwissenschaften 58, 465–523 (1971)

    Article  ADS  Google Scholar 

  20. Einstein, A.: Über die von der molekular-kinetischen Theorie der Wärme geforderte Bewegung von in ruhenden Flüssigkeiten suspendierten Teilchen. Annal. Phys. (Leipzig) 17, 549–560 (1905)

    Google Scholar 

  21. Elliot, R.J., Anderson, B.D.O.: Reverse-time diffusions. Stoch. Process. Appl. 19, 327–339 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  22. Elliot, R.J., Kopp, A.E.: Mathematics of Financial Markets, 2nd edn. Springer, New York (2005)

    MATH  Google Scholar 

  23. Farlow, S.J.: Partial Differential Equations for Scientists and Engineers. Dover Publications, New York (1982)

    MATH  Google Scholar 

  24. Feigenbaum, M.J.: Universal behavior in nonlinear systems. Physica D 7, 16–39 (1983)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  25. Feller, W.: On the theory of stochastic processes, with particular reference to applications. In: The Regents of the University of California (ed.) Proceedings of the Berkeley Symposium on Mathematical Statistics and Probability, pp. 403–432. University of California Press, Berkeley (1949)

    Google Scholar 

  26. Feller, W.: An Introduction to Probability Theory and Its Application, vol. II, 2nd edn. Wiley, New York (1971)

    Google Scholar 

  27. Fisk, D.L.: Quasi-martingales. Trans. Am. Math. Soc. 120, 369–389 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  28. Gardiner, C.W.: Handbook of Stochastic Methods, 1st edn. Springer, Berlin (1983)

    Book  MATH  Google Scholar 

  29. Gardiner, C.W.: Stochastic Methods. A Handbook for the Natural Sciences and Social Sciences, fourth edn. Springer Series in Synergetics. Springer, Berlin (2009)

    Google Scholar 

  30. Gibbs, J.W.: Elementary Principles in Statistical Mechanics. Charles Scribner’s Sons, New York (1902). Reprinted 1981 by Ox Bow Press, Woodbridge, CT

    Google Scholar 

  31. Gihman, I.F., Skorohod, A.V.: The Theory of Stochastic Processes. Vol. I, II, and III. Springer, Berlin (1975)

    Google Scholar 

  32. Gillespie, D.T.: Markov Processes: An Introduction for Physical Scientists. Academic Press, San Diego (1992)

    MATH  Google Scholar 

  33. Gillespie, D.T.: Exact numerical simulation of the Ornstein-Uhlenbeck process and its integral. Phys. Rev. E 54, 2084–2091 (1996)

    Article  ADS  MathSciNet  Google Scholar 

  34. Gillespie, D.T.: The chemical Langevin equation. J. Chem. Phys. 113, 297–306 (2000)

    Article  ADS  Google Scholar 

  35. Gillespie, D.T.: Stochastic simulation of chemical kinetics. Annu. Rev. Phys. Chem. 58, 35–55 (2007)

    Article  ADS  Google Scholar 

  36. Gillespie, D.T., Seitaridou, E.: Simple Brownian Diffusion. An Introduction to the Standard Theoretical Models. Oxford University Press, Oxford (2013)

    MATH  Google Scholar 

  37. Goel, N.S., Richter-Dyn, N.: Stochastic Models in Biology. Academic Press, New York (1974)

    Google Scholar 

  38. Goychuk, I.: Viscoelastic subdiffusion: Generalized langevin equation approach. Adv. Chem. Phys. 150, 187–253 (2012)

    Google Scholar 

  39. Hamilton, J.D.: Time Series Analysis. Princeton University Press, Princeton (1994)

    MATH  Google Scholar 

  40. Hamilton, W.R.: On a general method in dynamics. Philos. Trans. R. Soc. Lond. II for 1834, 247–308 (1834)

    Google Scholar 

  41. Hamilton, W.R.: Second essay on a general method in dynamics. Philos. Trans. R. Soc. London I for 1835, 95–144 (1835)

    Google Scholar 

  42. Haubold, H.J., Mathai, M.A., Saxena, R.K.: Mittag-Leffler functions and their applications. J. Appl. Math. 2011, e298,628 (2011). Hindawi Publ. Corp.

    Google Scholar 

  43. Haussmann, U.G., Pardoux, E.: Time reversal of diffusions. Ann. Probab. 14, 1188–1205 (1986)

    Article  MathSciNet  MATH  Google Scholar 

  44. Humphries, N.E., Queiroz, N., Dyer, J.R.M., Pade, N.G., Musyl, M.K., Schaefer, K.M., Fuller, D.W., Brunnschweiler, J.M., Doyle, T.K., Houghton, J.D.R., Hays, G.C., Jones, C.S., Noble, L.R., Wearmouth, V.J., Southall, E.J., Sims, D.W.: Environmental context explains Lévy and Brwonian movement patterns of marine predators. Nature 465, 1066–1069 (2010)

    Article  ADS  Google Scholar 

  45. Itō, K.: Stochastic integral. Proc. Imp. Acad. Tokyo 20, 519–524 (1944)

    Article  MathSciNet  MATH  Google Scholar 

  46. Itō, K.: On stochastic differential equations. Mem. Am. Math. Soc. 4, 1–51 (1951)

    Google Scholar 

  47. Jacobs, K.: Stochastic processes for Physicists. Understanding Noisy Systems. Cambridge University Press, Cambridge (2010)

    Book  MATH  Google Scholar 

  48. Karlin, S., Taylor, H.M.: A First Course in Stochastic Processes, 2nd edn. Academic Press, New York (1975)

    MATH  Google Scholar 

  49. Kimura, M.: The Neutral Theory of Molecular Evolution. Cambridge University Press, Cambridge (1983)

    Book  Google Scholar 

  50. Langevin, P.: Sur la théorie du mouvement Brownien. Comptes Rendues hebdomadaires des Séances de L’Academié des Sceinces 146, 530–533 (1908)

    MATH  Google Scholar 

  51. Lewis, W.C.M.: Studies in catalysis. Part IX. The calculation in absolute measure of velocity constants and equilibrium constants in gaseous systems. J. Chem. Soc. Trans. 113, 471–492 (1918)

    Google Scholar 

  52. Liouville, J.: Note sur la théorie de la variation des constantes arbitraires. Journal de Mathématiques pure et appliquées 3, 342–349 (1838). In French.

    Google Scholar 

  53. Liouville, J.: Mémoire sur l’intégration des équations différentielles du mouvement quelconque de points matériels. Journal de Mathématiques pure et appliquées 14, 257–299 (1849). In French.

    Google Scholar 

  54. Mahnke, R., Kaupužs, J., Lubashevsky, I.: Physics of Stochastic Processes. How Randomness Acts in Time. Wiley-VCh Verlag, Weinheim (Bergstraße), DE (2009)

    MATH  Google Scholar 

  55. Mandelbrot, B.B.: The Fractal Geometry of Nature, updated edn. W. H. Freeman Company, New York (1983)

    Google Scholar 

  56. Mansuy, R.: The origins of the word “martingale”. Electron. J. Hist. Probab. Stat. 5 (1), 1–10 (2009). Translated by Ronald Sverdlove from the French Histoire des martigales. Mathématiques Sciences Humaines 43 (169), 105–113 (2005)

    Google Scholar 

  57. Mathai, A.M., Saxena, R.K., Haubold, H.J.: A certain class of Laplace transforms with applications to reaction and reaction-diffusion equations. Astrophys. Space Sci. 305, 283–288 (2006)

    Article  ADS  MATH  Google Scholar 

  58. Medvegyev, P.: Stochastic Integration Theory. Oxford University Press, New York (2007)

    MATH  Google Scholar 

  59. Metzler, R., Klafter, J.: The random walk’s guide to anomalous diffusion: A fractional dynamics approach. Phys. Rep. 339, 1–77 (2000)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  60. Mittag-Leffler, M.G.: Sur la nouvelle fonction E α (x). C. R. Acad. Sci. Paris Ser. II 137, 554–558 (1903)

    MATH  Google Scholar 

  61. Montroll, E.W., Weiss, G.H.: Random walks on lattices. II. J. Math. Phys. 6, 167–181 (1965)

    Article  ADS  MathSciNet  MATH  Google Scholar 

  62. Moore, C.C.: Ergodic theorem, ergodic theory and statistical mechanics. Proc. Natl. Acad. Sci. USA 112, 1907–1911 (2015)

    Article  ADS  MathSciNet  Google Scholar 

  63. Moyal, J.E.: Stochastic processes and statistical physics. J. R. Stat. Soc. B 11, 150–210 (1949)

    MathSciNet  MATH  Google Scholar 

  64. Øksendal, B.K.: Stochastic Differential Equations. An Introduction with Applications, 6th edn. Springer, Berlin (2003)

    Google Scholar 

  65. Papapantoleon, A.: An Introduction to Lévy Processes with Applications in Finance. arXiv, Princeton, NJ (2008). ArXiv:0804.0482v2 retrieved July 27, 2015

    Google Scholar 

  66. Pearson, K.: On the criterion that a given system of deviations form the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philos. Mag. Ser. 5 50 (302), 157–175 (1900)

    Google Scholar 

  67. Philibert, J.: One and a half century of diffusion: Fick, Einstein, before and beyond. Diffusion Fundamentals 4, 6.1–6.19 (2006)

    Google Scholar 

  68. Pollard, H.: The representatioin of \(e^{-x^{\lambda } }\) as a Laplace intgeral. Bull. Am. Math. Soc. 52, 908–910 (1946)

    Article  MathSciNet  MATH  Google Scholar 

  69. Protter, P.E.: Stochastic Intergration and Differential Equations, Applications of Mathematics, vol. 21, 2nd edn. Springer, Berlin (2004)

    Google Scholar 

  70. Riley, K.F., Hobson, M.P., Bence, S.J.: Mathematical Methods for Physics and Engineering, 2nd edn. Cambridge University Press, Cambridge (2002)

    Book  MATH  Google Scholar 

  71. Risken, H.: TheFokker-Planck Equation. Methods of Solution and Applications, 2nd edn. Springer, Berlin (1989)

    Google Scholar 

  72. Sato, K.: Lévy Processes and Infinitely Divisible Distributions, 2nd edn. Cambridge University Press, Cambridge (2013)

    MATH  Google Scholar 

  73. Scher, H., Shlesinger, M.F., Bendler, J.T.: Time scale invariance in transport and relaxation. Phys. Today 44 (1), 26–34 (1991)

    Article  ADS  Google Scholar 

  74. Schoutens, W.: Lévy Processes in Finance. Wiley Series in Probability and Statistics. Wiley, Chichester (2003)

    Book  Google Scholar 

  75. Sharpe, M.J.: Transformations of diffusion by time reversal. Ann. Probab. 8, 1157–1162 (1980)

    Article  MathSciNet  MATH  Google Scholar 

  76. Sotiropoulos, V., Kaznessis, Y.N.: Analytical derivation of moment equations in stochastic chemical kinetics. Chem. Eng. Sci. 66, 268–277 (2011)

    Article  Google Scholar 

  77. Stepanow, S., Schütz, G.M.: The distribution function os a semiflexible polymer and random walks with constraints. Europhys. Lett. 60, 546–551 (2002)

    Article  ADS  Google Scholar 

  78. Stratonovich, R.L.: Introduction to the Theory of Random Noise. Gordon and Breach, New York (1963)

    MATH  Google Scholar 

  79. Tolman, R.C.: The Principle of Statistical Mechanics. Oxford University Press, Oxford (1938)

    MATH  Google Scholar 

  80. Uhlenbeck, G.E., Ornstein, L.S.: On the theory of the Brownian motion. Phys. Rev. 36, 823–841 (1930)

    Article  ADS  MATH  Google Scholar 

  81. Ullah, M., Wolkenhauer, O.: Family tree of Markov models in systems biology. IET Syst. Biol. 1, 247–254 (2007)

    Article  Google Scholar 

  82. Ullah, M., Wolkenhauer, O.: Stochastic Approaches for Systems Biology. Springer, New York (2011)

    Book  MATH  Google Scholar 

  83. van den Berg, T.: Calibrating the Ornstein-Uhlenbeck-Vasicek model. Sitmo – Custom Financial Research and Development Services, www.sitmo.com/article/calibrating-the-ornstein-uhlenbeck-model/ (2011). Retrieved April 20, 2014

  84. van Kampen, N.G.: The expansion of the master equation. Adv. Chem. Phys. 34, 245–309 (1976)

    Google Scholar 

  85. van Kampen, N.G.: Remarks on non-markov processes. Braz. J. Phys. 28, 90–96 (1998)

    ADS  Google Scholar 

  86. van Kampen, N.G.: Stochastic Processes in Physics and Chemistry, 3rd edn. Elsevier, Amsterdam (2007)

    MATH  Google Scholar 

  87. Vasicek, O.: An equlibrium characterization of the term structure. J. Financ. Econ. 5, 177–188 (1977)

    Article  Google Scholar 

  88. Viswanathan, G.M., Raposo, E.P., da Luz, M.G.E.: Lévy flights and superdiffusion in the context of biological encounters and random searches. Phys. Life Rev. 5, 133–150 (2008)

    Article  ADS  Google Scholar 

  89. von Neumann, J.: Proof of the quasi-ergodic hypothesis. Proc. Natl. Acad. Sci. USA 4, 70–82 (1932)

    Article  ADS  MATH  Google Scholar 

  90. von Smoluchowski, M.: Zur kinetischen Theorie der Brownschen Molekularbewegung und der Suspensionen. Ann. Phys. (Leipzig) 21, 756–780 (1906)

    Google Scholar 

  91. Wegscheider, R.: Über simultane Gleichgewichte und die Beziehungen zwischen Thermodynamik und Reaktionskinetik homogener Systeme. Mh. Chem. 32, 849–906 (1911). In German

    MATH  Google Scholar 

  92. Wei, W.W.S.: Time Series Analysis. Univariate and Multivariate Methods. Addison-Wesley Publishing, Redwood City (1990)

    Google Scholar 

  93. Weisstein, E.W.: Cross-Correlation. MathWorld - A Wolfram Web Resource. The Wolfram Centre, Long Hanborough, UK. http://www.Mathworld.wolfram.com/Cross-Correlation.html, retrieved July 17, 2015

  94. Weisstein, E.W.: Fourier Transform. MathWorld - A Wolfram Web Resource. The Wolfram Centre, Long Hanborough, UK. http://www.Mathworld.wolfram.com/FourierTransform.html, retrieved July 17, 2015

  95. Williams, D.: Diffusions, Markov Processes and Martingales. Volume 1: Foundations. Wiley, Chichester (1979)

    Google Scholar 

  96. Wold, H.: A Study in the Analysis of Time Series, second revised edn. Almqvist and Wiksell Book Co., Uppsala, SE (1954). With an appendix on Recent Developments in Time Series Analysis by Peter Whittle

    Google Scholar 

  97. Wright, S.: The roles of mutation, inbreeding, crossbreeding and selection in evolution. In: Jones, D.F. (ed.) Int. Proceedings of the Sixth International Congress on Genetics, vol. 1, pp. 356–366. Brooklyn Botanic Garden, Ithaca (1932)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Schuster, P. (2016). Stochastic Processes. In: Stochasticity in Processes. Springer Series in Synergetics. Springer, Cham. https://doi.org/10.1007/978-3-319-39502-9_3

Download citation

Publish with us

Policies and ethics