Abstract
A wide range of literature concerning classical asymptotic properties for linear models with adaptive control is available, such as strong laws of large numbers or central limit theorems. Unfortunately, in contrast with the situation without control, it appears to be impossible to find sharp asymptotic or nonasymptotic properties such as large deviation principles or exponential inequalities. Our purpose is to provide a first step towards that direction by proving a very simple exponential inequality for the standard least squares estimator of the unknown parameter of Gaussian autoregressive process in adaptive tracking.
Similar content being viewed by others
References
G. Bennett (1962) ArticleTitleProbability inequalities for the sum of independent random variables J. Amer. Statist. Assoc. 57 33–45 Occurrence Handle10.2307/2282438
W.J. Hoeffding (1963) ArticleTitleProbability inequalities sums of bounded random variables J. Amer. Statist. Assoc. 58 713–721 Occurrence Handle10.2307/2282952
C. McDiarmid, Concentration, in Probabilistic Methods for Algorithmic Discrete Mathematics, Mathematics Series: Algorithms and Combinatorics (Ed. by M. Habib, C. McDiarmid, J. Ramirez-Alfonsin, and B. Reed), Vol. 16, Springer-Verlag, Berlin, 1998, 195–248.
K. Azuma (1967) ArticleTitleWeighted sums of certain dependent random variables Tôkuku Math. J. 19 357–367
D.A. Freedman (1975) ArticleTitleOn tail probabilities for martingales Ann. of Probab. 3 100–118
V.H. Peña ParticleDe la (1999) ArticleTitleA general class of exponential inequalities for martingales and ratios Ann. of Probab 27 537–564 Occurrence Handle10.1214/aop/1022677271
J.S. White (1958) ArticleTitleThe limit distribution of the serial correlation in the explosive case Ann. Math. Statist. 29 1188–1197
B. Bercu F. Gamboa A. Rouault (1997) ArticleTitleLarge deviations for quadratic forms of stationary Gaussian processes Stoch. Proc. and Their Appl. 71 75–90 Occurrence Handle10.1016/S0304-4149(97)00071-9
B. Bercu (2001) ArticleTitleOn large deviations in the Gaussian autoregressive process: stable, unstable and explosive cases Bernoulli 7 299–316 Occurrence Handle10.2307/3318740
B. Bercu (1998) ArticleTitleCentral limit theorem and law of iterated logarithm for the least squares algorithms in adaptive tracking SIAM J. Control and Optimization 36 910–928 Occurrence Handle10.1137/S0363012995294183
B. Bercu B. Portier (2002) ArticleTitleAdaptive control of parametric nonlinear autoregressive models via a new martingale approach IEEE Trans. on Automatic Control 47 1524–1528 Occurrence Handle10.1109/TAC.2002.802756
R. Liptser V. Spokoiny (2000) ArticleTitleDeviation probability bound for martingales with applications to statistical estimation Statist. and Probab. Letters 46 347–357 Occurrence Handle10.1016/S0167-7152(99)00121-2
J. Worms (2001) ArticleTitleLarge and moderate deviations upper bounds for the Gaussian autoregressive process Statist. and Probab. Letters 51 235–243 Occurrence Handle10.1016/S0167-7152(00)00134-6
V.H. Peña ParticleDe la M.J. Klass T.L. Lai (2004) ArticleTitleSelf-normalized processes: exponential inequalities, moments bounds and iterated logarithm law Ann. of Probab. 32 1902–1933 Occurrence Handle10.1214/009117904000000397
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper is dedicated to Professor Han-Fu Chen for his 70th birthday.
Rights and permissions
About this article
Cite this article
Bercu, B. An Exponential Inequality for Autoregressive Processes in Adaptive Tracking. Jrl Syst Sci & Complex 20, 243–250 (2007). https://doi.org/10.1007/s11424-007-9021-6
Received:
Issue Date:
DOI: https://doi.org/10.1007/s11424-007-9021-6