Acta Mathematicae Applicatae Sinica, English Series

, Volume 19, Issue 3, pp 363–370 | Cite as

Uniform Convergence Rate of Estimators of Autocovariances in Partly Linear Regression Models with Correlated Errors

  • Jin-hong You
  • Gemai Chen
  • Min Chen
  • Xue-lei Jiang
Original papers


Consider the partly linear regression model \( y_{i} = {x}'_{i} \beta + g{\left( {t_{i} } \right)} + \varepsilon _{i} ,\;\;{\kern 1pt} 1 \leqslant i \leqslant n \), where y i ’s are responses, \( x_{i} = {\left( {x_{{i1}} ,x_{{i2}} , \cdots ,x_{{ip}} } \right)}^{\prime } \;\;\;{\text{and}}\;\;\;t_{i} \in {\cal T} \)are known and nonrandom design points, \( {\cal T} \) is a compact set in the real line \( {\cal R} \), β = (β1, ··· , β p )' is an unknown parameter vector, g(·) is an unknown function and {ε i } is a linear process, i.e.,\( \varepsilon _{i} {\kern 1pt} = {\kern 1pt} {\sum\limits_{j = 0}^\infty {\psi _{j} e_{{i - j}} ,{\kern 1pt} \;\psi _{0} {\kern 1pt} = {\kern 1pt} 1,\;{\kern 1pt} {\sum\limits_{j = 0}^\infty {{\left| {\psi _{j} } \right|} < \infty } }} } \) , where e j are i.i.d. random variables with zero mean and variance \( \sigma ^{2}_{e} \). Drawing upon B-spline estimation of g(·) and least squares estimation of β, we construct estimators of the autocovariances of {ε i }. The uniform strong convergence rate of these estimators to their true values is then established. These results not only are a compensation for those of [23], but also have some application in modeling error structure. When the errors {ε i } are an ARMA process, our result can be used to develop a consistent procedure for determining the order of the ARMA process and identifying the non-zero coeffcients of the process. Moreover, our result can be used to construct the asymptotically effcient estimators for parameters in the ARMA error process.


Uniform strong convergence rate autocovariance and autocorrelation B-spline estimation correlated error partly linear regression model 

2000 MR Subject Classification

62J05 62E20 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    An, H.Z., Chen, Z,G., Hannan, J.E. Autocorrelation, autoregression and autoregressive approximation. Ann. Statist., 10:926–936 (1982)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Bennett, G. Probability inequality for sums of independent random variables. J. Amer. Statist. Assoc., 57:33–45 (1962)CrossRefGoogle Scholar
  3. 3.
    Bhattacharya, P.B., Zhao, P. Semiparametric inference in partly linear model. Ann. Statist., 25:244–262 (1997)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Brockwell, P.J., Davis, R.A. Times Series: theory and methods. Springer–Verlag, New York, 1987Google Scholar
  5. 5.
    Chen, H. Convergence rates for parametric components in a partly linear model. Ann. Statist., 16:136–146 (1988)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Chen, H., Shiau, J. A two–stage spline smoothing method for partially linear models. J. Statist. Plann. Infer., 27:187–202 (1991)CrossRefGoogle Scholar
  7. 7.
    Chen, H., Shiau, J. Data–driven efficient estimation for a partially linear model. Ann. Statist., 22:211–237 (1994)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Chen, Z.G. The asymptotic efficiency of a linear procedure of estimation for ARMA models. J. Time Ser. Anal., 6:53–62 (1986)Google Scholar
  9. 9.
    Chen, Z.G., Ni, J.Y. Subset regression time series and its modeling procedures. J. Multivariate Anal., 32:55–69 (1989)CrossRefGoogle Scholar
  10. 10.
    Cuzick, J. Efficient estimates in semiparametric additive regression models with unknown error distribution. Ann. Statist., 20:1129–1136 (1992b)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Cuzick, J. Semiparametric additive regression. J. Roy. Statist. Soc. (Ser. B), 54:831–843 (1992a)MathSciNetGoogle Scholar
  12. 12.
    de Boor, C. A practical guide to splines. Springer–Verlag, New York, 1978Google Scholar
  13. 13.
    Donald, G., Newey, K. Series estimation of semilinear models. J. Multivariate Anal., 50:30–40 (1994)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Engle, R.F., Granger, W.J., Rice, J., Weiss, A. Semiparametric estimates of the relation between weather and electricity sales. J. Amer. Statist. Assoc., 80:310–319 (1986)CrossRefGoogle Scholar
  15. 15.
    Eubank, R.L., Hart, J.D., Speckman, P. Trigonometric series regression estimators with an application to partially linear models. J. Multivariate Anal., 32:70–83 (1990)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Gao, J.T. Adaptive parametric test in a semiparametric regression model. Comm. Statist. Theory and Methods, A26:787–800 (1997)CrossRefGoogle Scholar
  17. 17.
    Gao, J.T. Asymptotic theory for partly linear models. Comm. Statist. Theory and Methods, A24:1985–2009 (1995a)CrossRefGoogle Scholar
  18. 18.
    Gao, J.T. The laws of the iterated logarithm of some estimates in partly linear models. Statist. Probab. Letters, 25:153–162 (1995b)CrossRefGoogle Scholar
  19. 19.
    Hamilton, A., Truong, K. Local linear estimation in partly linear models. J. Multivariate Anal., 60:1–19 (1997)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Hannan, E.J., Rissanen, J. Recursive estimation of mixed autoregressive–moving average order. Biometrika, 69:81–94 (1982)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Heckman, N.E. Spline smoothing in a partly linear model. J. Roy. Statist. Soc. (Ser. B), 48:244–248 (1986)Google Scholar
  22. 22.
    Liang, H., Härdle, W. Large sample theory of the estimation of the error distrbution for a semiparametric model. Comm. Statist. Theory and Methods, A28:2025–2036 (1999)CrossRefGoogle Scholar
  23. 23.
    Lin, T.C., Pourahmadi, M., Schick, A. Regression models with time series errors. J. Time Ser. Anal., 20:425–433 (1999)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Rice, J. Convergence rates for partially splined models. Statist. Probab. Letters, 4:203–208 (1986)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Robinson, P. Root–N–consistent semiparametric regression. Econometrica, 56:931–954 (1988)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Schick, A. An adaptive estimator of the autocorrelation coefficient in regression models with autoregressive errors. J. Time Ser. Anal., 19:575–589 (1998)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Schick, A. Efficient estimation in a semiparametric additive regression model with autoregressive errors. Stochastic Processes Appl., 61:339–361 (1996a)CrossRefGoogle Scholar
  28. 28.
    Schick, A. Efficient estimation in a semiparametric additive regression model with ARMA errors. In: Asymptotics, Nonparametrics, and Time Series, S. Ghosh ed., 395–425, 1999Google Scholar
  29. 29.
    Schick, A. Estimation of the autocorrelation coefficient in the presence of a regression trend. Statist. Probab. Letters, 21:371–380 (1994)MathSciNetCrossRefGoogle Scholar
  30. 30.
    Schick, A. On efficient estimation in regression models. Ann. Statist., 21:1486–1521, (1993)MathSciNetCrossRefGoogle Scholar
  31. 31.
    Schick, A. Root–n consistent estimation in partly linear regression models. Statist. Probab. Letters, 28:353–358 (1996c)CrossRefGoogle Scholar
  32. 32.
    Schick, A. Root–n consistent and efficient estimation in semiparametric additive regression models. Statist. Probab. Letters, 30:45–51 (1996d)CrossRefGoogle Scholar
  33. 33.
    Schick, A. Weighted least squares estimates in partly linear regression model. Statist. Probab. Letters, 27:281–187 (1996b)CrossRefGoogle Scholar
  34. 34.
    Shi, P., Li, G. A note of the convergence rates of M–estimates for partly linear model. Statistics, 26:27–47 (1995)MathSciNetCrossRefGoogle Scholar
  35. 35.
    Speckman, P. Kernel smoothing in partial linear models. J. Roy. Statist. Soc. (Ser. B), 50:413–436 (1988)MathSciNetGoogle Scholar
  36. 36.
    Truong, K. Nonparametric curve estimation with time series errors. J. Statist. Plann. Infer., 28:167–183 (1991)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Jin-hong You
    • 1
  • Gemai Chen
    • 2
  • Min Chen
    • 3
  • Xue-lei Jiang
    • 3
  1. 1.University of ReginaReginaCanada
  2. 2.University of CalgaryCalgaryCanada
  3. 3.Academy of Mathematics and System SciencesChinese Academy of SciencesBeijingChina

Personalised recommendations