Penalized profile least squares-based statistical inference for varying coefficient partially linear errors-in-variables models

Articles
  • 5 Downloads

Abstract

The purpose of this paper is two fold. First, we investigate estimation for varying coefficient partially linear models in which covariates in the nonparametric part are measured with errors. As there would be some spurious covariates in the linear part, a penalized profile least squares estimation is suggested with the assistance from smoothly clipped absolute deviation penalty. However, the estimator is often biased due to the existence of measurement errors, a bias correction is proposed such that the estimation consistency with the oracle property is proved. Second, based on the estimator, a test statistic is constructed to check a linear hypothesis of the parameters and its asymptotic properties are studied. We prove that the existence of measurement errors causes intractability of the limiting null distribution that requires a Monte Carlo approximation and the absence of the errors can lead to a chi-square limit. Furthermore, confidence regions of the parameter of interest can also be constructed. Simulation studies and a real data example are conducted to examine the performance of our estimators and test statistic.

Keywords

diverging number of parameters varying coefficient partially linear model penalized likelihood SCAD variable selection 

MSC(2010)

62G08 62G20 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Notes

Acknowledgments

This work was supported by National Natural Science Foundation of China (Grant Nos. 11401006, 11671299 and 11671042), a grant from the University Grants Council of Hong Kong, the China Postdoctoral Science Foundation (Grant No. 2017M611083), and the National Statistical Science Research Program of China (Grant No. 2015LY55). The authors thank two referees for their insightful comments.

References

  1. 1.
    Candès E, Tao T. The Dantzig selector: Statistical estimation when p is much larger than n. Ann Statist, 2007, 35: 2313–2351MathSciNetCrossRefMATHGoogle Scholar
  2. 2.
    Fan G L, Liang H Y, Shen Y. Penalized empirical likelihood for high-dimensional partially linear varying coefficient model with measurement errors. J Multivariate Anal, 2016, 147: 183–201MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Fan G L, Xu H X, Huang Z S. Empirical likelihood for semivarying coefficient model with measurement error in the nonparametric part. AStA Adv Stat Anal, 2016, 100: 21–41MathSciNetCrossRefGoogle Scholar
  4. 4.
    Fan J, Huang T. Profile likelihood inferences on semiparametric varying-coefficient partially linear models. Bernoulli, 2005, 11: 1031–1057MathSciNetCrossRefMATHGoogle Scholar
  5. 5.
    Fan J, Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. J Amer Statist Assoc, 2001, 96: 1348–1360MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Fan J, Peng H. Nonconcave penalized likelihood with a diverging number of parameters. Ann Statist, 2004, 32: 928–961MathSciNetCrossRefMATHGoogle Scholar
  7. 7.
    Feng S, Xue L. Bias-corrected statistical inference for partially linear varying coefficient errors-in-variables models with restricted condition. Ann Inst Statist Math, 2014, 66: 121–140MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    Härdle W, Liang H, Gao J. Partially Linear Models. Heidelberg: Physica-Verlag, 2000CrossRefMATHGoogle Scholar
  9. 9.
    Huang J, Horowitz J, Ma S. Asymptotic properties of bridge estimators in sparse high-dimensional regression models. Ann Statist, 2008, 36: 587–613MathSciNetCrossRefMATHGoogle Scholar
  10. 10.
    Kai B, Li R, Zou H. New effcient estimation and variable selection methods for semiparametric varying-coefficient partially linear models. Ann Statist, 2011, 39: 305–332MathSciNetCrossRefMATHGoogle Scholar
  11. 11.
    Li G, Lin L, Zhu L. Empirical likelihood for a varying coefficient partially linear model with diverging number of parameters. J Multivariate Anal, 2012, 105: 85–111MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Li R, Liang H. Variable selection in semiparametric regression modeling. Ann Statist, 2008, 36: 261–286MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Liang H, Härdle W, Carroll R J. Estimation in a semiparametric partially linear errors-in-variables model. Ann Statist, 1999, 27: 1519–1535MathSciNetCrossRefMATHGoogle Scholar
  14. 14.
    Long W, Ouyang M, Shang Y. Effcient estimation of partially linear varying coefficient models. Econom Lett, 2013, 121: 79–81MathSciNetCrossRefMATHGoogle Scholar
  15. 15.
    Matsui H, Misumi T. Variable selection for varying-coefficient models with the sparse regularization. Comput Statist, 2015, 30: 43–55MathSciNetCrossRefMATHGoogle Scholar
  16. 16.
    van der Vaart A W. Asymptotic Statistics. New York: Cambridge University Press, 1998CrossRefMATHGoogle Scholar
  17. 17.
    Wang G, Wang L. Spline estimation and variable selection for single-index prediction models with diverging number of index parameters. J Statist Plann Inference, 2015, 162: 1–19MathSciNetCrossRefMATHGoogle Scholar
  18. 18.
    Wang H, Li R, Tsai C L. Tuning parameter selectors for the smoothly clipped absolute deviation method. Biometrika, 2007, 94: 553–568MathSciNetCrossRefMATHGoogle Scholar
  19. 19.
    Wang L, Lai P, Lian H. Polynomial spline estimation for generalized varying coefficient partially linear models with a diverging number of components. Metrika, 2013, 76: 1083–1103MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Wang T, Xu P R, Zhu L X. Variable selection and estimation for semi-parametric multiple-index models. Bernoulli, 2015, 21: 242–275MathSciNetCrossRefMATHGoogle Scholar
  21. 21.
    Wu Y, Li L. Asymptotic properties of suffcient dimension reduction with a diverging number of predictors. Statist Sinica, 2011, 2011: 707–730CrossRefMATHGoogle Scholar
  22. 22.
    Yang H, Guo C, Lv J. SCAD penalized rank regression with a diverging number of parameters. J Multivariate Anal, 2015, 133: 321–333MathSciNetCrossRefMATHGoogle Scholar
  23. 23.
    Yeh I C. Modeling of strength of high performance concrete using artificial neural networks. Cement Concrete Res, 1998, 28: 1797–1808CrossRefGoogle Scholar
  24. 24.
    You J, Zhou Y. Empirical likelihood for semiparametric varying-coefficient partially linear regression models. Statist Probab Lett, 2006, 76: 412–422MathSciNetCrossRefMATHGoogle Scholar
  25. 25.
    Zhang W, Lee S Y, Song X. Local polynomial fitting in semivarying coefficient model. J Multivariate Anal, 2002, 82: 166–188MathSciNetCrossRefMATHGoogle Scholar
  26. 26.
    Zhu L, Ng K. Checking the adequacy of a partial linear model. Statist Sinica, 2003, 13: 763–781MathSciNetMATHGoogle Scholar
  27. 27.
    Zhu L, Zhu L. On distribution-weighted partial least squares with diverging number of highly correlated predictors. J R Stat Soc Ser B Stat Methodol, 2009, 71: 525–548MathSciNetCrossRefMATHGoogle Scholar
  28. 28.
    Zhu L, Zhu L. Stable direction recovery in single-index models with a diverging number of predictors. Sci China Math, 2010, 53: 1817–1826MathSciNetCrossRefMATHGoogle Scholar
  29. 29.
    Zou H, Li R. One-step sparse estimates in nonconcave penalized likelihood models (with discussion). Ann Statist, 2008, 36: 1509–1566MathSciNetCrossRefMATHGoogle Scholar
  30. 30.
    Zou H, Zhang H. On the adaptive elastic-net with a diverging number of parameters. Ann Statist, 2009, 37: 1733–1751MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Science China Press and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Institute of Statistics and Big DataRenmin University of ChinaBeijingChina
  2. 2.School of Mathematics and PhysicsAnhui Polytechnic UniversityWuhuChina
  3. 3.School of Mathematical ScienceTongji UniversityShanghaiChina
  4. 4.Department of MathematicsHong Kong Baptist UniversityHong KongChina
  5. 5.School of StatisticsBeijing Normal UniversityBeijingChina

Personalised recommendations