Statistical Papers

, Volume 60, Issue 1, pp 19–34 | Cite as

Performance of the restricted almost unbiased type principal components estimators in linear regression model

  • Yalian LiEmail author
  • Hu Yang
Regular Article


In this paper, two new classes of estimators called the restricted almost unbiased ridge-type principal components estimator and the restricted almost unbiased Liu-type principal components estimator are introduced. For the two cases when the restrictions are true and not true, necessary and sufficient conditions for the superiority of the proposed estimators are derived and compared, respectively. Finally, A Monte Carlo simulation study is given to illustrate the performance of the proposed estimators.


Multicollinearity Principle components regression Equality Restrictions Almost unbiased ridge estimator Almost unbiased Liu estimator 

Mathematics Subject Classification

62J07 62J05 



We are grateful to the editor and the anonymous reviewers for the constructive comments and suggestions which have improved the quality of this paper. This work was supported in part by the National Natural Science Foundation of China (Grant No. 11671059) and the Fundamental Research Funds for the Central Universities (Grant No. 106112015CDJXY100004).


  1. Akdeniz F, Erol H (2003) Mean squared error matrix comparisons of some biased estimator in linear regression. Commun Stat Theory Methods 32(12):2389–2413MathSciNetCrossRefzbMATHGoogle Scholar
  2. Akdeniz F, Kaçıranlar S (1995) On the almost unbiased generalized Liu estimator and unbiased estimation of the bias and MSE. Commun Stat Theory Methods 24:1789–1797MathSciNetCrossRefzbMATHGoogle Scholar
  3. Baye MR, Parker DF (1984) Combining ridge and principal component regression: a money demand illustration. Commun Stat Theory Methods 13(2):197–205MathSciNetCrossRefGoogle Scholar
  4. Baksalary JK, Trenkler G (1991) Nonnegative and positive definiteness of matrices modified by two matrices of rank one. Linear Algebr Appl 151:169–184MathSciNetCrossRefzbMATHGoogle Scholar
  5. Groß J (2003) Restricted ridge estimation. Stat Probab Lett 65:57–64MathSciNetCrossRefzbMATHGoogle Scholar
  6. Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for non-orthogonal problems. Technometrics 12:55–67CrossRefzbMATHGoogle Scholar
  7. Hubert MH, Wijekoon P (2006) Improvement of the Liu estimator in linear regression model. Statistical Papers 47(3):471–479MathSciNetCrossRefzbMATHGoogle Scholar
  8. Kaçıranlar S, Sakallıoğlu S (2001) Combining the Liu estimator and the principal component regression estimator. Commun Stat Theory Methods 30:2699–2705MathSciNetCrossRefzbMATHGoogle Scholar
  9. Kaçıranlar S, Sakallıoğlu S, Akdeniz F, Styan GPH, Werner HJ (1999) A new biased estimator in linear regression and a detailed analysis of the widely-analysed dataset on Portland Cement. Sankhya Ind J Stat 61:443–459Google Scholar
  10. Liu K (1993) A new class of biased estimate in linear regression. Commun Stat Theory Methods 22:393–402MathSciNetCrossRefzbMATHGoogle Scholar
  11. Massy WF (1965) Principal components regression in exploratory statistical research. J Am Stat Assoc 60:234–266CrossRefGoogle Scholar
  12. Özkale MR, Kaçıranlar S (2007) The restricted and unrestricted two-parameter estimator. Commun Stat Theory Methods 36:2707–2725MathSciNetCrossRefzbMATHGoogle Scholar
  13. Rao CR, Toutenburg H, Shalabh H (2008) C: linear models and generalizations: least squares and alternatives. Springer, NewYorkzbMATHGoogle Scholar
  14. Sarkar N (1992) A new estimator combining the ridge regression and the restricted least squares methods of estimation. Commun Stat Theory Methods 21:1987–2000MathSciNetCrossRefzbMATHGoogle Scholar
  15. Singh B, Chaubey YP, Dwivedi TD (1986) An almost unbiased ridge estimator, Sankhya: Indian. J Stat B 48:342–346zbMATHGoogle Scholar
  16. Xu JW, Yang H (2011a) On the restricted r-k class estimator and the restricted r-d class estimator in linear regression. J Stat Comput Simul 81:679–691MathSciNetCrossRefzbMATHGoogle Scholar
  17. Xu JW, Yang H (2011b) On the restricted almost unbiased estimators in linear regression. J Appl Stat 38(03):605–617MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  1. 1.Department of Statistics and Actuarial ScienceChongqing UniversityChongqingChina

Personalised recommendations