Skip to main content
Log in

Consistent estimation in a linear regression problem with random errors in coefficients

  • Published:
Siberian Mathematical Journal Aims and scope Submit manuscript

Abstract

We consider the linear regression model in the case when the independent variables are measured with errors, while the variances of the main observations depend on an unknown parameter. In the case of normally distributed replicated regressors we propose and study new classes of two-step estimates for the main unknown parameter. We find consistency and asymptotic normality conditions for first-step estimates and an asymptotic normality condition for second-step estimates. We discuss conditions under which these estimates have the minimal asymptotic variance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Draper N. R. and Smith H., Applied Regression Analysis. Parts 1 and 2, John Wiley and Sons, New York etc. (1981).

    Google Scholar 

  2. Seber G., Linear Regression Analysis, John Wiley and Sons, New York etc. (1977).

    MATH  Google Scholar 

  3. Fedorov V. V., Theory of Optimal Experiments, Academic Press, New York (1972).

    Google Scholar 

  4. Linke Yu. Yu. and Sakhanenko A. I., “Asymptotically optimal estimation in the linear regression problem in the case of violation of some classical assumptions,” Siberian Math. J., 50, No. 2, 302–315 (2009).

    Article  MathSciNet  Google Scholar 

  5. Linke Yu. Yu. and Sakhanenko A. I., “Asymptotically optimal estimation in a linear regression problem with random errors in coefficients,” Siberian Math. J., 51, No. 1, 104–118 (2010).

    Article  MathSciNet  MATH  Google Scholar 

  6. Sakhanenko A. I. and Linke Yu. Yu., “Improvement of estimators in a linear regression problem with random errors in coefficients,” Siberian Math. J., 52, No. 1, 113–126 (2011).

    MATH  Google Scholar 

  7. Linke Yu. Yu. and Sakhanenko A. I., “Asymptotically normal estimation in the linear-fractional regression problem with random errors in coefficients,” Siberian Math. J., 49, No. 3, 474–497 (2008).

    Article  MathSciNet  Google Scholar 

  8. Sakhanenko A. I. and Linke Yu. Yu., “Asymptotically optimal estimation in a linear-fractional regression problem with random errors in coefficients,” Siberian Math. J., 47, No. 6, 1128–1153 (2006).

    Article  MathSciNet  Google Scholar 

  9. Linke Yu. Yu., “On the asymptotics of distributions of two-step statistical estimates,” Siberian Math. J., 52, No. 4, 665–681 (2011).

    MathSciNet  Google Scholar 

  10. Vuchkov I., Boyadzhieva L., and Solakov E., Applied Linear Regression Analysis [Russian translation], Financy i Statistika, Moscow (1987).

    Google Scholar 

  11. Kukush A. G. and Martsinyuk Y. V., “Consistency and inconsistency of the weighted least squares estimator in linear functional error-in-variables models,” Theory Stoch. Process., 4, No. 1–2, 172–179 (1998).

    MathSciNet  Google Scholar 

  12. Edland S. D., “Bias in slope estimates for the linear errors in variables model by the variance ratio method,” Biometrics, 52, No. 1, 243–248 (1996).

    Article  MATH  Google Scholar 

  13. Fuller W. A., Measurement Error Models, Wiley-Interscience, New York (2006) (Wiley Ser. Probab. Stat.).

    MATH  Google Scholar 

  14. Dellaportas P. and Stephens D. A., “Bayesian analysis of error-in-variables regression models,” Biometrics, 51, No. 3, 1085–1095 (1995).

    Article  MATH  Google Scholar 

  15. Gleser L. J., Carroll R. J., and Gallo P. P., “The limiting distribution of least squares in an errors-in-variables regression model,” Ann. Statist., 15, No. 1, 220–233 (1987).

    Article  MathSciNet  MATH  Google Scholar 

  16. Draper N. R., “Applied regression analysis bibliography update 1994–1997,” Comm. Statist. Theory Methods, 27, No. 10, 2581–2623 (1998).

    Article  MathSciNet  MATH  Google Scholar 

  17. Draper N. R., “Applied regression analysis bibliography update 1998–1999,” Comm. Statist. Theory Methods, 29, No. 9–10, 2313–2341 (2000).

    MathSciNet  MATH  Google Scholar 

  18. Draper N. R., “Applied regression analysis bibliography update 2000–2001,” Comm. Statist. Theory Methods, 31, No. 11, 2051–2075 (2002).

    Article  MathSciNet  MATH  Google Scholar 

  19. Borovkov A. A., Mathematical Statistics [in Russian], Nauka and Sobolev Institute Press, Moscow (1997).

    Google Scholar 

  20. Borovkov A. A., Probability Theory, Gordon and Breach, Abingdon (1998).

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. I. Sakhanenko.

Additional information

Original Russian Text Copyright © 2011 Sakhanenko A. I. and Linke Yu. Yu.

The authors were supported by the Russian Foundation for Basic Research (Grant 11-01-00285).

__________

Translated from Sibirskiĭ Matematicheskiĭ Zhurnal, Vol. 52, No. 4, pp. 894–912, July–August, 2011.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sakhanenko, A.I., Linke, Y.Y. Consistent estimation in a linear regression problem with random errors in coefficients. Sib Math J 52, 711–726 (2011). https://doi.org/10.1134/S0037446611040148

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0037446611040148

Keywords

Navigation