Skip to main content
SpringerLink
Log in

Exact finite-sample bias and MSE reduction in a simple linear regression model with measurement error

  • Original Paper
  • Published:
Japanese Journal of Statistics and Data Science Aims and scope Submit manuscript

Abstract

This paper deals with the problem of estimating a slope parameter in a simple linear regression model, where independent variables have functional measurement errors. Measurement errors in independent variables, as is well known, cause biasedness of the ordinary least squares estimator. A general procedure for the bias reduction is presented in a finite sample situation, and some exact bias-reduced estimators are proposed. Also, it is shown that certain truncation procedures improve the mean square errors of the ordinary least squares and the bias-reduced estimators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Adcock, R. J. (1877). Note on the method of least squares. Analyst, 4, 183–184.

    Article  Google Scholar 

  • Adcock, R. J. (1878). A problem in least squares. Analyst, 5, 53–54.

    Article  Google Scholar 

  • Anderson, T. W. (1976). Estimation of linear functional relationships: Approximate distributions and connections with simultaneous equations in econometrics. Journal of the Royal Statistical Society Series B, 38, 1–36.

    MathSciNet  MATH  Google Scholar 

  • Anderson, T. W. (1984). Estimating linear statistical relationships. The Annals of Statistics, 12, 1–45.

    Article  MathSciNet  Google Scholar 

  • Aoki, M. (1989). Optimization of stochastic systems (2nd ed.). New York: Academic Press.

    MATH  Google Scholar 

  • Berger, J. O., Berliner, L. M., & Zaman, A. (1982). General admissibility and inadmissibility results for estimation in a control problem. The Annals of Statistics, 10, 838–856.

    Article  MathSciNet  Google Scholar 

  • Bickel, P. J., & Ritov, Y. (1987). Efficient estimation in the errors in variables model. The Annals of Statistics, 15, 513–540.

    Article  MathSciNet  Google Scholar 

  • Brown, P. J. (1993). Measurement, regression, and calibration. Oxford: Oxford University Press.

    MATH  Google Scholar 

  • Cheng, C.-L., & Van Ness, J. W. (1999). Statistical regression with measurement error. New York: Oxford University Press.

    MATH  Google Scholar 

  • DeGracie, J. S., & Fuller, W. A. (1972). Estimation of the slope and analysis of covariance when the concomitant variable is measured with error. Journal of the American Statistical Association, 67, 930–937.

    Article  MathSciNet  Google Scholar 

  • Fuller, W. A. (1987). Measurement error models. New York: Wiley.

    Book  Google Scholar 

  • Gleser, L. J. (1981). Estimation in a multivariate “errors in variables” regression model: Large sample results. The Annals of Statistics, 9, 24–44.

    Article  MathSciNet  Google Scholar 

  • Guo, M., & Ghosh, M. (2012). Mean squared error of James-Stein estimators for measurement error models. Statistics & Probability Letters, 82, 2033–2043.

    Article  MathSciNet  Google Scholar 

  • Huber, P. J. (1981). Robust Statistics. New York: Wiley.

    Book  Google Scholar 

  • Hudson, H. M. (1978). A natural identity for exponential families with applications in multiparameter estimation. The Annals of Statistics, 6, 473–484.

    Article  MathSciNet  Google Scholar 

  • James, W., & Stein, C. (1961). Estimation with quadratic loss. In: Proc. Fourth Berkeley Symp. Math. Statist. Probab., 1, (pp. 361–379). Berkeley: Univ. California Press.

  • Kendall, M. G., & Stuart, A. (1979). The advanced theory of statistics, (4th ed., Vol. 2). London: Griffin.

  • Kubokawa, T. (1994). A unified approach to improving equivariant estimators. The Annals of Statistics, 22, 290–299.

    Article  MathSciNet  Google Scholar 

  • Kubokawa, T., & Robert, C. P. (1994). New perspectives on linear calibration. Journal of Multivariate Analysis, 51, 178–200.

    Article  MathSciNet  Google Scholar 

  • Nishii, R., & Krishnaiah, P. R. (1988). On the moments of classical estimates of explanatory variables under a multivariate calibration model. Sankhyā Series A, 50, 137–148.

    MathSciNet  MATH  Google Scholar 

  • Osborne, C. (1991). Statistical calibration: A review. International Statistical Review, 59, 309–336.

    Article  Google Scholar 

  • Reiersøl, W. (1950). Identifiability of linear relationship between variables are subject to error. Econometrica, 23, 375–389.

    Article  MathSciNet  Google Scholar 

  • Stefanski, L. A. (1985). The effects of measurement error on parameter estimation. Biometrika, 72, 583–592.

    Article  MathSciNet  Google Scholar 

  • Sundberg, R. (1999). Multivariate calibration—Direct and indirect regression methodology (with discussion). Scandinavian Journal of Statistics, 26, 161–207.

    Article  MathSciNet  Google Scholar 

  • Tsukuma, H. (2018). Estimation in a simple linear regression model with measurement error. arXiv:1804.03029.

  • Whittemore, A. S. (1989). Errors-in-variables regression using Stein estimates. Journal of the American Statistical Association, 43, 226–228.

    Google Scholar 

  • Zaman, A. (1981). A complete class theorem for the control problem and further results on admissibility and inadmissibility. The Annals of Statistics, 9, 812–821.

    Article  MathSciNet  Google Scholar 

  • Zellner, A. (1971). An introduction to Bayesian inference in econometrics. New York: Wiley.

    MATH  Google Scholar 

Download references

Acknowledgements

The author would like to thank the two reviewers for their careful review and for helpful comments and suggestions. This work was supported by Grant-in-Aid for Scientific Research (18K11201) from Japan Society for the Promotion of Science.

Author information

Authors and Affiliations

  1. Faculty of Medicine, Toho University, 5-21-16 Omori-nishi, Ota-ku, Tokyo, 143-8540, Japan

    Hisayuki Tsukuma

Authors
  1. Hisayuki Tsukuma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hisayuki Tsukuma.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tsukuma, H. Exact finite-sample bias and MSE reduction in a simple linear regression model with measurement error. Jpn J Stat Data Sci 2, 1–29 (2019). https://doi.org/10.1007/s42081-018-0025-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42081-018-0025-3

Keywords

Mathematics Subject Classifications

Search

Navigation