Skip to main content
Log in

Estimation of a subset of regression coefficients of interest in a model with non-spherical disturbances

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

This paper considers the estimation of a subset of regression coefficients in a linear regression model with non-spherical disturbances, when other regression coefficients are of no interest. A family of estimators is considered and its asymptotic distribution is derived. This proposed family of improved estimators is compared with the usual unrestricted FGLS estimator, and dominance conditions are obtained with respect to risk under quadratic loss as well as the Pitman nearness criterion. The results of a numerical simulation are presented to illustrate the risk performance of various estimators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Stein C, Inadmissibility of the usual estimator of the mean of a multivariate normal distribution, Proceedings of the Third Berkeley Symposium 1, University of California Press, Berkeley, 1956: 197–206.

    Google Scholar 

  2. James W and Stein C, Estimation with quadratic loss, Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, Berkeley, 1961, 361.

    Google Scholar 

  3. Baranchik A J, Inadmissibility of maximum likelihood estimators in some multiple regression problems with three or more independent variables, Annals of Statistics, 1973, 1: 312–321.

    Article  MathSciNet  MATH  Google Scholar 

  4. Judge G G and Bock M E, The Statistical Implications of Pre-Test and Stein-Rule Estimators in Econometrics, John Wiley and Sons, New York, 1978.

    MATH  Google Scholar 

  5. Judge G G and Bock M E, Biased Estimation, Handbook of Econometrics (Grillches Z and Intrilligator M D, eds.), North-Holland, Amsterdam, 1983: 599–649.

  6. Hoffman K, Stein-estimation — A review, Statistical Papers, 2000, 41: 127–158.

    Article  MathSciNet  Google Scholar 

  7. Wan A T K, The non-optimality of interval restricted and pretest estimators under squared error loss, Communications in Statistics — Theory and Methods, 1994, 23: 2231–2252.

    Article  MathSciNet  MATH  Google Scholar 

  8. Ohtani K and Wan A T K, On the sampling performance of an improved Stein inequality restricted estimator, Australian and New Zealand Journal of Statistics, 1998, 40: 181–187.

    Article  MathSciNet  MATH  Google Scholar 

  9. Shalabh and Wan A T K, Stein-rule estimation in mixed regression models, Biometrical Journal, 2000, 42: 203–214.

    Article  MathSciNet  MATH  Google Scholar 

  10. Chaturvedi A, Wan A T K, and Singh S P, Stein-rule restricted regression estimator in a linear regression model with non-spherical disturbances, Communications in Statistics, Theory and Methods, 2000, 30: 55–68.

    Article  MathSciNet  Google Scholar 

  11. Srivastava V K and Wan A T K, Separate versus system methods of Stein-rule estimation in S.U.R. models, Communications in Statistics — Theory and Methods, 2002, 31: 2077–2099.

    Article  MathSciNet  MATH  Google Scholar 

  12. Zhang X Y, Chen T, Wan A T K, and Zou G H, The robustness of Stein-type estimators under a non-scalar covariance structure, Journal of Multivariate Analysis, 2009, 100: 2376–2388.

    Article  MathSciNet  MATH  Google Scholar 

  13. Zou G H, Zeng J, Wan A T K, and Guan Z, Stein-type improved estimation of standard error under asymmetric LINEX loss function, Statistics, 2009, 43: 121–129.

    Article  MathSciNet  Google Scholar 

  14. Wan A T K, Chaturvedi A, and Zou G H, Unbiased estimation of the MSE matrices of improved estimators in linear regression, Journal of Applied Statistics, 2003, 30: 191–207.

    Article  MathSciNet  Google Scholar 

  15. Bao H X H and Wan A T K, Improved estimators of hedonic housing price models, Journal of Real Estate Research, 2007, 29: 267–302.

    Google Scholar 

  16. Ohtani K, Exact small sample properties of an operational variant of the minimum mean squared error estimator, Communications in Statistics — Theory and Methods, 1996(a), 25: 1223–1231.

    Article  MathSciNet  MATH  Google Scholar 

  17. Ohtani K, On an adjustment of degrees of freedom in the minimum mean squared error estimator, Communications in Statistics — Theory and Methods, 1996(b), 25: 3049–3058.

    Article  MathSciNet  MATH  Google Scholar 

  18. Ohtani K, Minimum mean squared error estimation of each individual coefficient in a linear regression model, Journal Statistical Planning and Inference, 1997, 62: 301–316.

    Article  MathSciNet  MATH  Google Scholar 

  19. Ohtani K, MSE performance of a heterogeneous pre-test estimator, Statistics and Probability Letters, 1999, 41: 65–71.

    Article  MathSciNet  MATH  Google Scholar 

  20. Wan A T K and Kurumai H, An iterative feasible minimum mean squared error estimator of the disturbance variance in linear regression under asymmetric loss, Statistics and Probability Letters, 1999, 45: 253–259.

    Article  MathSciNet  MATH  Google Scholar 

  21. Wan A T K and Ohtani K, Minimum mean squared error estimation in linear regression with an inequality constraint, Journal of Statistical Planning and Inference, 2000, 86: 157–173.

    Article  MathSciNet  MATH  Google Scholar 

  22. Theil H, Principles of Econometrics, North-Holland, Amsterdam, 1971.

    MATH  Google Scholar 

  23. Chaturvedi A and Shukla G, Stein-rule estimation in linear models with non-scalar error covariance matrix, Sankhyā, Series B, 1990, 52: 293–304.

    MathSciNet  MATH  Google Scholar 

  24. Wan A T K and Chaturvedi A, Operational variants of the minimum mean squared error estimator in linear regression models with non-spherical disturbances, Annals of the Institute of Statistical Mathematics, 2000, 52: 332–342.

    Article  MathSciNet  MATH  Google Scholar 

  25. Wan A T K and Chaturvedi A, Double k-Class estimators in regression models with non-spherical disturbances, Journal of Multivariate Analysis, 2001, 79: 226–250.

    Article  MathSciNet  MATH  Google Scholar 

  26. Ullah A and Ullah S, Double k-class estimators of coefficients in linear regression, Econometrica, 1978, 46: 705–722.

    Article  MathSciNet  MATH  Google Scholar 

  27. Peddada S D, A short note on Pitman measure of nearness, American Statistician, 1985, 39: 298–299.

    MathSciNet  Google Scholar 

  28. Rao C R, Keating J P, and Mason R L, The Pitman nearness criterion and its determination, Communications in Statistics — Theory and Methods, 1986, 15: 3173–3191.

    Article  MathSciNet  MATH  Google Scholar 

  29. Sen P K, Kubokawa T, and Saleh A K M E, The Stein paradox in the Pitman closeness, Annals of Statistics, 1989, 17: 1563–1579.

    Article  MathSciNet  Google Scholar 

  30. Peddada S D and Khattre R, On Pitman nearness and variance of estimators, Communications in Statistics — Theory and Methods, 1986, 15: 3005–3017.

    Article  MATH  Google Scholar 

  31. Khattre R and Peddada S D, A short note on Pitman nearness for elliptically symmetric estimators, Journal Statistical Planning and Inference, 1987, 16: 257–260.

    Article  Google Scholar 

  32. Srivastava A K and Srivastava V K, Pitman closeness for Stein-rule estimators of regression coefficients, Statistical Probability Letters, 1993, 18: 85–89.

    Article  Google Scholar 

  33. Chaturvedi A, A note on the Stein rule estimation in linear models with nonscalar error covariance matrix, Sankhyā, Series B, 1995, 57: 158–165.

    MathSciNet  MATH  Google Scholar 

  34. Chaturvedi A and Shalabh, Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function, Journal of Multivariate Statistics, 2004, 90: 229–256.

    Article  MathSciNet  MATH  Google Scholar 

  35. Ohtani K and Wan A T K, Comparison of Stein variance and the usual estimators for the regression error variance under the Pitman nearness criterion when variables are omitted, Statistical Papers, 2009, 50: 151–160.

    Article  MathSciNet  MATH  Google Scholar 

  36. Magnus J R and Durbin J, Estimation of regression coefficients of interest when other regression coefficients are of no interest, Econometrica, 1999, 67: 639–643.

    Article  MathSciNet  MATH  Google Scholar 

  37. Danilov D and Magnus J R, On the harm that ignoring pretesting can cause, Journal of Econometrics, 2004, 122: 27–46.

    Article  MathSciNet  Google Scholar 

  38. Zou G H, Wan A T K, Wu X, and Chen T, Estimation of regression coefficients of interest when other regression coefficients are of no interest: The case of non-normal errors, Statistics and Probability Letters, 2007, 77: 803–810.

    Article  MathSciNet  MATH  Google Scholar 

  39. Magnus J R, Wan A T K, and Zhang X Y, Weighted average least squares estimator with nonspherical disturbances and an application to the Hong Kong housing market, Computational Statistics and Data Analysis, 2011, 55(3): 1331–1341.

    Article  MathSciNet  Google Scholar 

  40. Rothenberg T J, Approximate normality of generalized least squares estimates, Econometrica, 1984, 52: 811–825.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anoop Chaturvedi.

Additional information

The author gratefully acknowledges the financial support from CSIR to carry on the present work.

This paper was recommended for publication by Editor ZOU Guohua.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chaturvedi, A., Kesarwani, S. Estimation of a subset of regression coefficients of interest in a model with non-spherical disturbances. J Syst Sci Complex 26, 209–231 (2013). https://doi.org/10.1007/s11424-012-0051-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-012-0051-3

Key words

Navigation