Abstract
This paper considers the estimation of a subset of regression coefficients in a linear regression model with non-spherical disturbances, when other regression coefficients are of no interest. A family of estimators is considered and its asymptotic distribution is derived. This proposed family of improved estimators is compared with the usual unrestricted FGLS estimator, and dominance conditions are obtained with respect to risk under quadratic loss as well as the Pitman nearness criterion. The results of a numerical simulation are presented to illustrate the risk performance of various estimators.
Similar content being viewed by others
References
Stein C, Inadmissibility of the usual estimator of the mean of a multivariate normal distribution, Proceedings of the Third Berkeley Symposium 1, University of California Press, Berkeley, 1956: 197–206.
James W and Stein C, Estimation with quadratic loss, Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, Berkeley, 1961, 361.
Baranchik A J, Inadmissibility of maximum likelihood estimators in some multiple regression problems with three or more independent variables, Annals of Statistics, 1973, 1: 312–321.
Judge G G and Bock M E, The Statistical Implications of Pre-Test and Stein-Rule Estimators in Econometrics, John Wiley and Sons, New York, 1978.
Judge G G and Bock M E, Biased Estimation, Handbook of Econometrics (Grillches Z and Intrilligator M D, eds.), North-Holland, Amsterdam, 1983: 599–649.
Hoffman K, Stein-estimation — A review, Statistical Papers, 2000, 41: 127–158.
Wan A T K, The non-optimality of interval restricted and pretest estimators under squared error loss, Communications in Statistics — Theory and Methods, 1994, 23: 2231–2252.
Ohtani K and Wan A T K, On the sampling performance of an improved Stein inequality restricted estimator, Australian and New Zealand Journal of Statistics, 1998, 40: 181–187.
Shalabh and Wan A T K, Stein-rule estimation in mixed regression models, Biometrical Journal, 2000, 42: 203–214.
Chaturvedi A, Wan A T K, and Singh S P, Stein-rule restricted regression estimator in a linear regression model with non-spherical disturbances, Communications in Statistics, Theory and Methods, 2000, 30: 55–68.
Srivastava V K and Wan A T K, Separate versus system methods of Stein-rule estimation in S.U.R. models, Communications in Statistics — Theory and Methods, 2002, 31: 2077–2099.
Zhang X Y, Chen T, Wan A T K, and Zou G H, The robustness of Stein-type estimators under a non-scalar covariance structure, Journal of Multivariate Analysis, 2009, 100: 2376–2388.
Zou G H, Zeng J, Wan A T K, and Guan Z, Stein-type improved estimation of standard error under asymmetric LINEX loss function, Statistics, 2009, 43: 121–129.
Wan A T K, Chaturvedi A, and Zou G H, Unbiased estimation of the MSE matrices of improved estimators in linear regression, Journal of Applied Statistics, 2003, 30: 191–207.
Bao H X H and Wan A T K, Improved estimators of hedonic housing price models, Journal of Real Estate Research, 2007, 29: 267–302.
Ohtani K, Exact small sample properties of an operational variant of the minimum mean squared error estimator, Communications in Statistics — Theory and Methods, 1996(a), 25: 1223–1231.
Ohtani K, On an adjustment of degrees of freedom in the minimum mean squared error estimator, Communications in Statistics — Theory and Methods, 1996(b), 25: 3049–3058.
Ohtani K, Minimum mean squared error estimation of each individual coefficient in a linear regression model, Journal Statistical Planning and Inference, 1997, 62: 301–316.
Ohtani K, MSE performance of a heterogeneous pre-test estimator, Statistics and Probability Letters, 1999, 41: 65–71.
Wan A T K and Kurumai H, An iterative feasible minimum mean squared error estimator of the disturbance variance in linear regression under asymmetric loss, Statistics and Probability Letters, 1999, 45: 253–259.
Wan A T K and Ohtani K, Minimum mean squared error estimation in linear regression with an inequality constraint, Journal of Statistical Planning and Inference, 2000, 86: 157–173.
Theil H, Principles of Econometrics, North-Holland, Amsterdam, 1971.
Chaturvedi A and Shukla G, Stein-rule estimation in linear models with non-scalar error covariance matrix, Sankhyā, Series B, 1990, 52: 293–304.
Wan A T K and Chaturvedi A, Operational variants of the minimum mean squared error estimator in linear regression models with non-spherical disturbances, Annals of the Institute of Statistical Mathematics, 2000, 52: 332–342.
Wan A T K and Chaturvedi A, Double k-Class estimators in regression models with non-spherical disturbances, Journal of Multivariate Analysis, 2001, 79: 226–250.
Ullah A and Ullah S, Double k-class estimators of coefficients in linear regression, Econometrica, 1978, 46: 705–722.
Peddada S D, A short note on Pitman measure of nearness, American Statistician, 1985, 39: 298–299.
Rao C R, Keating J P, and Mason R L, The Pitman nearness criterion and its determination, Communications in Statistics — Theory and Methods, 1986, 15: 3173–3191.
Sen P K, Kubokawa T, and Saleh A K M E, The Stein paradox in the Pitman closeness, Annals of Statistics, 1989, 17: 1563–1579.
Peddada S D and Khattre R, On Pitman nearness and variance of estimators, Communications in Statistics — Theory and Methods, 1986, 15: 3005–3017.
Khattre R and Peddada S D, A short note on Pitman nearness for elliptically symmetric estimators, Journal Statistical Planning and Inference, 1987, 16: 257–260.
Srivastava A K and Srivastava V K, Pitman closeness for Stein-rule estimators of regression coefficients, Statistical Probability Letters, 1993, 18: 85–89.
Chaturvedi A, A note on the Stein rule estimation in linear models with nonscalar error covariance matrix, Sankhyā, Series B, 1995, 57: 158–165.
Chaturvedi A and Shalabh, Risk and Pitman closeness properties of feasible generalized double k-class estimators in linear regression models with non-spherical disturbances under balanced loss function, Journal of Multivariate Statistics, 2004, 90: 229–256.
Ohtani K and Wan A T K, Comparison of Stein variance and the usual estimators for the regression error variance under the Pitman nearness criterion when variables are omitted, Statistical Papers, 2009, 50: 151–160.
Magnus J R and Durbin J, Estimation of regression coefficients of interest when other regression coefficients are of no interest, Econometrica, 1999, 67: 639–643.
Danilov D and Magnus J R, On the harm that ignoring pretesting can cause, Journal of Econometrics, 2004, 122: 27–46.
Zou G H, Wan A T K, Wu X, and Chen T, Estimation of regression coefficients of interest when other regression coefficients are of no interest: The case of non-normal errors, Statistics and Probability Letters, 2007, 77: 803–810.
Magnus J R, Wan A T K, and Zhang X Y, Weighted average least squares estimator with nonspherical disturbances and an application to the Hong Kong housing market, Computational Statistics and Data Analysis, 2011, 55(3): 1331–1341.
Rothenberg T J, Approximate normality of generalized least squares estimates, Econometrica, 1984, 52: 811–825.
Author information
Authors and Affiliations
Corresponding author
Additional information
The author gratefully acknowledges the financial support from CSIR to carry on the present work.
This paper was recommended for publication by Editor ZOU Guohua.
Rights and permissions
About this article
Cite this article
Chaturvedi, A., Kesarwani, S. Estimation of a subset of regression coefficients of interest in a model with non-spherical disturbances. J Syst Sci Complex 26, 209–231 (2013). https://doi.org/10.1007/s11424-012-0051-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-012-0051-3