Weighted Mixed Regression Estimation Under Biased Stochastic Restrictions

  • Christian Heumann
  • Shalabh

The use of prior information in linear regression analysis is well known to provide more efficient estimators of regression coefficients. Such prior information can be available in different forms from various sources like as past experience of the experimenter, similar kind of experiments conducted in the past, etc. The available prior information sometimes can be expressed in the form of exact, stochastic or inequality restrictions. The methods of restricted regression estimation, mixed estimation (Theil and Goldberger (1961)) and minimax estimation are preferred when prior information is available in the form of exact, stochastic and inequality restrictions, respectively. More details about these estimation procedures can be found in Rao, Toutenburg, Shalabh and Heumann (2008).

When the prior information is available in the form of stochastic restrictions, then in many applications a systematic bias is also present. Such systematic bias can arise from different sources and due to various reasons like personal judgements of the persons involved in the experiment, in testing of general linear hypothesis in linear models when null hypothesis is rejected, in imputation of missing values through regression approach etc. Teräsvirta (1980) and Hill and Ziemer (1983) have given some interesting examples for this type of information. How to incorporate such systematic bias in the estimation procedure is an issue which is addressed in this article. The method of weighted mixed regression estimation is utilized for the purpose. How to choose the weights in this estimation procedure so as to have gain in efficiency under the criterion of mean dispersion error matrix is also addressed.

The plan of the paper is as follows. The model description and the estimation of parameters are discussed in Section 2. The properties of the estimators are derived and analyzed in Section 3. Some conclusions are placed in Section 4.


Prior Information Systematic Bias Unbiased Estimator Full Column Rank Ordinary Little Square Estimator 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Hill C, Ziemer RF (1983) Missing regressor values under conditions of multicollinearity. Communications in Statistics (Theory and Methods) A12:2557-2573CrossRefMathSciNetGoogle Scholar
  2. Mathai AM, Provost SB (1992) Quadratic Forms in Random Variables: Theory and Application. Marcel Dekker Inc., New YorkGoogle Scholar
  3. Rao CR, Toutenburg H, Shalabh, Heumann C (2008) Linear Models and Generalizations - Least Squares and Alternatives (3rd edition). Springer, Berlin Heidelberg New YorkMATHGoogle Scholar
  4. Teräsvirta T (1980) Linear restrictions in misspecified linear models and polynomial distributed lag estimation. Research report no. 16, Department of Statistics, University of Helsinki 1-39Google Scholar
  5. Teräsvirta T (1982) Superiority comparisons of homogeneous linear estimators. Communications in Statistics (Theory and Methods) A11:1595-1601CrossRefGoogle Scholar
  6. Theil H, Goldberger AS (1961) On pure and mixed estimation in econometrics. International Economic Review 2: 65-78CrossRefGoogle Scholar
  7. Theobald CM (1974) Generalizations of mean square error applied to ridge regression. Journal of the Royal Statistical Society B36:103-106MathSciNetGoogle Scholar
  8. Toutenburg H (1989) Mean-square-error-comparisons between re-stricted least squares, mixed and weighted mixed estimators. Forschungsbericht 89/12, Universität Dortmund, GermanyGoogle Scholar
  9. Toutenburg H, Trenkler G (1990) Mean square error matrix compar-isons of optimal and classical predictors and estimators in linear re-gression. Computational Statistics and Data Analysis 10:297-305CrossRefMathSciNetGoogle Scholar
  10. Trenkler G (1981) Biased Estimators in the Linear Regression Model. Hain, Königstein/TsMATHGoogle Scholar
  11. Trenkler G (1985) Mean square error matrix comparisons of estimators in linear regression. Communications in Statistics (Theory and Methods) A14: 2495-2509CrossRefMathSciNetGoogle Scholar
  12. Trenkler G, Toutenburg H (1990) Mean-square error matrix comparisons between biased estimators-an overview of recent results. Statistical Papers 31:165-179MATHCrossRefMathSciNetGoogle Scholar
  13. Wijekoon P, Trenkler G (1995) Pre-test estimation in the linear regression model under stochastic restrictions. Ceylon Journal of Sciences: Physical sciences 2/1:57-64Google Scholar

Copyright information

© Physica-Verlag Heidelberg 2008

Authors and Affiliations

  • Christian Heumann
    • 1
  • Shalabh
    • 2
  1. 1.Department of StatisticsUniversity of MunichMunichGermany
  2. 2.Department of Mathematics and StatisticsIndian Institute of TechnologyKanpurIndia

Personalised recommendations