Simultaneous Prediction Based on Shrinkage Estimator

  • Anoop Chaturvedi
  • Suchita Kesarwani
  • Ram Chandra

In the literature of multiple regression models, the customary analysis is the estimation and hypothesis testing about the parameters of the model. However, in various applications, it is utmost important for a practitioner to predict the future values of the response variable. The most common way to tackle with such a problem is the use of Best Linear Unbiased Predictors (BLUP) discussed by Theil (1971), Hendersion (1972) and Judge, Griffiths, Hill, Lütkepohl and Lee (1985). for further details of the BLUP one can see Toyooka (1982) and Kariya and Toyooka (1985). The Stein-rule predictors and the shrinkage rules based on Stein-rule technique to forecast have also got considerable attention of the researchers in recent past. Copas (1983) considered the prediction in regression using a Stein-rule predictor. Copas and Jones (1987) applied the regression shrinkage technique for the prediction in an autoregressive model. Zellner and Hong (1989) used Bayesian shrinkage rules to forecast international growth rate. Hill and Fomby (1992) analyzed the performance of various improved estimators under an out-of-sample prediction mean square error criterion. Gotway and Cressie (1993) considered a class of linear and non-linear predictors in the context of a general linear model with known disturbances covariance matrix and observed that, under the quadratic loss function, the proposed class of predictors has uniformly smaller risk than the BLUP. Khan and Bhatti (1998) obtained the prediction distribution for a set of future responses from a multiple linear regression model following an equi-correlation structure. Tuchscheres, Herrendorfer and Tuchscheres (1998) proposed Estimated Best Linear Unbiased Predictor (EBLUP) with the help of a designated simulation experiment using MSE and GSD technique for evaluation.

The present paper deals with the problem of prediction based on shrinkage estimator in a general linear model with nonspherical disturbances. A general family of predictors for the composite target function, considered by Shalabh (1995), has been proposed and its asymptotic distribution has been derived employing large sample asymptotic theory. The risk based on quadratic loss structure of the proposed family of predictors has been obtained. The performance of proposed family of predictors is compared with the feasible Best Linear Unbiased Predictor (FBLUP) under the MSE matrix criterion and Quadratic loss function criterion. Further, we obtain the expression for an estimator for the MSE matrix of the proposed predictor. The results of a numerical simulation have been presented and discussed.


Linear Regression Model Unbiased Estimator Forecast Period Best Linear Unbiased Predictor Shrinkage Estimator 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Chaturvedi A, Singh SP (2000) Stein rule prediction of the composite target function in a general linear regression model. Statistical Papers 41:359-367MATHCrossRefMathSciNetGoogle Scholar
  2. Chaturvedi A, Wan ATK, Singh SP (2002) Improved multivariate prediction in a general linear model with an unknown error covariance matrix. Journal of Multivariate Analysis 83:166-182MATHCrossRefMathSciNetGoogle Scholar
  3. Copas JB (1983) Regression, prediction and shrinkage (with discus-sion). Journal of the Royal Statistical Society (B) 45:311-354MATHMathSciNetGoogle Scholar
  4. Copas JB, Jones MC (1987) Regression shrinkage methods and au-toregressive time series prediction. Australian Journal of Statistics 29:264-277CrossRefMathSciNetGoogle Scholar
  5. Dube M, Singh V (1986) Mixed and Improved Estimation of Coefficients in Regression Models A Predictive Perspective. Journal of Applied Statistical Science 2/3, 5:161-171Google Scholar
  6. Gotway CA, Cressie N (1993) Improved multivariate prediction under a general linear model. Journal of Multivariate Analysis 45:56-72MATHCrossRefMathSciNetGoogle Scholar
  7. Hendersion CR (1972) General flexibility of linear model techniques for sire evaluation. Journal of Dairy Sciences 57:963-972CrossRefGoogle Scholar
  8. Hill RC, Fomby TB (1983) The Effects of Extrapolation on Mini-Max Stein-Rule Prediction Hill. In: WE Griffiths, H Lütkepohl, and ME Bock (eds) Readings in Econometrics Theory and Practice: A volume in Honor of George Judge, North Holland, Amsterdam 3-32Google Scholar
  9. Judge GG , Griffiths WE , Hill RC, Lütkepohl H, Lee TC (1985) The Theory and Practice of Econometrics. Wiley, New YorkGoogle Scholar
  10. Kariya T, Toyooka Y (1985) Non-linear version of the Gauss-Markov Theorem and its application to SUR model. Annals of the Institute of Statistical Mathematics 34:281-297CrossRefGoogle Scholar
  11. Kariya T, Toyooka Y (1985) Bounds for normal approximations to the distributions of generalized least squares predictors and estimators. Journal of Statistical Planning and Inference 30:213-221CrossRefMathSciNetGoogle Scholar
  12. Khan S, Bhatti MI (1998) Predictive inference on equicorrelated linear regression models. Applied Mathematics and Computation 95:205-217MATHCrossRefMathSciNetGoogle Scholar
  13. Rao CR, Toutenburg H, Shalabh, Heumann, C. (2008) Linear Models and Generalizations: Least Squares and Alternatives (3rd edition). Springer, Berlin Heidelberg New YorkMATHGoogle Scholar
  14. Shalabh (1995) Performance of Stein-rule procedure for simultaneous prediction of actual and average values of study variable in linear regression models. Bulletin of the International Statistical Institute 56:1375-1390Google Scholar
  15. Shalabh (1998) Unbiased Prediction in Linear Regression Models with Equi-Correlated Responses. Statistical Papers 39:237-244MATHCrossRefGoogle Scholar
  16. Srivastava AK, Shalabh (1996) A composite target function for predic-tion in econometric models. Indian Journal of Applied Econometrics 5:251-257Google Scholar
  17. Theil H (1971) Principle of Econometrics. Wiley, New YorkGoogle Scholar
  18. Toutenburg H (1982) Prior Information in Linear Models. Wiley, New YorkMATHGoogle Scholar
  19. Toutenburg H, Shalabh (1996) Predictive performance of the methods of restricted and mixed regression estimators. Biometrical Journal 38:951-959MATHCrossRefMathSciNetGoogle Scholar
  20. Toyooka Y (1982) Prediction error in a linear model with estimated parameters. Biometrica 69:453-459MATHCrossRefMathSciNetGoogle Scholar
  21. Tuchscheres A, Herrendorfer G and Tuchscheres M (1998) Evaluation of the Best Linear Unbiased Prediction in Mixed Linear Models with Estimated Variance Components by Means of the MSE of Prediction and the Genetic Selection Differential. Biometrical Journal 40:949-962CrossRefGoogle Scholar
  22. Zellner A, Hong C (1989) Forecasting International growth rates using Bayesian Shrinkage and Other Procedures. Journal of Econometrics 40:183-202CrossRefGoogle Scholar

Copyright information

© Physica-Verlag Heidelberg 2008

Authors and Affiliations

  • Anoop Chaturvedi
    • 1
  • Suchita Kesarwani
    • 1
  • Ram Chandra
    • 2
  1. 1.Department of StatisticsUniversity of AllahabadAllahabadIndia
  2. 2.C.S. Azad University of Agriculture and TechnologyKanpurIndia

Personalised recommendations