# Simultaneous Prediction Based on Shrinkage Estimator

• Anoop Chaturvedi
• Suchita Kesarwani
• Ram Chandra
Chapter

In the literature of multiple regression models, the customary analysis is the estimation and hypothesis testing about the parameters of the model. However, in various applications, it is utmost important for a practitioner to predict the future values of the response variable. The most common way to tackle with such a problem is the use of Best Linear Unbiased Predictors (BLUP) discussed by Theil (1971), Hendersion (1972) and Judge, Griffiths, Hill, Lütkepohl and Lee (1985). for further details of the BLUP one can see Toyooka (1982) and Kariya and Toyooka (1985). The Stein-rule predictors and the shrinkage rules based on Stein-rule technique to forecast have also got considerable attention of the researchers in recent past. Copas (1983) considered the prediction in regression using a Stein-rule predictor. Copas and Jones (1987) applied the regression shrinkage technique for the prediction in an autoregressive model. Zellner and Hong (1989) used Bayesian shrinkage rules to forecast international growth rate. Hill and Fomby (1992) analyzed the performance of various improved estimators under an out-of-sample prediction mean square error criterion. Gotway and Cressie (1993) considered a class of linear and non-linear predictors in the context of a general linear model with known disturbances covariance matrix and observed that, under the quadratic loss function, the proposed class of predictors has uniformly smaller risk than the BLUP. Khan and Bhatti (1998) obtained the prediction distribution for a set of future responses from a multiple linear regression model following an equi-correlation structure. Tuchscheres, Herrendorfer and Tuchscheres (1998) proposed Estimated Best Linear Unbiased Predictor (EBLUP) with the help of a designated simulation experiment using MSE and GSD technique for evaluation.

The present paper deals with the problem of prediction based on shrinkage estimator in a general linear model with nonspherical disturbances. A general family of predictors for the composite target function, considered by Shalabh (1995), has been proposed and its asymptotic distribution has been derived employing large sample asymptotic theory. The risk based on quadratic loss structure of the proposed family of predictors has been obtained. The performance of proposed family of predictors is compared with the feasible Best Linear Unbiased Predictor (FBLUP) under the MSE matrix criterion and Quadratic loss function criterion. Further, we obtain the expression for an estimator for the MSE matrix of the proposed predictor. The results of a numerical simulation have been presented and discussed.

## Keywords

Linear Regression Model Unbiased Estimator Forecast Period Best Linear Unbiased Predictor Shrinkage Estimator
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

## References

1. Chaturvedi A, Singh SP (2000) Stein rule prediction of the composite target function in a general linear regression model. Statistical Papers 41:359-367
2. Chaturvedi A, Wan ATK, Singh SP (2002) Improved multivariate prediction in a general linear model with an unknown error covariance matrix. Journal of Multivariate Analysis 83:166-182
3. Copas JB (1983) Regression, prediction and shrinkage (with discus-sion). Journal of the Royal Statistical Society (B) 45:311-354
4. Copas JB, Jones MC (1987) Regression shrinkage methods and au-toregressive time series prediction. Australian Journal of Statistics 29:264-277
5. Dube M, Singh V (1986) Mixed and Improved Estimation of Coefficients in Regression Models A Predictive Perspective. Journal of Applied Statistical Science 2/3, 5:161-171Google Scholar
6. Gotway CA, Cressie N (1993) Improved multivariate prediction under a general linear model. Journal of Multivariate Analysis 45:56-72
7. Hendersion CR (1972) General flexibility of linear model techniques for sire evaluation. Journal of Dairy Sciences 57:963-972
8. Hill RC, Fomby TB (1983) The Effects of Extrapolation on Mini-Max Stein-Rule Prediction Hill. In: WE Griffiths, H Lütkepohl, and ME Bock (eds) Readings in Econometrics Theory and Practice: A volume in Honor of George Judge, North Holland, Amsterdam 3-32Google Scholar
9. Judge GG , Griffiths WE , Hill RC, Lütkepohl H, Lee TC (1985) The Theory and Practice of Econometrics. Wiley, New YorkGoogle Scholar
10. Kariya T, Toyooka Y (1985) Non-linear version of the Gauss-Markov Theorem and its application to SUR model. Annals of the Institute of Statistical Mathematics 34:281-297
11. Kariya T, Toyooka Y (1985) Bounds for normal approximations to the distributions of generalized least squares predictors and estimators. Journal of Statistical Planning and Inference 30:213-221
12. Khan S, Bhatti MI (1998) Predictive inference on equicorrelated linear regression models. Applied Mathematics and Computation 95:205-217
13. Rao CR, Toutenburg H, Shalabh, Heumann, C. (2008) Linear Models and Generalizations: Least Squares and Alternatives (3rd edition). Springer, Berlin Heidelberg New York
14. Shalabh (1995) Performance of Stein-rule procedure for simultaneous prediction of actual and average values of study variable in linear regression models. Bulletin of the International Statistical Institute 56:1375-1390Google Scholar
15. Shalabh (1998) Unbiased Prediction in Linear Regression Models with Equi-Correlated Responses. Statistical Papers 39:237-244
16. Srivastava AK, Shalabh (1996) A composite target function for predic-tion in econometric models. Indian Journal of Applied Econometrics 5:251-257Google Scholar
17. Theil H (1971) Principle of Econometrics. Wiley, New YorkGoogle Scholar
18. Toutenburg H (1982) Prior Information in Linear Models. Wiley, New York
19. Toutenburg H, Shalabh (1996) Predictive performance of the methods of restricted and mixed regression estimators. Biometrical Journal 38:951-959
20. Toyooka Y (1982) Prediction error in a linear model with estimated parameters. Biometrica 69:453-459
21. Tuchscheres A, Herrendorfer G and Tuchscheres M (1998) Evaluation of the Best Linear Unbiased Prediction in Mixed Linear Models with Estimated Variance Components by Means of the MSE of Prediction and the Genetic Selection Differential. Biometrical Journal 40:949-962
22. Zellner A, Hong C (1989) Forecasting International growth rates using Bayesian Shrinkage and Other Procedures. Journal of Econometrics 40:183-202

## Authors and Affiliations

• Anoop Chaturvedi
• 1
• Suchita Kesarwani
• 1
• Ram Chandra
• 2