Abstract
Exact permutation tests are available only in rather simple linear models. The problem is that, although standard assumptions allow permuting the errors of the model, we cannot permute them in practice, because they are unobservable. Nevertheless, the residuals of the model can be permuted. A proof is given here which shows that it is possible to approximate the unobservable permutation distribution where the true errors are permuted by permuting the residuals. It is shown that approximation holds asymptotically and almost surely for certain quadratic statistics as well as for statistics which are expressible as the maximum of appropriate linear functions. The result is applied to testing the significance of predictors as well as to diagnostic checking of heteroscedasticity, autocorrelation, change-points, and changing regression function. Also a simulation experiment is made in order to evaluate the performance of the proposed tests.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson, M.J., Robinson, J.: Permutation tests for linear models. Aust. N. Z. J. Stat. 43, 75–88 (2001)
Anderson, M.J., ter Braak, C.J.F.: Permutation tests for multi-factorial analysis of variance. J. Stat. Comput. Simul. 73, 85–113 (2003)
Billingsley, P.: Probability and Measure. Wiley, New York (1979)
Chen, J.: Testing for a change point in linear regression models. Commun. Stat. Theory Methods 27, 2481–2493 (1998)
Cook, R.D., Weisberg, S.: Residuals and Influence in Regression. Chapman and Hall, New York (1982)
Cook, R.D., Weisberg, S.: Diagnostics for heteroscedasticity in regression. Biometrika 70, 1–10 (1983)
Edgington, E.S.: Randomization Tests, 3rd edn. Marcel Dekker, New York (1995)
Efron, B.: Bootstrap methods: another look at the jacknife. Ann. Stat. 7, 1–26 (1979)
Fisher, R.A.: Design of Experiments. Oliver and Boyd, Edinburgh (1935)
Freedman, D., Lane, D.: A nonstochastic interpretation of reported significance levels. J. Bus. Econ. Stat. 1, 292–298 (1983)
Good, P.: Permutation Tests, 3rd edn. Springer, New York (2005)
Huh, M.-H., Jhun, M.: Random permutation testing in multiple linear regression. Commun. Stat. Theory Methods 30, 2023–2032 (2001)
Holbert, D.: A Bayesian analysis of a switching linear model. J. Econ. 19, 77–87 (1982)
Imhof, J.P.: Computing the distribution of quadratic forms in normal variables. Biometrika 48, 419–426 (1961)
Kempthorne, O.: Randomization–II. In: Kotz, S., Johnson, N.L. (eds.) Encyclopedia of Statistical Sciences, vol. 7, pp. 519–524. Wiley, New York (1986)
Kennedy, P.E.: Randomization tests in econometrics. J. Bus. Econ. Stat. 13 85–94 (1995)
Kim, H.-J., Siegmund, D.: The likelihood ratio test for a change-point in simple linear regression. Biometrika 76, 409–423 (1989)
Kim, H.-J., Fay, M.P., Feuer, E.J., Midthune, D.: Permutation tests for jointpoint regression with applications to cancer rates. Stat. Med. 19, 335–351 (2000)
Koutsoyiannis, A.: Theory of Econometrics. Macmillan, London (1973)
Lehmann, E.L., Romano, J.P.: Testing Statistical Hypotheses, 3rd edn. Chapman and Hall, New York (2005)
LePage, R., Podgórski, K.: Resampling permutations in regression without second moments. J. Multivar. Anal. 57, 119–141 (1996)
Loève, M.: Probability Theory. Van Nostrand, New York (1963)
Manly, B.F.J.: Randomization, Bootstrap, and Monte Carlo Methods in Biology, 2nd edn. Chapman and Hall, London (1997)
Nyblom, J.: Testing for deterministic linear trend in time series. J. Am. Stat. Assoc. 81, 545–549 (1986)
Nyblom, J., Mäkeläinen, T.: Comparisons of tests for the presence of random walk coefficients in a simple linear model. J. Am. Stat. Assoc. 78, 856–864 (1983)
Oja, H.: On permutation tests in multiple regression and analysis of covariance problems. Aust. J. Stat. 29, 91–100 (1987)
Pesarin, F.: Multivariate Permutation Tests. Wiley, New York (2001)
Pitman, E.J.G.: Significance tests which may be applied to samples from any populations. J. R. Stat. Soc. B 4, 119–130 (1937a)
Pitman, E.J.G.: Significance tests which may be applied to samples from any populations. II. The correlation coefficient. J. R. Stat. Soc. B 4, 225–232 (1937b)
Pitman, E.J.G.: Significance tests which may be applied to samples from any populations. III. The analysis of variance test. Biometrika 29, 322–335 (1938)
Ryan, T., Joiner, B., Ryan, B.: Minitab Student Handbook. Duxbury, North Scituate (1976)
Rao, C.R.: Linear Statistical Inference and Its Applications, 2nd edn. Wiley, New York (1973)
Schmoyer, R.L.: Permutation tests for correlation in regression errors. J. Am. Stat. Assoc. 89, 1507–1516 (1994)
Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 6, 461–464 (1978)
Serfling, R.J.: Approximation Theorems of Mathematical Statistics. Wiley, New York (1980)
Acknowledgements
The author thanks two anonymous referees for their useful comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Nyblom, J. (2015). Permutation Tests in Linear Regression. In: Nordhausen, K., Taskinen, S. (eds) Modern Nonparametric, Robust and Multivariate Methods. Springer, Cham. https://doi.org/10.1007/978-3-319-22404-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-22404-6_5
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22403-9
Online ISBN: 978-3-319-22404-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)