Skip to main content

Permutation Versus Bootstrap Significance Tests in Multiple Regression and Anova

  • Conference paper
Bootstrapping and Related Techniques

Part of the book series: Lecture Notes in Economics and Mathematical Systems ((LNE,volume 376))

Abstract

Kempthorne’s (1952) formulation of the randomization test is extended to yield a permutational analog of the bootstrap significance test. In the new test, residuals of a multiple regression are permuted instead of being bootstrapped. The test is an attractive alternative for Oja’s test that permutes predictors (Austr. J. Statist. 29, 91–100, 1987).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Beran, R. (1986). Simulated power functions. Ann. Statist. 14, 151–173.

    Article  Google Scholar 

  • Beran, R. (1988). Prepivoting test statistics: a bootstrap view of asymptotic refinements. J. Amer. Statist. 83, 687–697.

    Article  Google Scholar 

  • Brown, B. M. and Maritz, J. S. (1982). Distribution-free methods in regression. Austral. J. Statist. 24, 318–331.

    Article  Google Scholar 

  • Collins, M. F. (1987). A permutation test for planar regression. Austral. J. Statist. 29, 303–308.

    Article  Google Scholar 

  • Cox, D. R. and Hinkley, D. V. (1974). Theoretical Statistics. London: Chapman and Hall.

    Google Scholar 

  • DiCiccio, T. J. and Romano, J. P. (1989). A review of bootstrap confidence intervals. J. R. Statist. Soc. B 50,338–354.

    Google Scholar 

  • Edgington, E. S. (1987). Randomization Tests. 2nd Ed. New York: Dekker.

    Google Scholar 

  • Efron, B. (1979). Bootstrap methods: another look at the jackknife. Ann. Statist. 7, 1–26.

    Article  Google Scholar 

  • Efron, B. (1982). The Jackknife, the Bootstrap and other Resampling Plans. Philadelphia: SIAM.

    Book  Google Scholar 

  • Freedman, D. A. and Lane, D. (1983). A nonstochastic interpretation of reported significance levels. J. Bus. Econ. Statist. 1, 292–298.

    Article  Google Scholar 

  • Gail, M. H., Tan, W. Y. and Piantadosi, S. (1988). Tests for no treatment effect in randomized clinical trials. Biometrika 75, 57–64.

    Article  Google Scholar 

  • Hall, P. and Titterington, D. M. (1989). The effect of simulation order on level accuracy and power of Monte Carlo tests. J. R. Statist. Soc. B 51, 459–467.

    Google Scholar 

  • Hinkley, D. V. (1988). Bootstap methods. J. R. Statist. Soc. B 50, 321–337.

    Google Scholar 

  • Jöckei, K.-H. (1990). Monte Carlo techniques and hypothesis testing. In 1rst Int. conf. Statistical computing, Cesme, Izmir 1987, E. J. Dudewisz (ed.).

    Google Scholar 

  • Kempthome, O. (1952). The Design and Analysis of Experiments. New York: Wiley.

    Google Scholar 

  • Lehmann, E. L. (1975). Nonparametrics: Statistical Methods Based on Ranks. San Francisco: Holden-Day.

    Google Scholar 

  • Neyman, J. (1923). On the application of probability theory to agricultural experiments: principles (in Polish with German summary). Roczniki Nauk Rolniczch 10, 21–51.

    Google Scholar 

  • Oja, H. (1987). On permutation tests in multiple regression and analysis of covariance analysis problems. Austral. J. Statist. 29, 91–100.

    Article  Google Scholar 

  • Pitman, E. J. G. (1937). Significance tests which may be applied to samples from any populations. III The analysis of variance test. Biometrika 29, 322–335.

    Google Scholar 

  • Puri, M. L. and Sen, P. K. (1971). Nonparametric Methods in Multivariate Analysis. New York: Wiley.

    Google Scholar 

  • Romano, J. P. (1988). A bootstrap revival of some nonparametric distance tests. J. Amer. Statist. 83, 698–708.

    Article  Google Scholar 

  • Romano, J. P. (1989). Bootstrap and randomization tests of some nonparametric hypotheses. Ann. Statist. 17, 141–159.

    Article  Google Scholar 

  • Scheffé, H. (1959). The Analysis of Variance. New York: Wiley.

    Google Scholar 

  • Seber, G. A. F. (1977). Linear Regression Analysis. New York: Wiley.

    Google Scholar 

  • ter Braak, C. J. F. (1988a). CANOCO — an extension of DECORANA to analyze species-environment relationships. Vegetatio 75, 159–160.

    Google Scholar 

  • ter Braak, C. J. F. (1988b). Partial canonical correspondence analysis. In Classification and Related Methods of Data Analysis, H. H. Bock (ed.), 551–558. Amsterdam: North-Holland.

    Google Scholar 

  • ter Braak, C. J. F. (1988c). CANOCO — a FORTRAN program for canonical community ordination by [partial] [detrended] [canonical] correspondence analysis, principal components analysis and redundancy analysis(version 2.1). Report LWA-88–02. Wageningen: Agricultural Mathematics Group.

    Google Scholar 

  • Welch, W. J. (1990). Construction of permutation tests. J. Amer. Statist. 85, 693–698.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

ter Braak, C.J.F. (1992). Permutation Versus Bootstrap Significance Tests in Multiple Regression and Anova. In: Jöckel, KH., Rothe, G., Sendler, W. (eds) Bootstrapping and Related Techniques. Lecture Notes in Economics and Mathematical Systems, vol 376. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-48850-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-48850-4_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-55003-7

  • Online ISBN: 978-3-642-48850-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics