Skip to main content
SpringerLink
Log in

Test the Overall Significance of p-values by Using Joint Tail Probability of Ordered p-values as Test Statistic

  • Conference paper
Advanced Data Mining and Applications (ADMA 2008)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5139))

Included in the following conference series:

  • 3010 Accesses

Abstract

Fisher’s combined probability test is the most commonly used method to test the overall significance of a set independent p-values. However, it is very obviously that Fisher’s statistic is more sensitive to smaller p-values than to larger p-value and a small p-value may overrule the other p-values and decide the test result. This is, in some cases, viewed as a flaw. In order to overcome this flaw and improve the power of the test, the joint tail probability of a set p-values is proposed as a new statistic to combine and make an overall test of the p-values. Through the development of a method and a practical application, this study reveals that the new method has plausible properties and more power.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fisher, R.A.: Statistical Methods for Research Workers, 4th edn. Oliver and Boyd (1932)

    Google Scholar 

  2. Tippett, L.H.C.: The method of Statistics. Williams and Norgate (1931)

    Google Scholar 

  3. Edgington, E.S.: An additive method for combining probability values from independent experiments. Journal of Psychology 80, 351–363 (1972)

    Google Scholar 

  4. Edgington, E.S.: A normal curve method for combining probability values from independent experiments. Journal of Psychology 82, 85–89 (1972)

    Google Scholar 

  5. Wilkinson, B.: A statistical consideration in psychological research. Psychological Bulletin 48, 156–157 (1951)

    Article  Google Scholar 

  6. Stouffer, S.A., Suchman, E.A., DeVinney, L.C., Star, S.A., Williams Jr., R.M.: The American Soldier. In: Adjustment during Army Life, vol. I. Princeton University Press, Princeton (1949)

    Google Scholar 

  7. Birnbaum, A.: Combining independent tests of significance. Journal of the American Statistical Association 49, 559–574 (1954)

    Article  MATH  MathSciNet  Google Scholar 

  8. Littell, R.C., Folks, J.L.: Asymptotic optimality of Fisher’s method of combining independent tests. Journal of the American Statistical Association 66(336), 802–806 (1971)

    Article  MATH  MathSciNet  Google Scholar 

  9. Littell, R.C., Folks, J.L.: Combining Independent Tests of Significance. Journal of the American Statistical Association 68(341), 193–194 (1973)

    Article  MATH  MathSciNet  Google Scholar 

  10. Berk, R.H., Cohen, R.: Asymptotically optimal methods of combining tests. Journal of the American Statistical Association 74, 812–814 (1979)

    Article  MATH  MathSciNet  Google Scholar 

  11. William, R.: A Consensus Combined P-Value Test and the Family-Wide Significance of Component Tests. Biometrics 46(2), 303–308 (1990)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematics and statistics, Lancaster University, Lancaster, LA1 4YF, UK

    Yongxiang Fang & Ernst Wit

Authors
  1. Yongxiang Fang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ernst Wit
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Science, Sichuan University, 610065, Chengdu, China

    Changjie Tang

  2. Department of Computer Science, The University of Western Ontario, Canada

    Charles X. Ling

  3. School of ITEE, The University of Queensland, Australia

    Xiaofang Zhou

  4. Faculty of Science & Engineering, York University, 355 Lumbers Building, M3J 1P3, Toronto, Ontario, Canada

    Nick J. Cercone

  5. School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, 4072, Queensland, Australia

    Xue Li

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fang, Y., Wit, E. (2008). Test the Overall Significance of p-values by Using Joint Tail Probability of Ordered p-values as Test Statistic. In: Tang, C., Ling, C.X., Zhou, X., Cercone, N.J., Li, X. (eds) Advanced Data Mining and Applications. ADMA 2008. Lecture Notes in Computer Science(), vol 5139. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88192-6_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-88192-6_41

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-88191-9

  • Online ISBN: 978-3-540-88192-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation