Skip to main content
SpringerLink
Log in

Statistical Inference Design

  • Chapter
  • First Online:
Design Science Methodology for Information Systems and Software Engineering

  • 9341 Accesses

Abstract

Statistical inference is the inference of properties of the distribution of variables of a population, from a sample selected from the population (Fig. 13.1). To do statistical inference, your conceptual research framework should define the relevant statistical structures, namely, a population and one or more random variables (Chap. 8, Conceptual Frameworks). The probability distributions of the variables over the population are usually unknown. This chapter is required for Chap. 20 on statistical difference-making experiments, but not for the other chapters that follow.

Statistical inference is the inference of properties of the probability distribution of variables

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. R.P. Abelson, A retrospective on the significance test ban of 1999 (If there were no significance tests, they would be invented), in What If There Were No Significance Tests?, ed. by L.L. Harlow, S.A. Mulaik, J.H. Steiger (Lawrence Erlbaum, Mahwah, 1997), pp. 117–141

    Google Scholar 

  2. D. Bakan, The test of significance in psychological research. Psychol. Bull. 66(6), 423–437 (1966)

    Article  Google Scholar 

  3. J.O. Berger, Statistical Decision Theory and Bayesian Analysis, 2nd edn. (Springer, Heidelberg, 1980)

    Book  Google Scholar 

  4. J.O. Berger, Could Fisher, Jeffreys and Neyman have agreed on testing? Stat. Sci. 18, 1–32 (2003)

    Article  MATH  Google Scholar 

  5. R.A. Berk, Toward a methodology for mere mortals. Sociol. Methodol. 21, 315–324 (1991)

    Article  Google Scholar 

  6. R.A. Berk, D.A. Freedman, Statistical assumptions as empirical commitments, in Law, Punishment, and Social Control: Essays in Honor of Sheldon Messinger, 2nd edn., ed. by T.G. Blomberg, S. Cohen (Aldine de Gruyter, Berlin, 2005), pp. 235–254. Reprinted in [21, pp. 23–43]

    Google Scholar 

  7. J. Berkson, Tests of significance considered as evidence. Int. J. Epidemiol. 32, 687–691 (2003). [Originally published in J. Am. Stat. Assoc. 37, 325–335 (1942)]

    Google Scholar 

  8. A. Birnbaum, The Neyman-Pearson theory as decision theory, and as inference theory; with a criticism of the lindley-savage argument for Bayesian theory. Synthese, 36(1), 19–49 (1977)

    Article  MathSciNet  Google Scholar 

  9. R.C. Bolles, The difference between statistical hypotheses and scientific hypotheses. Psychol. Rep. 11, 639–645 (1962)

    Article  Google Scholar 

  10. J.P. Campbell, Some remarks from the outgoing editor. J. Appl. Psychol. 67, 691–700 (1982)

    Article  Google Scholar 

  11. R.P. Carver, The case against statistical significance testing. Harv. Education. Rev. 48(8), 378–399 (1978)

    Google Scholar 

  12. J. Cohen, The earth is round (p < 0. 05). Am. Psychol. 49(12), 997–1003 (1994)

    Google Scholar 

  13. P.R. Cohen, Empirical Methods for Artificial Intelligence (Bradford Books, Cambridge, 1995)

    MATH  Google Scholar 

  14. D.R. Cooper, P.S. Schindler, Business Research Methods, 8th edn. (Irwin/McGraw-Hill, Homewood/Singapore, 2003)

    Google Scholar 

  15. D.R. Cox, Some problems connected with statistical inference. Ann. Math. Stat. 29(2), 357–372 (1958)

    Article  MATH  Google Scholar 

  16. R. Falk, C.W. Greenbaum, Significance tests die hard. The amazing persistence of a probabilistic misconception. Theory Psychol. 5(1), 75–98 (1995)

    Google Scholar 

  17. A. Field, Discovering Statistics Using SPSS, 3rd edn. (Sage, Thousand Oaks, 2009)

    Google Scholar 

  18. R.A. Fisher, Statistical methods and scientific induction. J. R. Stat. Soc. B 17, 69–77 (1955)

    MATH  Google Scholar 

  19. R.A. Fisher, Statistical Methods and Scientific Inference (Oliver & Boyd, Edinburgh, 1956)

    MATH  Google Scholar 

  20. D. Freedman, R. Pisani, R. Purves, Statistics, 4th edn. (Norton & Company, New York, 2007)

    Google Scholar 

  21. D.A. Freedman, Statistical Models and Causal Inference: A Dialogue With the Social Sciences, ed. by D. Collier, J.S. Sekhon, P.B. Stark (Cambridge University Press, Cambridge, 2010)

    Google Scholar 

  22. G. Gigerenzer, Mindless statistics. J. Socio Econ. 33, 587–606 (2004)

    Article  Google Scholar 

  23. G. Gigerenzer, D.J. Murray, Cognition as Intuitive Statistics. (Lawrence Erlbaum, Mahwah, 1987). Chap. 1, The Inference Revolution

    Google Scholar 

  24. G. Gigerenzer, Z. Swijtink, T. Porter, L. Daston, J. Beatty, L. Krüger, The Empire of Chance: How Probability Changed Science and Everyday Life (Cambridge University Press, Cambridge, 1989)

    Book  Google Scholar 

  25. G. Gigerenzer, S. Krauss, O. Vitouch, The Null ritual: what you always wanted to know about significance testing but were afraid to ask, in The Sage Handbook of Quantiative Methodology for the Social Sciences, ed. by D. Kaplan (Sage, Thousand Oaks, 2004.), pp. 391–408

    Google Scholar 

  26. I. Hacking, An Introduction to Probability and Inductive Logic (Cambridge University Press, Cambridge, 2001)

    Book  MATH  Google Scholar 

  27. A. Hájek, Interpretations of probability, in The Stanford Encyclopedia of Philosophy, Winter 2012 edn., ed. by E.N. Zalta, (2012). http://plato.stanford.edu/cgi-bin/encyclopedia/archinfo.cgi?entry=probability-interpret

  28. P.G. Halpin, H.J. Stam, Inductive inference or inductive behavior: Fisher and Neyman-Pearson approaches to statistical testing in psychological research (1940–1960). Am. J. Psychol. 119(4), 625–653 (2006)

    Article  Google Scholar 

  29. L.L. Harlow, S.A. Mulaik, J.H. Steiger (eds). What If There Were No Significance Tests? (Lawrence Erlbaum, Mahwah, 1997)

    Google Scholar 

  30. C. Hildebrand, G. Häubl, A. Herrmann, J.R. Landwher, When social media can be bad for you: community feedback stifles consumer creativity and reduces satisfaction with self-designed products. Inf. Syst. Res. 24(1), 14–29 (2013)

    Article  Google Scholar 

  31. R. Hubbard, M.J. Bahyarri, Confusion over measures of evidence (p’s) versus errors (α’s) in classical statistical testing. Am. Statistician 57(3), 171–182 (2003)

    Article  Google Scholar 

  32. T. Huynh, J. Miller, An empirical investigation into open source web applications’ implementation vulnerabilities. Empir. Softw. Eng. 15(5), 556–576 (2010)

    Article  Google Scholar 

  33. H.F. Inman, Karl Pearson and R.A. Fisher on statistical tests: a 1935 exchange from Nature. Am. Statistician 48(1), 2–11 (1994)

    Google Scholar 

  34. N. Juristo, A. Moreno, Basics of Software Engineering Experimentation (Kluwer, Dordrecht, 2001)

    Book  MATH  Google Scholar 

  35. C. Lambdin, Significance tests as sorcery: science is empirical—significance tests are not. Theory Psychol. 22(1), 67–90 (2012)

    Article  Google Scholar 

  36. J. Lenhard, Models and statistical inference: the controversy between Fisher and Neyman-Pearson. Br. J. Philos. Sci. 57, 69–91 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  37. D.T. Lykken, Statistical significance in psychological research. Psychol. Bull. 70(3), 151–159 (1968)

    Article  Google Scholar 

  38. P.E. Meehl, Theory-testing in psychology and physics: a methodological paradox. Philos. Sci. 34(2), 103–115 (1967)

    Article  Google Scholar 

  39. P.E. Meehl, Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. J. Consult. Clin. Psychol. 46, 806–834 (1978)

    Article  Google Scholar 

  40. P.E. Meehl, Why summaries of research on psychological theories are often uninterpretable. Psychol. Rep. 66, 195–244 (1990)

    Article  Google Scholar 

  41. D.E. Morrison, R.E. henkel (eds.) The Significance Test Controversy: A Reader (Aldline Transaction, Piscataway, 2006)

    Google Scholar 

  42. J. Neyman, “inductive behavior” as a basic concept in the philosophy of science. Rev. Int. Stat. Institute. 25(1/3), 7–22 (1957)

    Google Scholar 

  43. R. Nola, H. Sankey, Theories of Scientific Method (Acumen, Stocksfield, 2007)

    Google Scholar 

  44. K.R. Popper, The Logic of Scientific Discovery (Hutchinson, London, 1959)

    MATH  Google Scholar 

  45. J.M. Robins, L. Wasserman, On the impossibility of inferring causation from association without background knowledge, in Computation, Causation, and Discovery. P. Glymour, G. Cooper (eds.) (The MIT Press, Cambridge, 1999), pp. 305–321

    Google Scholar 

  46. W.W. Rozeboom, The fallacy of the null-hypothesis significance test. Psychol. Bull. 57(5), 416–428 (1960)

    Article  Google Scholar 

  47. W.R. Shadish, T.D. Cook, D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin Company, Boston, 2002)

    Google Scholar 

  48. Z. Swijtink, The objectification of observation: measurement and statistical methods in the nineteenth century, in The Probabilistic Revolution. Volume I: Ideas in History. L. Krüger, L.J. Daston, and M. Heidelberger (eds.) (MIT Press, Cambridge, 1987), pp. 261–285

    Google Scholar 

  49. J.W. Tukey, Conclusions vs decisions. Technometrics 2(4), 423–433 (1960)

    Article  MATH  MathSciNet  Google Scholar 

  50. R.W. Tyler, What is statistical significance? Educ. Res. Bull. 10(5), 115–118, 142 (1931)

    Google Scholar 

  51. L. Wasserman, All of Statistics. A Concise Course in Statistical Inference (Springer, Heidelberg, 2004)

    Google Scholar 

  52. R.R. Wilcox, Introduction to Robust Estimation and Hypothesis Testing, 2nd edn. (Academic Press, Waltham, 2005)

    MATH  Google Scholar 

  53. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A. Weslén, Experimentation in Software Engineering, 2nd edn. (Springer, Heidelberg, 2012)

    Book  Google Scholar 

  54. T.H. Wonnacott, R.J. Wonnacott, Introductory Statistics for Business and Economics, 4th edn. (Wiley, Hoboken, 1990)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Twente, Enschede, The Netherlands

    Roel J. Wieringa

Authors
  1. Roel J. Wieringa
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wieringa, R.J. (2014). Statistical Inference Design. In: Design Science Methodology for Information Systems and Software Engineering. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43839-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-43839-8_13

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-43838-1

  • Online ISBN: 978-3-662-43839-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation