Skip to main content

Statistical Inference

  • Chapter
  • First Online:
  • 2798 Accesses

Part of the book series: Bernstein Series in Computational Neuroscience ((BSCN))

Abstract

This first chapter will briefly review basic statistical concepts, ways of thinking, and ideas that will reoccur throughout the book, as well as some general principles and mathematical techniques for handling these. In this sense it will lay out some of the ground on which statistical methods developed in later chapters rest. It is assumed that the reader is basically familiar with core concepts in probability theory and statistics, such as expectancy values, probability distributions like the binomial or Gaussian, Bayes’ rule, or analysis of variance. The presentation given in this chapter is quite condensed and mainly serves to summarize and organize key facts and concepts required later, as well as to put special emphasis on some topics. Although this chapter is self-contained, if the reader did not pass through an introductory statistics course so far, it may be advisable to consult introductory chapters in a basic statistics textbook first (very readable introductions are provided, for instance, by Hays 1994, or Wackerly et al. 2007; Kass et al. 2014, in particular, give a highly recommended introduction specifically targeted to a neuroscience readership). More generally, it is remarked here that the intention of the first six chapters was more to extract and summarize essential points and concepts from the literature referred to.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   69.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Aarts, E., Korst, J.: Simulated Annealing and Boltzmann Machines: A Stochastic Approach to Combinatorial Optimization and Neural Computing. Wiley, Chichester (1988)

    MATH  Google Scholar 

  • Benjamini, Y., Hochberg, Y.: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. Roy. Stat. Soc. Ser. B (Methodological). 289–300 (1995)

    Google Scholar 

  • Berger, J.O.: Statistical Decision Theory and Bayesian Analysis, 2nd edn. Springer, New York (1985)

    Book  MATH  Google Scholar 

  • Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2006)

    MATH  Google Scholar 

  • Box, G.E., Cox, D.R.: An analysis of transformations. J. Roy. Stat. Soc. B. 26, 211–252 (1964)

    MATH  Google Scholar 

  • Buzsaki, G., Draguhn, A.: Neuronal oscillations in cortical networks. Science. 304, 1926–1929 (2004)

    Article  Google Scholar 

  • Davison, A.C., Hinkley, D.V.: Bootstrap Methods and Their Application. Series: Cambridge Series in Statistical and Probabilistic Mathematics (No. 1) (1997)

  • Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. Ser. B. 39, 1–38 (1977)

    MathSciNet  MATH  Google Scholar 

  • Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. Wiley, New York (1973)

    MATH  Google Scholar 

  • Efron, B.: Estimating the error rate of a prediction rule: some improvements on cross-validation. J. Am. Stat. Assoc. 78, 316–331 (1983)

    Article  MATH  Google Scholar 

  • Efron, B.: Better bootstrap confidence intervals. J. Am. Stat. Assoc. 82, 171–185 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  • Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Taylor & Francis, Boca Raton, FL (1993)

    Book  MATH  Google Scholar 

  • Ernst, M.D.: Permutation methods: a basis for exact inference. Stat. Sci. 19, 676–685 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  • Fahrmeir, L., Tutz, G.: Multivariate Statistical Modelling Based on Generalized Linear Models. Springer, New York (2010)

    MATH  Google Scholar 

  • Fisher, R.A.: On the mathematical foundations of theoretical statistics. Phil. Trans. R. Soc. A. 222, 309–368 (1922)

    Article  MATH  Google Scholar 

  • Fisher, R.A.: Two new properties of mathematical likelihood. Phil. Trans. R. Soc. A. 144, 285–307 (1934)

    MATH  Google Scholar 

  • Fisz, M.: Wahrscheinlichkeitsrechnung und mathematische Statistik. VEB Deutscher Verlag der Wissenschaften, Berlin (1970)

    MATH  Google Scholar 

  • Freedman, D., Pisani, R., Purves, R.: Statistics. W. W. Norton, New York (2007)

    MATH  Google Scholar 

  • Hartig, F., Calabrese, J.M., Reineking, B., Wiegand, T., Huth, A.: Statistical inference for stochastic simulation models—Theory and application. Ecol. Lett. 14, 816–827 (2011)

    Article  Google Scholar 

  • Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning (Vol. 2, No. 1) Springer, New York (2009)

    Book  MATH  Google Scholar 

  • Hays, W.L.: Statistics, International Revised 2nd edn. Academic Press, New York (1994)

    Google Scholar 

  • Holm, S.: A simple sequentially rejective multiple test procedure. Scand. J. Stat. 6, 65–70 (1979)

    MathSciNet  MATH  Google Scholar 

  • Kass, R.E., Eden, U.T., Brown, E.N.: Analysis of Neural Data. Springer, New York (2014)

    Book  MATH  Google Scholar 

  • Luenberger, D.G., Ye, Y.: Linear and Nonlinear Programming, 4th edn. Springer, New York (2016)

    Book  MATH  Google Scholar 

  • McCullagh, P., Nelder, J.A.: Generalized Linear Models, 2nd edn. Chapman and Hall/CRC Press, Boca Raton, FL (1989)

    Book  MATH  Google Scholar 

  • McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions, 2nd edn. Wiley, New York (1997)

    MATH  Google Scholar 

  • Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge, MA (1996)

    MATH  Google Scholar 

  • Morris, R.G.M.: Morris watermaze. Scholarpedia. 3, 6315 (2008)

    Article  Google Scholar 

  • Myung, I.J.: Tutorial on maximum likelihood estimation. J. Math. Psychol. 47, 90–100 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  • Naundorf, B., Wolf, F., Volgushev, M.: Unique features of action potential initiation in cortical neurons. Nature. 20, 1060–1063 (2006)

    Article  Google Scholar 

  • O’Keefe, J.: Place units in the hippocampus of the freely moving rat. Exp. Neurol. 51, 78–109 (1976)

    Article  Google Scholar 

  • Pascanu, R., Dauphin, Y.N., Ganguli, S., Bengio, Y.: On the saddle point problem for non-convex optimization. arXiv:1405.4604v2 (2014)

    Google Scholar 

  • Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press, Cambridge (2007)

    MATH  Google Scholar 

  • Turner, B.M., Van Zandt, T.: A tutorial on approximate Bayesian computation. J. Math. Psychol. 56, 69–85 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  • Wackerly, D., Mendenhall, W., Scheaffer, R.: Mathematical statistics with applications. Cengage Learning. (2008)

    Google Scholar 

  • Wilks, S.S.: The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann. Math. Stat. 9, 60–62 (1938)

    Article  MATH  Google Scholar 

  • Winer, B.J.: Statistical Principles in Experimental Design. McGraw-Hill, New York (1971)

    Google Scholar 

  • Wood, S.N.: Statistical inference for noisy nonlinear ecological dynamic systems. Nature. 466, 1102–1104 (2010)

    Article  Google Scholar 

  • Wu, C.F.J.: On the convergence properties of the EM algorithm. Ann. Stat. 11, 95–103 (1983)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Durstewitz, D. (2017). Statistical Inference. In: Advanced Data Analysis in Neuroscience. Bernstein Series in Computational Neuroscience. Springer, Cham. https://doi.org/10.1007/978-3-319-59976-2_1

Download citation

Publish with us

Policies and ethics