Encyclopedia of Computational Neuroscience

Living Edition
| Editors: Dieter Jaeger, Ranu Jung

Significance Evaluation

  • Matthew T. Harrison
Living reference work entry
DOI: https://doi.org/10.1007/978-1-4614-7320-6_404-1

Synonyms

Definition

Broadly speaking: assigning a numerical score to the “unusualness” of data relative to a specific theory. In this entry: computing a p-value for a statistical hypothesis test with emphasis on spike-train resampling.

Significance Evaluation

Deciding whether the patterns observed in experimental data support or challenge existing theories is a recurring theme in data analysis. Assigning a numerical score, or significance, is a central part of the decision process. Hypothesis testing is the classical statistical approach with p-values being the most common (but not the exclusive) method of communicating statistical significance. This entry is about basic statistical hypothesis testing with a focus on the connection between hypothesis testing and the so-called resampling methods that are gaining widespread popularity in the statistical analysis of neural firing patterns.

A comprehensive statistical analysis rarely...

This is a preview of subscription content, log in to check access.

References

  1. Amarasingham A, Harrison M, Hatsopoulos N, Geman S (2012) Conditional modeling and the jitter method of spike re-sampling. J Neurophysiol 107:517–531PubMedCentralPubMedCrossRefGoogle Scholar
  2. Casella G, Berger RL (2002) Statistical inference, 2nd edn. Duxbury Press, Pacific GroveGoogle Scholar
  3. Davison AC, Hinkley DV (1997) Bootstrap methods and their application. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  4. Farcomeni F (2008) A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion. Stat Methods Med Res 17:347–388PubMedCrossRefGoogle Scholar
  5. Harrison MT, Amarasingham A, Kass RE (2013) Statistical identification of synchronous spiking. In: DiLorenzo PM, Victor JD (eds) Spike timing: mechanisms and function. Taylor & Francis, Boca Raton, pp 77–120CrossRefGoogle Scholar
  6. Kass RE, Eden U, Brown EN (2014) Analysis of neural data. Springer, New YorkCrossRefGoogle Scholar
  7. Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI (2009) Circular analysis in systems neuroscience: the dangers of double dipping. Nat Neurosci 12:535–540PubMedCentralPubMedCrossRefGoogle Scholar
  8. Lehmann EL, Romano JP (2005) Testing statistical hypotheses, 3rd edn. Springer, New YorkGoogle Scholar
  9. Nichols T, Hayasaka S (2003) Controlling the familywise error rate in functional neuroimaging: a comparative review. Stat Methods Med Res 12:419–446PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Division of Applied MathematicsBrown UniversityProvidenceUSA