A Practical Guide to Information Analysis of Spike Trains

  • Gianni Pola
  • Simon R. Schultz
  • Rasmus S. Petersen
  • Stefano Panzeri


Information Theory enables different candidate coding strategies to be quantified and compared, and hence is a natural framework for studying neural coding. The main difficulty is that estimates of information from experimental data are prone to systematic sampling error. In this chapter, we present a step-by-step guide to how this error can be addressed, and reliable information estimates obtained.

Key words

Information Theory Spike Timing Neural Coding. 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Borst, A. and Theunissen, F. E. (1999) Information theory and neural coding. Nature Neuroscience 2, 947–957.PubMedCrossRefGoogle Scholar
  2. Cover, T. M. and Thomas, J. A. (1991) Elements of information theory, Wiley, New York.CrossRefGoogle Scholar
  3. Miller, G. A. (1955) Note on the bias on information estimates. Information Theory in Psychology; Problems and Methods II-B, 95–100.Google Scholar
  4. Nemenman, I., Shafee, F. and Bialek, W. (2002) Entropy and Inference, Revisited in Advances in Neural Information Processing Systems 14. Dietterich, T. G., Becker, S. and Z. Ghahramani (Eds.), MIT Press, Cambridge, MA.Google Scholar
  5. Panzeri, S., Petersen, R. S., Schultz, S. R., Lebedev M. and Diamond, M. E. (2001) The role of spike timing in the coding of stimulus location in rat somatosensory cortex. Neuron 29, 769–777.PubMedCrossRefGoogle Scholar
  6. Panzeri, S. and Treves, A. (1996) Analytical estimates of limited sampling in different information measures. Network 7, 87–107.CrossRefGoogle Scholar
  7. Panzeri, S. and Schultz, S. R. (2001) A unified approach to the study of temporal, correlational and rate coding. Neural Comput. 13, 1311–1349.PubMedCrossRefGoogle Scholar
  8. Panzeri, S., Schultz, S. R., Treves, A. and Rolls, E. T. (1999) Correlations and the encoding of information in the nervous system. Proc. R. Soc. Lond. B Biol Sci. 266, 1001–1012.CrossRefGoogle Scholar
  9. Petersen, R. S., Panzeri, S. and Diamond, M. E. (2001) Population coding of stimulus location in rat somatosensory cortex. Neuron 32, 503–514.PubMedCrossRefGoogle Scholar
  10. Petroni, F. (2002) A computational analysis of the functional role of timing of action potentials in the cerebral cortex. Unpublished doctoral dissertation, University of Newcastle upon Tyne.Google Scholar
  11. Pola, G., Thiele, A., K. -P. Hoffmann and Panzeri, S. (2002) An exact method to quantify the information transmitted by different mechanisms of correlational coding. Network: Special issue on statistical analysis of spike trains and information theory, submitted.Google Scholar
  12. Rieke, F., Warland, D., de Ruyter van Stevenick, R. R. and Bialek, W. (1996) Spikes: Exploring the neural code, MIT Press, Cambridge, MA.Google Scholar
  13. Schultz, S. R. and Panzeri, S. (2001) Temporal correlations and neural spike train entropy. Phys. Rev. Lett. 86, 5823–5826.PubMedCrossRefGoogle Scholar
  14. Shannon, C. E. (1948) A mathematical theory of communication. AT&T Bell Labs. Tech. J., 27, 379–423.Google Scholar
  15. Strong, S.P., Koberle R., de Ruyter van Stevenink, R.R. and Bialek, W. (1998) Entropy and information in neuronal spike trains. Phys. Rev. Lett. 80,197–200.CrossRefGoogle Scholar
  16. Treves, A. and Panzeri, S. (1995) The upward bias in measures of information derived from limited data samples. Neural Comput. 7, 399–407.CrossRefGoogle Scholar
  17. Victor, J. D. (2000) Asymptotic bias in information estimates and the exponential (bell) polynomials. Neural Comput. 12, 2797–2804.PubMedCrossRefGoogle Scholar
  18. Wolpert, D. H. and Wolf, D. R. (1995) Estimating functions of probability distributions from a finite set of samples. Phys. Rev. E, 52, 6841–54.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2003

Authors and Affiliations

  • Gianni Pola
    • 1
  • Simon R. Schultz
    • 2
  • Rasmus S. Petersen
    • 3
  • Stefano Panzeri
    • 1
  1. 1.Department of PsychologyUniversity of Newcastle upon Tyne, The Henry Wellcome Building for Neuroecology, Medical School, Framlington PlaceNewcastle upon TyneUK
  2. 2.Howard Hughes Medical Institute and Center for Neural ScienceNew York UniversityNew YorkUSA
  3. 3.Cognitive Neuroscience SectorInternational School for Advanced StudiesItaly

Personalised recommendations