Summary
An exposition is given of various information theoretic measures appropriate for general statistical analysis of multivariate discrete data. Such measures ought to be better known and used in descriptive and exploratory statistics, and they can also be beneficial as test statistics of probabilistic models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cover, T., Thomas, J.: Elements of Information Theory. Wiley, New York (1991)
Ellis, R.S.: Entropy, Large Deviations, and Statistical Mechanics. Springer, New York (1985)
Frank, O.: Structural plots of multivariate binary data. J. Soc. Struct. 1(4), 1–19 (2000)
Frank, O., Lorenc, B.: Entropy combinations that detect conditional, pair-wise and mutual independence. Statistics Department, Stockholm University (2002)
Frank, O., Menéndez, M.L., Pardo, L.: Asymptotic distributions of weighted divergence between discrete distributions. Comm. Statist.-Theor. Meth. 27(4), 867–885 (1998)
Gokhale, D., Kullback, S.: The Information in Contingency Tables. Marcel-Decker, New York (1978)
Goodman, L.A., Kruskal, W.H.: Measures of Association for Cross-Classifications. Springer, New York (1979)
Hamming, R.W.: Coding and Information Theory. Prentice-Hall, Englewood Cliffs (1980)
Hankerson, D., Harris, G., Johnson Jr., P.: Introduction to Information Theory and Data Compression. CRC Press, Boca Raton (1998)
Kallenberg, O.: Foundations of Modern Probability, 2nd edn. Springer, New York (2002)
Krippendorff, K.: Information Theory; Structural Models for Qualitative Data. Sage, Newbury Park (1986)
Kullback, S.: Information Theory and Statistics. Wiley, New York (1959)
Lauritzen, S.L.: Graphical Models. Oxford University Press, Oxford (1996)
Luksch, P., Skorsky, M., Wille, R.: Drawing concept lattices with a computer. In: Gaul, W., Schader, M. (eds.) Classification as a Tool of Research, pp. 269–274. Elsevier Science, Amsterdam (1986)
Schervish, M.J.: Theory of Statistics. Springer, New York (1995)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423, 623–656 (1948)
Theil, H.: Economics and Information Theory. North Holland, Amsterdam (1967)
Whittaker, J.: Graphical Models in Applied Multivariate Statistics. Wiley, New York (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Frank, O. (2011). Statistical Information Tools for Multivariate Discrete Data. In: Pardo, L., Balakrishnan, N., Gil, M.Á. (eds) Modern Mathematical Tools and Techniques in Capturing Complexity. Understanding Complex Systems. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20853-9_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-20853-9_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20852-2
Online ISBN: 978-3-642-20853-9
eBook Packages: EngineeringEngineering (R0)