Abstract
A common problem found in statistics, signal processing, data analysis and image processing research is the estimation of mutual information, which tends to be difficult. The aim of this survey is threefold: an introduction for those new to the field, an overview for those working in the field and a reference for those searching for literature on different estimation methods. In this paper comparison studies on mutual information estimation is considered. The paper starts with a description of entropy and mutual information and it closes with a discussion on the performance of different estimation methods and some future challenges.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Francois, D., Wertz, V., Verleysen, M.: Proceedings of the European Symposium on Artificial Neural Networks (ESANN), pp. 239–244 (2006)
Daub, C.O., Steuer, R., Selbig, J., Kloska, S.: BMC Bioinformatics 5 (2004)
Trappenberg, T., Ouyang, J., Back, A.: Journal of Latex Class Files 1, 8 (2002)
Fransens, R., Strecha, C., Van Gool, L.: Proceedings of Theory and Applications of Knowledge-Driven Image Information Mining with Focus on Earth Observation (ESA-EUSC) (2004)
Hlaváčková-Schindler, K.: Information Theory and Statistical Learning. Springer Science & Business Media LLC (2009)
Rossi, F., Francois, D., Wertz, V., Meurens, M., Verleysen, M.: Chemometrics and Intelligent Laboratory Systems 86 (2007)
Aumônier, S.: Generalized Correlation Power Analysis in the workshop ECRYPT, Tools for Cryptanalysis (2007)
Vamucci, M.: Technical Reports. Duke University (1998)
Kraskov, A., Stögbauer, H., Andrzejak, R.G., Grassberger, P, http://arxiv.org/abs/q-bio/0311039
Papana, A., Kugiumtzis, D.: Nonlinear Phenomena in Complex Systems 11, 2 (2008)
Darbellay, G.A., Vajda, I.: IEEE Transaction on Information Theory 45, 4 (1999)
Suzuki, T., Sugiyama, M, Sese, J., Kanamori, T.: Proceedings of JMLR: Workshop and Conference 4 (2008)
Endres, D., Földiák, P.: IEEE Transactions on Information Theory 51, 11 (2005)
Suzuki, T., Sugiyama, M., Sese, J., Kanamori, T.: Proceedings of the Seventh Asia-Pacific Bioinformatics Conference (APBC) (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Walters-Williams, J., Li, Y. (2009). Estimation of Mutual Information: A Survey. In: Wen, P., Li, Y., Polkowski, L., Yao, Y., Tsumoto, S., Wang, G. (eds) Rough Sets and Knowledge Technology. RSKT 2009. Lecture Notes in Computer Science(), vol 5589. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02962-2_49
Download citation
DOI: https://doi.org/10.1007/978-3-642-02962-2_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02961-5
Online ISBN: 978-3-642-02962-2
eBook Packages: Computer ScienceComputer Science (R0)