Abstract
Information theory is a branch of mathematical statistics and probability theory. Thus, it can and has been applied in many fields, including economics, that rely on statistical analysis. As we are concerned with it, the technical concept of ‘information’ must be distinguished from the semantic concept in common parlance. The simplest and still the most widely used technical definitions of information were first introduced (independently) by Shannon and Wiener in 1948 in connection with communication theory. Though decisively and directly related, these definitions must also be distinguished from the definition of ‘information’ introduced by R.A. Fisher in 1925 for estimation theory.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Bibliography
Akaike, H. 1973. Information theory and the extension of the maximum likelihood principle. In International symposium on information theory, ed. B.N. Petrov and F. Csaki. Budapest: Akadémiaikiado.
Amemiya, T. 1976. Selection of regressors, Technical Report, vol. 225. Stanford: Stanford University.
Atkinson, A.B.. 1970. On the measurement of inequality. Journal of Economic Theory 2: 244–263.
Atkinson, A.B.., and F. Bourguignon. 1982. The comparison of multi-dimensional distributions of economic status. Review of Economic Studies 49: 183–201.
Bourguignon, F. 1979. Decomposable income inequality measures. Econometrica 47: 901–920.
Chernoff, H. 1954. On the distribution of the likelihood ratio. Annals of Mathematical Statistics 25: 573–578.
Cowell, F.A., and K. Kuga. 1981. Inequality measurement: An axiomatic approach. European Economic Review 13: 147–159.
Cox, D.R. 1961. Test of separate families of hypotheses. In Proceedings of the Fourth Berkeley Symposium on mathematical statistics and probability, vol. 1. Berkeley: University of California Press.
De Jongh, B.H. 1952. Egalisation, disparity and entropy. Utrecht: A.W. Bruna en Zoons-Uitgevers Maatschapij.
Fisher, R.A. 1925. Statistical methods for research workers. London: Oliver & Boyd.
Foster, J.E. 1983. An axiomatic characterization of the Theil measure of income inequality. Journal of Economic Theory 31(1): 105–121.
Judge, G.G., W.E. Griffiths, R.C. Hill, and T.C. Lee. 1980. The theory and practice of econometrics. New York: Wiley.
Kolm, S-Ch. 1977. Multi-dimensional egalitarianism. Quarterly Journal of Economics 91: 1–13.
Kullback, S. 1959. Information theory and statistics. New York: Wiley.
Lisman, J.H.C. 1949. Econometrics and thermodynamics: A remark on Davis’ theory of budgets. Econometrica 17: 59–62.
Maasoumi, E. 1986a. The measurement and decomposition of multi-dimensional inequality. Econometrica 54(5).
Maasoumi, E. 1986b. Unknown regression functions and information efficient functional forms: An interpretation. In Innovations in quantitative economics, ed. D. Slottje, Greenwich: JAI Press.
Pikler, A. 1951. Optimum allocation in econometrics and physics. Welwirtschaftliches Archiv 66: 97–132.
Shannon, C.E. 1948. A mathematical theory of communication. Bell System Technical Journal 27: 379–423, 623–56.
Shorrocks, A.F. 1980. The class of additively decomposable inequality measures. Econometrica 48: 613–625.
Stumpers, F.L.H.M. 1953. A bibliography of information theory; Communication theory–cybernetics. IRE Transactions, PGIT-2.
Theil, H. 1967. Economics and information theory. Amsterdam: North-Holland.
Theil, H. 1972. Statistical decomposition analysis with applications in the social and administrative sciences. Amsterdam: North-Holland.
Theil, H. 1980. The increased use of statistical concepts in economic analysis. In Developments in statistics, vol. 3, ed. P.R. Krishnaiah. New York: Academic Press.
Theil, H., and D. Fiebig. 1984. Exploiting continuity: Maximum entropy estimation of continuous distributions. Cambridge, MA: Ballinger.
Theil, H., and K. Laitinen. 1980. Singular moment matrices in applied econometrics. In Multivariate analysis V, ed. P.R. Krishnaiah. Amsterdam: North-Holland.
Wiener, N. 1948. Cybernetics. New York: John Wiley.
Author information
Authors and Affiliations
Editor information
Copyright information
© 2018 Macmillan Publishers Ltd.
About this entry
Cite this entry
Maasoumi, E. (2018). Information Theory. In: The New Palgrave Dictionary of Economics. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-349-95189-5_778
Download citation
DOI: https://doi.org/10.1057/978-1-349-95189-5_778
Published:
Publisher Name: Palgrave Macmillan, London
Print ISBN: 978-1-349-95188-8
Online ISBN: 978-1-349-95189-5
eBook Packages: Economics and FinanceReference Module Humanities and Social SciencesReference Module Business, Economics and Social Sciences