A Unified Approach to Discrete and Continuous Entropy
In the third chapter we reviewed the main properties of discrete and of continuous entropy, and after a careful analysis, we concluded that, to a large extent, the latter is a more suitable measure of uncertainty than the former.
KeywordsUnify Approach Relative Entropy Shannon Entropy Total Entropy Conditional Entropy
Unable to display preview. Download preview PDF.
- 6.1Aczel, J., Daroczy, Z.: On Measures of Information and Their Characterization ( Academic, New York 1975 )Google Scholar
- 6.11Hartley, R. V.: Bell Syst. Techn. J. 7, 535 (1928)Google Scholar
- 6.12Renyi, A.: “On Measures of Entropy and Information” in Proc. 4th Berkeley Symp: on Math. Statistics and Probability (Univ. of California Press, Berkeley 1960 ) pp. 547–561Google Scholar
- 6.13Renyi, A.: Probability Theory ( North-Holland, Amsterdam 1970 )Google Scholar