A Unified Approach to Discrete and Continuous Entropy

  • Guy Jumarie
Part of the Springer Series in Synergetics book series (SSSYN, volume 47)


In the third chapter we reviewed the main properties of discrete and of continuous entropy, and after a careful analysis, we concluded that, to a large extent, the latter is a more suitable measure of uncertainty than the former.


Unify Approach Relative Entropy Shannon Entropy Total Entropy Conditional Entropy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 6.1
    Aczel, J., Daroczy, Z.: On Measures of Information and Their Characterization ( Academic, New York 1975 )Google Scholar
  2. 6.2
    Faddeev, D. K.: Uspehi Mat. NAÜKA 11, 227 (1956)MathSciNetMATHGoogle Scholar
  3. 6.3
    Shannon, C. E.: Bell Syst. Techn. J. 27, 379 (1948)MathSciNetMATHGoogle Scholar
  4. 6.4
    Shannon, C. E.: Bell Syst. Techn. J. 27, 623 (1948)MathSciNetGoogle Scholar
  5. 6.5
    Hatori, H.: Kodai Math. Sem. Rep. 10, 172 (1958)MathSciNetMATHCrossRefGoogle Scholar
  6. 6.6
    Thom, R.: Structural Stability and Morphogenesis ( Benjamin, New York 1975 )MATHGoogle Scholar
  7. 6.7
    Linnik, Yu. V.: Theory of Prob, and Applications 4, 288 (1959)MathSciNetCrossRefGoogle Scholar
  8. 6.8
    Jaynes, E. T.: Phys. Rev. 106, 620 (1957)MathSciNetADSCrossRefGoogle Scholar
  9. 6.9
    Jaynes, E. T.: Phys. Rev. 108, 171 (1957)MathSciNetADSCrossRefGoogle Scholar
  10. 6.10
    Shore, J. E., Johnson, R. W.: IEEE Trans. Inform. Theory IT 26, 26 (1980)MathSciNetADSMATHCrossRefGoogle Scholar
  11. 6.11
    Hartley, R. V.: Bell Syst. Techn. J. 7, 535 (1928)Google Scholar
  12. 6.12
    Renyi, A.: “On Measures of Entropy and Information” in Proc. 4th Berkeley Symp: on Math. Statistics and Probability (Univ. of California Press, Berkeley 1960 ) pp. 547–561Google Scholar
  13. 6.13
    Renyi, A.: Probability Theory ( North-Holland, Amsterdam 1970 )Google Scholar
  14. 6.14
    Brillouin, L.: Science and Information Theory ( Academic, New York 1956 )MATHGoogle Scholar
  15. 6.15
    Jumarie, G.: J. Syst. Sc. 6, 249 (1975)MathSciNetMATHCrossRefGoogle Scholar
  16. 6.16
    Aczel, J., Daroczy, Z.: RAIRO Theoretical Comput. Sc. 12, 149 (1978)MathSciNetMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1990

Authors and Affiliations

  • Guy Jumarie
    • 1
  1. 1.Department of Mathematics and Computer ScienceUniversity of Québec at MontréalMontréalCanada

Personalised recommendations