Part of the Statistics for Industry and Technology book series (SIT)


Part II is based upon three papers that were presented in the Special Session Information Theory and Statistical Applications of the 12th International Conference on Applied Stochastic Models and Data Analysis (ASMDA 2007) which was held in May 2007 in Chania, Greece. Information theory includes research dealing, among others with statistical inference, association, prediction, and modelling of statistical data. The last two or three decades are characterised by a vigorous growth in the use of information-theoretic ideas and methods in statistics. The reason is that Statistical Information Theory (SIT) provides a number of measures which obey nice probabilistic and statistical properties and moreover can be used to formulate and solve a great variety of statistical problems. In this sense SIT contributes to the advancement in probability theory and statistics in particular, and progress in almost all areas of science and engineering.


Divergence Measure Statistical Inference Model Selection Criterion Vigorous Growth Special Session 


  1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. Proc. of the 2nd Intern. Symposium on Information Theory, (Petrov B. N. and Csaki F., Eds.), Akademiai Kaido, Budapest.Google Scholar
  2. Ali, S. M. and Silvey, S. D. (1966). A general class of coefficients of divergence of one distribution from another. J. R. Statist. Soc. B, 28, 131–142.MATHMathSciNetGoogle Scholar
  3. Csiszar, I. (1963). Eine Informationstheoretische Ungleichung und ihre Anwendung auf den Bewis der Ergodizitat on Markhoffschen Ketten. Publ Mathe Inst Hungarian Acad Sci, 8, 84–108.MathSciNetGoogle Scholar
  4. Jaynes E. T. (1957). Information theory and statistical mechanics. Phys. Rev., 106, 620–630.CrossRefMathSciNetGoogle Scholar
  5. Pardo, L. (2006). Statistical Inference Based on Divergence Measures. Chapman and Hall, London.MATHGoogle Scholar
  6. Read, T. R. C. and Cressie, N. A. C. (1988). Goodness-of-Fit Statistics for Discrete Multivariate Data. Springer-Verlag, New York.MATHGoogle Scholar
  7. Shannon, C. E. (1948). The mathematical theory of communication. Bell Syst. Tech. J., 27, 379–423.MATHMathSciNetGoogle Scholar
  8. Vajda, I. (1989). Theory of Statistical Inference and Information. Kluwer Academic, Dordrecht.Google Scholar

Copyright information

© Birkhäuser Boston 2010

Authors and Affiliations

  1. 1.Department of MathematicsUniversity of IoanninaIoanninaGreece

Personalised recommendations