Statistical Theory

Abstract

This chapter contains theory and derivations relevant to Kullback-Leibler information-theory-based model selection. We have tried to make the other chapters of this book readable by a general audience, especially graduate students in various fields. Hence, we have reserved this chapter for the theoretical material we feel it is important to make available to statisticians and quantitative biologists. For many, it will suffice to know that this theory exists. However, we encourage persons, especially if they have some mathematical-statistical training, to read and try to understand the theory given here, because that understanding provides a much deeper knowledge of many facets of K-L-based model selection in particular, and of some general model selection issues also.