# Automatic transaction of signal via statistical modeling

## Abstract

The statistical information processing can be characterized by the likelihood function defined by giving an explicit form for an approximation to the true distribution. This mathematical representation, which is usually called a model, is built based on not only the current data but also prior knowledge on the object and the objective of the analysis. Akaike^{2,3}) showed that the log-likelihood can be considered as an estimate of the Kullback-Leibler (K-L) information which measures the similarity between the predictive distribution of the model and the true distribution. Akaike information criterion (AIC) is an estimate of the K-L information and makes it possible to evaluate and compare the goodness of many models objectively. In consequence, the minimum AIC procedure allows us to develop automatic modeling and signal extraction procedures. In this article, we give a simple explanation of statistical modeling based on the AIC and demonstrate four examples of applying the minimum AIC procedure to an automatic transaction of signals observed in the earth sciences.

## Keywords

Kullback-Leibler Information Akaike Information Criterion (AIC) Statistical Modeling Signal Processing Generalized State Space Model## Preview

Unable to display preview. Download preview PDF.

## References

- 1).Akaike, H., “Automatic Data Structure Search by the Maximum Likelihood,” in
*Computers in Biomedicine, A Supplement to the Proceedings of the Fifth Hawaii International Conference on Systems Sciences*, Western Periodicals, California, pp. 99–101, 1972.Google Scholar - 2).Akaike, H., “Information Theory and an Extension of the Maximum Likelihood Principle,” in
*2nd International Symposium in Information Theory*(Petrov, B. N. and Csaki, F. (eds.), Akademiai Kiado, Budapest, pp. 267–281, 1973. (Reproduced in*Breakthroughs in Statistics, Vol. I, Foundations and Basic Theory*(S. Kots and N. L. Johnson (eds.)) Springer-Verlag, New York, pp. 610–624, 1992.)Google Scholar - 3).Akaike, H., “A New Look at the Statistical Model Identification,”
*IEEE Transactions on Automatic Control, AC*-*19*, pp. 716–723, 1974.MATHCrossRefMathSciNetGoogle Scholar - 4).Bozdogan, H. (ed.),
*Proc. of the First US/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach*, Kluwer Academic Publishers, 1994.Google Scholar - 5).Higuchi, T. and Ohtani, S., “Automatic Identification of Large-Scale Field-Aligned Current Structure,”
*Research Memorandom, No. 668*, The Institute of Statistical Mathematics, 1998. http://www.ism.ac.jp/~higuchi/AIFACpaper. htmlGoogle Scholar - 6).Hiragi, Y., Urakawa, H. and Tanabe, K., “Statistical Procedure for Deconvoluting Experimental Data,”
*J. Applied Physics, 58, 1*, pp. 5–11, 1985.CrossRefGoogle Scholar - 7).Ishiguro, M., Sakamoto, Y. and Kitagawa, G., “Bootstrapping log likelihood and EIC, an extension of AIC,”
*Annals of the Institute of Statistical Mathematics, 49, 3*, pp. 411–434, 1997.MATHCrossRefMathSciNetGoogle Scholar - 8).Ja-Yong, K., “Spline Estimation of Discontinuous Regression Functions,”
*J. Computational and Graphical Statistics, 6, 3*, pp. 266–284, 1997.CrossRefGoogle Scholar - 9).Kitagawa, G. and Gersch, W., “Smoothness Priors Analysis of Time Series,”
*Lecture Notes in Statistics, No. 116*, Springer-Verlag, New York, 1996.MATHGoogle Scholar - 10).Kitagawa, G. and Matsumoto, N., “Detection of Coseismic Changes of Underground water Level,”
*Journal of the American Statistical Association, 91, 434*, pp. 521–528, 1996.MATHCrossRefGoogle Scholar - 11).Konishi, S. and Kitagawa, G., “Generalized Information Criteria in Model Selection,”
*Biometrika, 83, 4*, pp. 875–890, 1996.MATHCrossRefMathSciNetGoogle Scholar - 12).Ohtani, S., Potemra, T. A., Newell, P. T., Zanetti, L. J., Iijima, T., Watanabe, M., Blomberg, L. G., Elphinstone, R. D., Murphree, J. S., Yamauchi, M., and Woch, J. G., “Four large-scale field-aligned current systems in the dayside high-latitude region,”
*J. Geophysical Research, 100, A1*, pp. 137–153, 1995.CrossRefGoogle Scholar - 13).Sakamoto, Y. and Akaike, H., “Analysis of cross-classified data by AIC,”
*Annals of the Institute of Statistical Mathematics, 30, 1*, pp. 185–197, 1978.MATHCrossRefMathSciNetGoogle Scholar - 14).Takanami, T. and Kitagawa, G., “Estimation of the Arrival Times of Seismic Waves by Multivariate Time Series Model,”
*Annals of the Institute of Statistical mathematics, 43, 3*, pp. 407–433, 1991.MATHCrossRefGoogle Scholar