Abstract
Techniques which identify parametric models for a time series are considered in this chapter. When the model structure is unknown, the key issue becomes one of regularizing the inference, namely, discovering a model which explains the data well, but avoids excessive complexity. Strict model selection criteria—such as Akaike’s, Rissanen’s and the evidence approach—are contrasted with full Bayesian solutions which allow parameters to be estimated in tandem. In the latter paradigm, marginalization is the key operator allowing model complexity to be assessed and penalized naturally via integration over parameter subspaces. As such, it is an important alternative (or adjunct) to ‗subjective ‘penalization via the choice of prior. These various strategies are considered in the context of model order determination for both harmonic and autoregressive signals, and it is emphasized that effective and numerically efficient identification algorithms result even in the case of uniform priors, if judicious integration of parameters is undertaken.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
H. Akaike. On entropy maximization principle. In P. R. Krishnaiah, editor, Applications of Statistics, pages 27–41. North-Holland, Amsterdam, 1977.
G. L. Bretthorst. Bayesian Spectrum Analysis and Parameter Estimation. Springer-Verlag, 1989.
B. de Finetti. Theory of Probability, volume 2. John Wiley, 1975.
P. M. Djuric. A model selection rule for sinusoids in white Gaussian noise. IEEE Trans, on Sig. Proc, 44(7), 1996.
H. Jeffreys. Theory of Probability. Oxford Univ. Press, 3rd edition, 1961.
B. Porat. Digital Processing of Random Signals. Prentice-Hall, 1994.
A. Quinn. A general complexity measure for signal identification using Bayesian inference. In Proc. IEEE Workshop on Nonlinear Sig. and Image Process. (NSIP’ 95), Greece, 1995.
A. Quinn. Novel parameter priors for Bayesian signal identification. In Proc. IEEE Int. Conf. on Acoust, Sp., Sig. Proc. (ICASSP), Munich, 1997.
A. Quinn. New results for autoregressive signal identification. In IEEE Int. Conf. on Acoust, Sp., Sig. Proc. (ICASSP), 1998. In preparation.
A. P. Quinn. Bayesian Point Inference in Signal Processing. Ph.D. Thesis, Cambridge University Engineering Dept., 1992.
J. Rissanen. Modeling by shortest data description. Automatica, 14, 1978.
R. D. Rosenkrantz, editor. E. T. Jaynes: Papers on Probability, Statistics and Statistical Physics. D. Reidel, Dordrecht-Holland, 1983.
O. Schwartz and A. Quinn. Fast and accurate texture-based image segmentation. In Proc. 3rd IEEE Int. Conf. on Image Proc, Lausanne, 1996.
J.E. Shore and R.W. Johnson. Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans. on Inf. Th., IT-26(1), 1980.
C. S. Wallace and P. R. Freeman. Estimation and inference by compact coding. J. Roy. Statist. Soc. B, 49(3), 1987.
A. Zellner. An Introduction to Bayesian Inference in Econometrics. John Wiley and Sons, 1971.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer Science+Business Media New York
About this chapter
Cite this chapter
Quinn, A. (1998). Regularized Signal Identification Using Bayesian Techniques. In: Procházka, A., Uhlíř, J., Rayner, P.W.J., Kingsbury, N.G. (eds) Signal Analysis and Prediction. Applied and Numerical Harmonic Analysis. Birkhäuser, Boston, MA. https://doi.org/10.1007/978-1-4612-1768-8_10
Download citation
DOI: https://doi.org/10.1007/978-1-4612-1768-8_10
Publisher Name: Birkhäuser, Boston, MA
Print ISBN: 978-1-4612-7273-1
Online ISBN: 978-1-4612-1768-8
eBook Packages: Springer Book Archive