Skip to main content

Statistical Decision Making and Neural Networks

  • Chapter
Dealing with Complexity

Abstract

Statistical decision making (SDM) [1] and artificial neural networks (NN) [2] support the same activity, namely, decision making. In this chapter, decision making is understood in a wide sense that covers pattern recognition, cluster analysis, parameter estimation, prediction, diagnostics, fault detection, control design etc. In any of these tasks, the available information is processed in order to make some action: to assign a proper class to an observed sample, to guess what values an unobserved quantity may have, to predict what values of some quantities will occur, to guess the state of a patient or a technical system, to select values of manipulable variables fed into a controlled system etc.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. J.O. Berger, Statistical Decision Theory and Bayesian Analysis, Springer-Verlag, New York, 1985.

    MATH  Google Scholar 

  2. S. Haykin, Neural networks: A comprehensive foundation, Macmillan College Publishing Company, New York, 1994.

    MATH  Google Scholar 

  3. A. Wald, Statistical Decision Functions, John Wiley & Sons, New York, London, 1950.

    Google Scholar 

  4. L. Berec and M. Kârnÿ, “Identification of reality in Bayesian context”, in Computer-Intensive Methods in Control and Signal Processing: Curse of Dimensionality, K. Warwick and M. KArnÿ, Eds. Birkhauser, 1997.

    Google Scholar 

  5. R. Kulhav and M. B. Zarrop, “On general concept of forgetting”, international Journal of Control, vol. 58, no. 4, pp. 905–924, 1993.

    Article  MathSciNet  Google Scholar 

  6. L.T. Fine, Theories of Probability, Academic Press, New York, London, 1973.

    MATH  Google Scholar 

  7. M.M. Rao, Measure Theory and Integration, John Wiley and Sons, New York, Chichester, Brisbane, Toronto, Singapore, 1987, Pure and Applied Mathematics, Wiley-Interscience Series of Texts, Monographs and Tracts.

    Google Scholar 

  8. V. Peterka, “Bayesian system identification”, in Trends and Progress in System Identification, P. Eykhoff, Ed., pp. 239–304. Pergamon Press, Oxford, 1981.

    Google Scholar 

  9. P.H. Algoet and T.M. Cover, “A sandwich proof fo the Shannon-McMillanBreiman theorem”, The Annals of Probability, vol. 16, pp. 899–909, 1988.

    Article  MATH  MathSciNet  Google Scholar 

  10. S. Kullback and R. Leibler, “On information and sufficiency”, Annals of Mathematical Statistics, vol. 22, pp. 79–87, 1951.

    Article  MATH  MathSciNet  Google Scholar 

  11. R. Kulhav9, “Directional tracking of regression-type model parameters”, in Preprints of the 2nd IFAC Workshop on Adaptive Systems in Control and Signal Processing, Lund, Sweden, 1986, pp. 97–102.

    Google Scholar 

  12. H. Gao, M. Kârnÿ, and M. SlAma, “Performance of feasible Markov chain-based predictors for nonlinear systems”, 1997, ECC’97, accepted.

    Google Scholar 

  13. M. Kârnÿ, P. Nedoma, and J. Böhm, “On completion of probabilistic models”, in Preprints of the 2nd European IEEE Workshop on Computer Intensive Methods in Control and Signal Processing, CMP ‘86, L. Berec, J. Rojíek, M. Kârnÿ, and K. Warwick, Eds., pp. 59–64. ÚTIA AV CR, Prague, 1996.

    Google Scholar 

  14. M. Kârnÿ, L. Berec, and P. Nedoma, “Bayesian structure estimation: State and progress”, in Preprints of the Summer School Course, J. Böhm and J. Rojí6ek, Eds., pp. 13–27. ÚTIA AVCR, Prague, 1995.

    Google Scholar 

  15. M. Kârnÿ and P. Nedoma, “Automatic processing of prior information with application to identification of regression model”, Automatica, 1997, submitted.

    Google Scholar 

  16. M. Kârnÿ, “Parametrization of multi-output multi-input autoregressive-regressive models for self-tuning control”, Kybernetika, vol. 28, no. 5, pp. 402–412, 1992.

    MATH  MathSciNet  Google Scholar 

  17. R. Kulhavfr, Recursive Nonlinear Estimation: A Geometric Approach, vol. 216 of Lecture Notes in Control and Information Sciences, Springer-Verlag, London, 1996.

    Google Scholar 

  18. I.N. Sanov, “On probability of large deviations of random variables”, Matematiceskij Sbornik, vol. 42, pp. 11–44, 1957, in Russian, translation in Selected Translations mathematical statistics and probability, I, 1961, 213–244.

    Google Scholar 

  19. A. R. Barron and C. H. Sheu, “Approximation of density functions by sequences of exponential families”, The Annals of Statistics, vol. 19, no. 3, pp. 1347–1369, 1991.

    Article  MATH  MathSciNet  Google Scholar 

  20. M. Kgrnÿ, “Estimation of control period for selftuners”, Automatica,vol. 27, no. 2, pp. 339–348, 1991, extended version of the paper presented at 11th IFAC World Congress, Tallinn.

    Google Scholar 

  21. G.J. Bierman, Factorization Methods for Discrete Sequential Estimation, Academic Press, New York, 1977.

    MATH  Google Scholar 

  22. J. Kadlec, F.M.F. Gaston, and G.W. Irwin, “Parallel implementation of restricted parameter tracking”, in Mathematics in signal Processing, J.G. McWhirter, Ed., pp. 315–325. Clarendon Press, Oxford, 1994.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag London Limited

About this chapter

Cite this chapter

Kárný, M., Warwick, K., Kůrková, V. (1998). Statistical Decision Making and Neural Networks. In: Kárný, M., Warwick, K., Kůrková, V. (eds) Dealing with Complexity. Perspectives in Neural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-1523-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-1523-6_3

  • Publisher Name: Springer, London

  • Print ISBN: 978-3-540-76160-0

  • Online ISBN: 978-1-4471-1523-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics