Structures and Features of Optimal Information Systems


The first purpose of this chapter is to present a systematic approach to the optimization problems. In the preceding chapters we considered several concrete optimization problems. They now serve as examples of general methods that are presented here. On the other hand, considerations in this chapter show those specific problems in a broader perspective and provide formal justifications for the heuristic assumption that have been introduced previously.


Potential Form Solve Optimization Problem Primary Information Training Cycle Optimal Recovery 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [8.1]
    Makhoul, J., Roucos, S., Gish, H., Vector Quantization in Speech Coding, Procc. IEEE, vol 73 (1985) pp. 1551–1588.CrossRefGoogle Scholar
  2. [8.2]
    Lim, J.S., Two-Dimensional Signal and Image Processing, Prentice Hall, Englewood Cliffs, NJ, 1990.Google Scholar
  3. [8.3]
    Daugherty, E.R., Digital Image Processing Methods, Marcel Dekker, NY, 1994.Google Scholar
  4. [8.4]
    Russ, J.C., ed., The Image Processing Handbook, (2-nd ed.), IEEE Press, NY, 1994.Google Scholar
  5. [8.5]
    Minoux, M., Mathematical Programming: Theory and Algorithms, J. Wiley, NY, 1986.MATHGoogle Scholar
  6. [8.6]
    Cuthbert, T.R., Optimization Using Personal Computers, J. Wiley, NY, 1986.Google Scholar
  7. [8.7]
    Press, W.H., Flannery, B.P., Teukolsy, S.A., Vetterling, W.T., Numerical Recipes, Cambridge University Press, Cambridge, 1992.Google Scholar
  8. [8.8]
    Thompson, E.E., An Introduction to Algebra of Matrices with some Applications, Adam Hilger, London, 1969.MATHGoogle Scholar
  9. [8.9]
    Middleton, R.H., Goodwin, G.c., Digital Control and Estimation: A Unified Approach, Prentice Hall, Englewood Cliffs, NJ, 1990.MATHGoogle Scholar
  10. [8.10]
    Schmetterer, L., Stochastic Approximations, Procc. of 4-th Berkley Symposium on Mathematical Statistics, vol 9, (1961), pp. 587–609.MathSciNetGoogle Scholar
  11. [8.11]
    Tsypkin Ya.,Z., Foundations of Theory of Learning Systems, Academic Press, N.Y., 1973.MATHGoogle Scholar
  12. [8.12]
    Widrow B., Stearns S.,D., Adaptive Signal Processing, Prentice Hall, Englewood Cliffs, 1985.MATHGoogle Scholar
  13. [8.13]
    Proakis, J.G., Digital Communications, (2nd ed.), McGraw-Hill, NY, 1989.Google Scholar
  14. [8.14]
    Zurada, J.M., Introduction to Artificial Neural Systems, West, St.Poul, MN, 1992.Google Scholar
  15. [8.15]
    Haykin, S., Neural Networks: A Comprehensive Foundation, IEEE Press, NY, 1994.MATHGoogle Scholar
  16. [8.16]
    Goldberg, D.E., Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Weseley, NY, 1989.MATHGoogle Scholar
  17. [8.17]
    Soucek, B. and IRIS Group, Dynamic, Genetic, and Chaotic Programming, J. Wiley, NY, 1992.MATHGoogle Scholar
  18. [8.18]
    Schalkwijk, J.P.M., Center of Gravity Information Feedback, IEEE Trans. On Information Theory, vol IT-14 (1968), pp.324–331.CrossRefMathSciNetGoogle Scholar
  19. [8.19]
    Papoulis, R., Probability, Random Variables, and Stochastic Processes, McGraw-Hill, NY, 1991.Google Scholar
  20. [1.20]
    Blachut, R.E., Principles and Practice in Information Theory, Addison-Wesley, Reading, MA, 1990.Google Scholar
  21. [8.21]
    Cover, T.M., Elements of Information Theory, J. Wiley, NY, 1991.MATHGoogle Scholar
  22. [8.22]
    Golomb, S.W., Peile R.A., Scholtz, R.A., Basic Concepts in Information Theory and Coding, Plenum Press, NY, 1994.MATHGoogle Scholar
  23. [8.23]
    Seidler, J.A., Digital Data Transmission Systems, (in Polish), W.N.T., Warsaw, 1976; (in Russian) SWAZ, Moscow, 1978.Google Scholar
  24. [8.24]
    Kleinrock, L., Queuing Systems (2 vols.), J. Wiley, NY., 1976.Google Scholar
  25. [8.25]
    Seidler, J.A., Principles of Computer Communication Network Design, J. Wiley, NY, 1983.Google Scholar
  26. [8.26]
    Bertsekas, D., Gallager R., Data Networks, Prentice Hall, Englewood Cliffs, NJ, 1987.Google Scholar
  27. [8.27]
    Judell, N., Scharf, L., A Simple Derivation of Lloyd’s Classical Result for the Optimal Scalar Quantizer, IEEE Trans.on Information Theory, vol 32 (1986), pp.326–328.CrossRefGoogle Scholar

Copyright information

© Kluwer Academic Publishers 1997

Personalised recommendations