Advertisement

The Use of State Space Control Theory for Analysing Feedforward Neural Networks

  • Mirek Kárný
  • Kevin Warwick
  • Vera Kůrková
Part of the Perspectives in Neural Computing book series (PERSPECT.NEURAL)

Abstract

Multi-layer neural networks have the ability to approximate any nonlinear function [l][2][3], and are therefore used for a variety of purposes. However, in many cases, the neural network is treated as a black box, since the internal mathematics of a neural network can be hard to analyse. As the size of a neural network increases, its mathematics becomes more complex and hence harder to analyse. This chapter examines the use of concepts from state space control theory, for the analysis of feedforward neural networks. The concepts used in this chapter are observability, controllability and stability. Some can be applied completely to feedforward neural networks and others have little or no meaning in the context of neural computing. Each concept will be examined and its used for analysing feedforward neural networks discussed.

Keywords

State Space Hide Layer Training Algorithm Feedforward Neural Network State Space Representation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    K. Funashi, 1989, “On the approximate realisation of continuous mappings by neural networks.”, Neural Networks2, pp. 183–192.CrossRefGoogle Scholar
  2. [2]
    K. Hornik, M. Stinchcomb and H. White, 1990, “Multi-layer perceptrons are universal approximators.”, Neural Networks2, pp. 359–366.CrossRefGoogle Scholar
  3. [3]
    F. Girosi and T. Poggio, 1990, “Neural networks and the best approximation property.”, Biol. Cybernetics, 63, pp. 169–176.CrossRefMATHMathSciNetGoogle Scholar
  4. [4]
    K. Ogata, 1967, “State-space analysis of control systems.”, Prentice-Hall.Google Scholar
  5. [5]
    Y.Z. Tsypkin, 1971, “Adaptation and Learning in Autonomous Systems.”. Academic Press Inc.Google Scholar
  6. [6]
    M. Vidyasagar, 1993, “Nonlinear Systems Analysis.”, Prentice-Hall International Editions.Google Scholar
  7. [7]
    J.C. Mason, 1984, “Basic Matrix Methods.”, Butterworth and Co.Google Scholar

Copyright information

© Springer-Verlag London Limited 1998

Authors and Affiliations

  • Mirek Kárný
    • 1
  • Kevin Warwick
    • 2
  • Vera Kůrková
    • 3
  1. 1.Institute of Information Theory & AutomationPrague 8Czech Republic
  2. 2.Department of CyberneticsUniversity of ReadingWhiteknights, ReadingUK
  3. 3.Institute of Computer ScienceAcademy of Sciences of the Czech RepublicPrague 8Czech Republic

Personalised recommendations