Skip to main content

Visualization of Hidden Node Activity in Neural Networks: I. Visualization Methods

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3070))

Abstract

Quality of neural network mappings may be evaluated by visual inspection of hidden and output node activities for the training dataset. This paper discusses how to visualize such multidimensional data, introducing a new projection on a lattice of hypercube nodes. It also discusses what type of information one may expect from visualization of the activity of hidden and output layers. Detailed analysis of the activity of RBF hidden nodes using this type of visualization is presented in the companion paper.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hinton, G.E., McClelland, J.L., Rumelhart, D.E.: In: Rumelhart, D.E., McClelland, J.L. (eds.) Parallel Distributed Processing. Foundations, vol. 1, pp. 77–109. MIT Press, Cambridge (1986)

    Google Scholar 

  2. Gallagher, M., Downs, T.: Visualization of Learning in Multi-layer Perceptron Networks using PCA. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics 33, 28–34 (2003)

    Article  Google Scholar 

  3. Duch, W.: Coloring black boxes: visualization of neural network decisions. In: Int. Joint Conference on Neural Networks, Portland, Oregon, vol. 1, pp. 1735–1740 (2003)

    Google Scholar 

  4. PDF version of the color figures and the Matlab programs used in experiments are available at http://www.phys.uni.torun.pl/kmk/publications.html

  5. Jambu, M.: Exploratory and Multivariate Data Analysis. Academic Press, Boston (1991)

    MATH  Google Scholar 

  6. Naud, A.: Neural and statistical methods for the visualization of multidimensional data. PhD thesis, Dept of Informatics, Nicholaus Copernicus University (2001), Available at http://www.phys.uni.torun.pl/kmk/publications.html

  7. Bishop, C.: Neural networks for pattern recognition. Clarendon Press, Oxford (1994)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Duch, W. (2004). Visualization of Hidden Node Activity in Neural Networks: I. Visualization Methods. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds) Artificial Intelligence and Soft Computing - ICAISC 2004. ICAISC 2004. Lecture Notes in Computer Science(), vol 3070. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24844-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24844-6_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22123-4

  • Online ISBN: 978-3-540-24844-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics