Abstract
Quality of neural network mappings may be evaluated by visual inspection of hidden and output node activities for the training dataset. This paper discusses how to visualize such multidimensional data, introducing a new projection on a lattice of hypercube nodes. It also discusses what type of information one may expect from visualization of the activity of hidden and output layers. Detailed analysis of the activity of RBF hidden nodes using this type of visualization is presented in the companion paper.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Hinton, G.E., McClelland, J.L., Rumelhart, D.E.: In: Rumelhart, D.E., McClelland, J.L. (eds.) Parallel Distributed Processing. Foundations, vol. 1, pp. 77–109. MIT Press, Cambridge (1986)
Gallagher, M., Downs, T.: Visualization of Learning in Multi-layer Perceptron Networks using PCA. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics 33, 28–34 (2003)
Duch, W.: Coloring black boxes: visualization of neural network decisions. In: Int. Joint Conference on Neural Networks, Portland, Oregon, vol. 1, pp. 1735–1740 (2003)
PDF version of the color figures and the Matlab programs used in experiments are available at http://www.phys.uni.torun.pl/kmk/publications.html
Jambu, M.: Exploratory and Multivariate Data Analysis. Academic Press, Boston (1991)
Naud, A.: Neural and statistical methods for the visualization of multidimensional data. PhD thesis, Dept of Informatics, Nicholaus Copernicus University (2001), Available at http://www.phys.uni.torun.pl/kmk/publications.html
Bishop, C.: Neural networks for pattern recognition. Clarendon Press, Oxford (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Duch, W. (2004). Visualization of Hidden Node Activity in Neural Networks: I. Visualization Methods. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds) Artificial Intelligence and Soft Computing - ICAISC 2004. ICAISC 2004. Lecture Notes in Computer Science(), vol 3070. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24844-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-24844-6_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22123-4
Online ISBN: 978-3-540-24844-6
eBook Packages: Springer Book Archive