Abstract
Creating a neural network based classification model is traditionally accomplished using the trial and error technique. However, the trial and error structuring method nornally suffers from several difficulties including overtraining. In this article, a new algorithm that simplifies structuring neural network classification models has been proposed. It aims at creating a large structure to derive classifiers from the training dataset that have generally good predictive accuracy performance on domain applications. The proposed algorithm tunes crucial NN model thresholds during the training phase in order to cope with dynamic behavior of the learning process. This indeed may reduce the chance of overfitting the training dataset or early convergence of the model. Several experiments using our algorithm as well as other classification algorithms, have been conducted against a number of datasets from University of California Irvine (UCI) repository. The experiments’ are performed to assess the pros and cons of our proposed NN method. The derived results show that our algorithm outperformed the compared classification algorithms with respect to several performance measures.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abdelhamid, N., Ayesh, A., Thabtah, F.: Phishing detection based associative classification data mining. Expert Syst. Appl. 41(13), 5948–5959 (2014)
Ash, T.: Dynamic node creation in backpropagation networks. Connect. Sci. 1(4), 365–375 (1989)
Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Advances in Neural Information Processing Systems, pp. 524–532 (1990)
Ma, L., Khorasani, K.: A new strategy for adaptively constructing multilayer feedforward neural networks. Neurocomputing 51(1), 361–385 (2003)
Basheer, I.A., Hajmeer, M.: Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43(1), 3–31 (2000)
Hall, M., et al.: Waikato Environment for Knowledge Analysis (2011). http://www.cs.waikato.ac.nz/ml/weka/
Duffner, S., Garcia, C.: An online backpropagation algorithm with validation error-based adaptive learning rate. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D.P. (eds.) ICANN 2007. LNCS, vol. 4668, pp. 249–258. Springer, Heidelberg (2007)
Riley, M., Karl, J., Chris, T.: A study of early stopping, ensembling, and patchworking for cascade correlation neural networks. IAENG Int. J. Appl. Math. 40(4), 307–316 (2010)
Quinlan, J.: Data mining tools See5 and C5.0 (1998)
Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. - Spec. Issue Learn. Probab. Represent. 29(2–3), 131–163 (1997)
Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, 3rd edn. Morgan Kaufmann, Boston (2011)
Hinton, G., et al.: Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process. Mag. 29(6), 82–97 (2012)
Ganatra, A., Kosta, Y.P., Panchal, G., Gajjar, C.: Initial classification through back propagation in a neural network following optimization through GA to evaluate the fitness of an algorithm. Int. J. Comput. Sci. Inf. Technol. 3(1), 98–116 (2011)
Insung, J., Wang, G.-N.: Pattern classification of back-propagation algorithm using exclusive connecting network. World Acad. Sci. 36(1), 189–193 (2007)
Mohammad, R.M., Thabtah, F., McCluskey, L.: Predicting phishing websites using neural network trained with back-propagation. In: ICAI, Las Vigas, pp. 682–686 (2013)
Lichman, M.: School of Information and Computer Sciences, University of California, Irvine (2013). http://archive.ics.uci.edu/ml/index.html
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Mohammad, R.M., Thabtah, F., McCluskey, L. (2016). An Improved Self-Structuring Neural Network. In: Cao, H., Li, J., Wang, R. (eds) Trends and Applications in Knowledge Discovery and Data Mining. PAKDD 2016. Lecture Notes in Computer Science(), vol 9794. Springer, Cham. https://doi.org/10.1007/978-3-319-42996-0_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-42996-0_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42995-3
Online ISBN: 978-3-319-42996-0
eBook Packages: Computer ScienceComputer Science (R0)