Abstract
In this paper, operational and complexity analysis model for ensemble Artificial Neural Networks (ANN) multiple classifiers are investigated. The main idea behind this, is lie on large dataset classification complexity and burden are to be moderated by using partitioning for parallel tasks and combining them to enhance the capability of a classifier. The complexity of the single ANN and ensemble ANN are obtained from the estimates of upper bounds of converged functional error with the partitioning of dataset. The estimates derived using Apriori method shows that the use of an ensemble ANN with different approach is feasible where such problem with a high number of inputs and classes can be solved with time complexity of \( {\text{O}}\left( {{\text{n}}^{\text{k}} } \right) \) for some \( {\text{k}} \), which is a type of polynomial. This result is in line with the importance of good performance achieved by diversity rule applied with the use of reordering technique. As a conclusion, an ensemble heterogeneous ANN classifier is practical and relevance to theoretical and experimental of combiners for ensemble ANN classifier systems for large dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Deep big simple neural nets excel on handwritten digit recognition. Neural Comput. 22(12), 3207–3220 (2010)
Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon, Oxford (1995)
Egmont-Petersen, M., de Ridder, D., Handels, H.: Image processing with neural networks—a review. J. Pattern Recogn. Soc. 35, 2279–2301 (2002)
Vijayalakshmi, M., Devi, M.R.: A survey of different issues of different clustering algorithms used in large data sets. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(2), 137–141 (2012)
Windeatt, T.: Accuracy diversity and ensemble MLP classifier design. IEEE Trans. Neural Netw. 17(5), 1194–1211 (2006)
Sospedra, J.T.: Ensembles of artificial neural networks: analysis and development of design methods. Ph.D. Doctoral Dissertation, Department of Computer Science and Engineering, Universitat Jaume I, Castellon (2011)
Ceamanosa, X., Waske, B., Benediktsson, J.A., Chanussot, J., Fauvele, M., Sveinsson, J.R.: A classifier ensemble based on fusion of support vector machines for classifying hyperspectral data. Int. J. Image Data Fusion 1(3), 293–307 (2010)
Alizadeh, H., Behrouz, M.B., Parvin, H.: To improve the quality of cluster ensembles by selecting a subset of base clusters. J. Exp. Theor. Artif. Intell. 26(1), 127–150 (2014)
Mohamad, M., Saman, M.Y.M., Hitam, M.S.: The use of output combiners in enhancing the performance of large data for ANNs. IAENG Int. J. Comput. Sci. 41(1), 38–47 (2014)
Zinkevich, M., Weimer, M., Li, L., Smola, A.J.: Parallelized stochastic gradient descent. In: Advances in Neural Information Processing Systems, pp. 2595–2603 (2010)
Torres-Sospedra, J., Hernández-Espinosa, C., Fernández-Redondo, M.: Introducing reordering algorithms to classic well-known ensembles to improve their performance. In: Neural Information Processing, vol. 7063, pp. 572–579. Springer, Berlin, Heidelberg (2011)
Woźniak, M., Graña, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Inf. Fusion 16, 3–17 (2014)
Shields, M.W., Casey, M.C.: A theoretical framework for multiple neural network systems. Neurocomputing 71(7–9), 1462–1476 (2008)
Babii, S.: Performance evaluation for training a distributed backpropagation implementation. In: 4th International Symposium on Applied Computational Intelligence and Informatics, Timisoara, pp. 273–278 (2007)
Yu, L., Wang, S., Lai, K.K.: Credit risk assessment with a multistage neural network ensemble learning approach. Expert Syst. Appl. 34(2), 1434–1444 (2008)
Sharma, K., Garg, D.: Complexity analysis in heterogeneous system. Comput. Inf. Sci. 2(1), 48–55 (2009)
Ghaemi, R., Sulaiman, M.N., Ibrahim, H., Mustafa, N.: A survey: clustering ensembles techniques. World Acad. Sci. Eng. Technol. 26, 636–645 (2009)
Acknowledgements
This work partially supported by Center of Research and Innovation Management of Universiti Sultan Zainal Abidin, Terengganu, Malaysia.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Mohamad, M., Saman, M.Y.M., Hamid, N.A. (2019). Complexity Approximation of Classification Task for Large Dataset Ensemble Artificial Neural Networks. In: Abawajy, J., Othman, M., Ghazali, R., Deris, M., Mahdin, H., Herawan, T. (eds) Proceedings of the International Conference on Data Engineering 2015 (DaEng-2015) . Lecture Notes in Electrical Engineering, vol 520. Springer, Singapore. https://doi.org/10.1007/978-981-13-1799-6_21
Download citation
DOI: https://doi.org/10.1007/978-981-13-1799-6_21
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1797-2
Online ISBN: 978-981-13-1799-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)