Skip to main content

Complexity Approximation of Classification Task for Large Dataset Ensemble Artificial Neural Networks

  • Conference paper
  • First Online:
Proceedings of the International Conference on Data Engineering 2015 (DaEng-2015)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 520))

  • 299 Accesses

Abstract

In this paper, operational and complexity analysis model for ensemble Artificial Neural Networks (ANN) multiple classifiers are investigated. The main idea behind this, is lie on large dataset classification complexity and burden are to be moderated by using partitioning for parallel tasks and combining them to enhance the capability of a classifier. The complexity of the single ANN and ensemble ANN are obtained from the estimates of upper bounds of converged functional error with the partitioning of dataset. The estimates derived using Apriori method shows that the use of an ensemble ANN with different approach is feasible where such problem with a high number of inputs and classes can be solved with time complexity of \( {\text{O}}\left( {{\text{n}}^{\text{k}} } \right) \) for some \( {\text{k}} \), which is a type of polynomial. This result is in line with the importance of good performance achieved by diversity rule applied with the use of reordering technique. As a conclusion, an ensemble heterogeneous ANN classifier is practical and relevance to theoretical and experimental of combiners for ensemble ANN classifier systems for large dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Deep big simple neural nets excel on handwritten digit recognition. Neural Comput. 22(12), 3207–3220 (2010)

    Article  Google Scholar 

  2. Bishop, C.M.: Neural Networks for Pattern Recognition. Clarendon, Oxford (1995)

    Google Scholar 

  3. Egmont-Petersen, M., de Ridder, D., Handels, H.: Image processing with neural networks—a review. J. Pattern Recogn. Soc. 35, 2279–2301 (2002)

    Article  Google Scholar 

  4. Vijayalakshmi, M., Devi, M.R.: A survey of different issues of different clustering algorithms used in large data sets. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 3(2), 137–141 (2012)

    Google Scholar 

  5. Windeatt, T.: Accuracy diversity and ensemble MLP classifier design. IEEE Trans. Neural Netw. 17(5), 1194–1211 (2006)

    Article  Google Scholar 

  6. Sospedra, J.T.: Ensembles of artificial neural networks: analysis and development of design methods. Ph.D. Doctoral Dissertation, Department of Computer Science and Engineering, Universitat Jaume I, Castellon (2011)

    Google Scholar 

  7. Ceamanosa, X., Waske, B., Benediktsson, J.A., Chanussot, J., Fauvele, M., Sveinsson, J.R.: A classifier ensemble based on fusion of support vector machines for classifying hyperspectral data. Int. J. Image Data Fusion 1(3), 293–307 (2010)

    Article  Google Scholar 

  8. Alizadeh, H., Behrouz, M.B., Parvin, H.: To improve the quality of cluster ensembles by selecting a subset of base clusters. J. Exp. Theor. Artif. Intell. 26(1), 127–150 (2014)

    Article  Google Scholar 

  9. Mohamad, M., Saman, M.Y.M., Hitam, M.S.: The use of output combiners in enhancing the performance of large data for ANNs. IAENG Int. J. Comput. Sci. 41(1), 38–47 (2014)

    Google Scholar 

  10. Zinkevich, M., Weimer, M., Li, L., Smola, A.J.: Parallelized stochastic gradient descent. In: Advances in Neural Information Processing Systems, pp. 2595–2603 (2010)

    Google Scholar 

  11. Torres-Sospedra, J., Hernández-Espinosa, C., Fernández-Redondo, M.: Introducing reordering algorithms to classic well-known ensembles to improve their performance. In: Neural Information Processing, vol. 7063, pp. 572–579. Springer, Berlin, Heidelberg (2011)

    Chapter  Google Scholar 

  12. Woźniak, M., Graña, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Inf. Fusion 16, 3–17 (2014)

    Article  Google Scholar 

  13. Shields, M.W., Casey, M.C.: A theoretical framework for multiple neural network systems. Neurocomputing 71(7–9), 1462–1476 (2008)

    Article  Google Scholar 

  14. Babii, S.: Performance evaluation for training a distributed backpropagation implementation. In: 4th International Symposium on Applied Computational Intelligence and Informatics, Timisoara, pp. 273–278 (2007)

    Google Scholar 

  15. Yu, L., Wang, S., Lai, K.K.: Credit risk assessment with a multistage neural network ensemble learning approach. Expert Syst. Appl. 34(2), 1434–1444 (2008)

    Article  Google Scholar 

  16. Sharma, K., Garg, D.: Complexity analysis in heterogeneous system. Comput. Inf. Sci. 2(1), 48–55 (2009)

    Google Scholar 

  17. Ghaemi, R., Sulaiman, M.N., Ibrahim, H., Mustafa, N.: A survey: clustering ensembles techniques. World Acad. Sci. Eng. Technol. 26, 636–645 (2009)

    Google Scholar 

Download references

Acknowledgements

This work partially supported by Center of Research and Innovation Management of Universiti Sultan Zainal Abidin, Terengganu, Malaysia.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mumtazimah Mohamad .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mohamad, M., Saman, M.Y.M., Hamid, N.A. (2019). Complexity Approximation of Classification Task for Large Dataset Ensemble Artificial Neural Networks. In: Abawajy, J., Othman, M., Ghazali, R., Deris, M., Mahdin, H., Herawan, T. (eds) Proceedings of the International Conference on Data Engineering 2015 (DaEng-2015) . Lecture Notes in Electrical Engineering, vol 520. Springer, Singapore. https://doi.org/10.1007/978-981-13-1799-6_21

Download citation

Publish with us

Policies and ethics