Skip to main content

Stability-Based Model Order Selection for Clustering Using Multiple Cooperative Particle Swarms

  • Chapter
Foundations of Computational Intelligence Volume 4

Part of the book series: Studies in Computational Intelligence ((SCI,volume 204))

Summary

Data clustering is the organization of a set of unlabelled data into similar groups. In this chapter, stability analysis is proposed to determine the model order of the underlying data using multiple cooperative swarms clustering. The mathematical explanations demonstrating why multiple cooperative swarms clustering leads to more stable and robust results than those of single swarm clustering are also provided. The proposed approach is evaluated using different data sets and its performance is compared with that of other clustering techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abraham, A., Guo, H., Liu, H.: Swarm Intelligence: Foundations. In: Nedjah, N., Mourelle, L. (eds.) Perspectives and Applications, Swarm Intelligent Systems. Studies in Computational Intelligence. Springer, Germany (2006)

    Google Scholar 

  2. Kazemian, M., Ramezani, Y., Lucas, C., Moshiri, B.: Swarm Clustering Based on Flowers Pollination by Artificial Bees. In: Abraham, A., Grosan, C., Ramos, V. (eds.) Swarm Intelligence in Data Mining, pp. 191–202. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  3. Ahmadi, A., Karray, F., Kamel, M.: Multiple Cooperating Swarms for Data Clustering. In: Proceeding of the IEEE Swarm Intelligence Symposium (SIS 2007), pp. 206–212 (2007)

    Google Scholar 

  4. Ahmadi, A., Karray, F., Kamel, M.: Cooperative Swarms for Clustering Phoneme Data. In: Proceeding of the IEEE Workshop on Statistical Signal Processing (SSP 2007), pp. 606–610 (2007)

    Google Scholar 

  5. Cui, X., Potok, T.E., Palathingal, P.: Document Clustering Using Particle Swarm Optimization. In: Proceeding of the IEEE Swarm Intelligence Symposium (SIS 2005), pp. 185–191 (2005)

    Google Scholar 

  6. Xiao, X., Dow, E.R., Eberhart, R., Miled, Z.B., Oppelt, R.: Gene Clustering Using Self-Organizing Maps and Particle Swarm Optimization. In: Proceeding of International Parallel Processing Symposium (IPDPS 2003), 10 p. (2003)

    Google Scholar 

  7. Eberhart, R., Kennedy, J.: A New Optimizer Using Particle Swarm Theory. In: Proceeding of 6th Int. Symp. Micro Machine and Human Scince, pp. 39–43 (1995)

    Google Scholar 

  8. Eberhart, R., Kennedy, J.: Particle Swarm Optimization. In: Proceeding of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)

    Google Scholar 

  9. Halkidi, M., Vazirgiannis, M.: Clustering Validity Assessment: Finding the Optimal Partitioning of a Data Set. In: Proceeding of the IEEE International Conference on Data Mining (ICDM 2001), pp. 187–194 (2001)

    Google Scholar 

  10. Van der Merwe, D.W., Engelbrecht, P.: Data Clustering Using Particle Swarm Optimization. In: Proceeding of the IEEE Congress on Evolutionary Computation, pp. 215–220 (2003)

    Google Scholar 

  11. Ahmadi, A., Karray, F., Kamel, M.S.: Model order selection for multiple cooperative swarms clustering using stability analysis. In: Proceeding of the IEEE Congress on Evolutionary Computation (IEEE CEC 2006), pp. 3387–3394 (2008)

    Google Scholar 

  12. Engelbrecht, A.P.: Fundamentals of Computational Swarm Intelligence. John Wiley and Sons, Chichester (2005)

    Google Scholar 

  13. Kennedy, J., Eberhart, R., Shi, Y.: Swarm Intelligence. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  14. Duda, R., Hart, P., Stork, D.: Pattern Classification. John Wiley & Sons, Chichester (2000)

    Google Scholar 

  15. Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algoritms. Plenum Press, New York (1981)

    Google Scholar 

  16. Sharkey, A.: Combining Artificial Neural Networks. Springer, Heidelberg (1999)

    Google Scholar 

  17. Zhang, Z., Hsu, M.: K-Harmonic Means – A Data Clustering Algorithm, Technical Report in Hewlett-Packard Labs, HPL-1999-124

    Google Scholar 

  18. Turi, R.H.: Clustering-Based Colour Image Segmentation, PhD Thesis in Monash University (2001)

    Google Scholar 

  19. Omran, M., Salman, A., Engelbrecht, E.P.: Dynamic Clustering Using Particle Swarm Optimization with Application in Image Segmentation. Pattern Analysis and Applications 6, 332–344 (2006)

    Article  MathSciNet  Google Scholar 

  20. Omran, M., Engelbrecht, E.P., Salman, A.: Particle Swarm Optimization Method for Image Clustering. International Journal of Pattern Recognition and Artificial Intelligence 19(3), 297–321 (2005)

    Article  Google Scholar 

  21. Van den Bergh, F., Engelbrecht, E.P.: A Cooperative Approach to Particle Swarm Optimization. IEEE Transactions on Evolutionary Computing 8(3), 225–239 (2004)

    Article  Google Scholar 

  22. Dunn, J.C.: A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters. Cybernetics 3, 32–57 (1973)

    Article  MATH  MathSciNet  Google Scholar 

  23. Cui, X., Gao, J., Potok, T.E.: A Flocking Based Algorithm for Document Clustering Analysis. Journal of Systems Architecture 52(8-9), 505–515 (2006)

    Article  Google Scholar 

  24. Halkidi, M., Batistakis, Y., Vazirgiannis, M.: On Clustering Validation Techniques. Intelligent Information Systems 17(2-3), 107–145 (2001)

    Article  MATH  Google Scholar 

  25. Xiao, X., Dow, E., Eberhart, R., Miled, Z., Oppelt, R.: A Hybrid Self-Organizing Maps and Particle Swarm Optimization Approach. Concurrency and Computation: Practice and Experience 16(9), 895–915 (2004)

    Article  Google Scholar 

  26. Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., Shikano, K., Lang, L.: Phoneme Recognition Using Time-Delay Neural Networks. IEEE Transactions on Acoustics, Speech and Signal Processing 37(3), 328–339 (1989)

    Article  Google Scholar 

  27. Auda, G., Kamel, M.S.: Modular Neural Networks: A Survey. International Journal of Neural Systems 9(2), 129–151 (1999)

    Article  Google Scholar 

  28. Jain, A.K., Murty, M.N., Flynn, P.J.: Data Clustering: A Review. IACM Computing Surveys 31(3), 264–323 (1999)

    Article  Google Scholar 

  29. Lange, T., Roth, V., Braun, M.L., Buhmann, J.M.: Stability-Based Validation of Clustering Solutions. Neural Computing 16, 1299–1323 (2004)

    Article  MATH  Google Scholar 

  30. Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Ahmadi, A., Karray, F., Kamel, M.S. (2009). Stability-Based Model Order Selection for Clustering Using Multiple Cooperative Particle Swarms. In: Abraham, A., Hassanien, AE., de Carvalho, A.P.d.L.F. (eds) Foundations of Computational Intelligence Volume 4. Studies in Computational Intelligence, vol 204. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01088-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01088-0_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01087-3

  • Online ISBN: 978-3-642-01088-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics