Abstract
Population-based clustering techniques, which attempt to integrate particle swarm optimizers (PSOs) with K-Means, have been proposed in the literature. However, the performance of these hybrid clustering methods have not been extensively analyzed and compared with other competitive clustering algorithms. In the paper, five existing PSOs, which have shown promising performance for continuous function optimization, are hybridized separately with K-Means, leading to five PSO-KM-based clustering methods. Numeric experiments on nine real-life datasets show that, in the context of numeric data clustering, there exist no significant performance differences among these PSOs, though they often show significantly different search abilities in the context of numeric function optimization. These PSO-KM-based clustering techniques obtain better and more stable solutions than some individual-based counterparts, but at the cost of higher time complexity. To alleviate the above issue, some potential improvements are empirically discussed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Jain, A.K.: Data Clustering: 50 Years Beyond K-Means. Pattern Recognition Letters. 31(8), 651–666 (2010)
Tzortzis, G., Likas, A.: The MinMax K-Means Clustering Algorithm. Pattern Recognition. 47(7), 2505–2516 (2014)
Alam, S., et al.: Research on Particle Swarm Optimization Based Clustering: A Systematic Review of Literature and Techniques. Swarm and Evolutionary Computation. 17, 1–13 (2014)
Merwe, D.W., Engelbrecht, A.P.: Data clustering using particle swarm optimization. In: The 2003 Congress on Evolutionary Computation, CEC 2003, pp. 215–220. IEEE (2003)
Chen, J., Zhang, H.: Research on application of clustering algorithm based on PSO for the web usage pattern. In: The 2007 International Conference on Wireless Communications, Networking and Mobile Computing, WiCom 2007, pp. 3705–3708. IEEE (2007)
Lin Y., et al: K-means optimization clustering algorithm based on particle swarm optimization and multiclass merging. In: Advances in Computer Science and Information Engineering, pp. 569–578. Springer (2012)
Alam, S., et al: An evolutionary particle swarm optimization algorithm for data clustering. In: The Proceedings of IEEE Swarm Intelligence Symposium, pp. 1–6 (2008)
Abbas, A., Fakhri, K., Mohamed, S.K.: Flocking Based Approach for Data Clustering. Natural Computing 9(3), 767–794 (2010)
Niknam, T., Amiri, B.: An Efficient Hybrid Approach Based on PSO, ACO and K-Means for Cluster Analysis. Applied Soft Computing 10(1), 183–197 (2010)
Chen, C.Y., Fun, Y.: Particle swarm optimization algorithm and its application to clustering analysis. In: The Proceedings of 17th Conference on Electrical Power Distribution Networks (EPDC), pp. 789–794 (2012)
Cohen, S.C.M., Castro, L.N.: Data clustering with particle swarms. In: The Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1792–1798. IEEE (2006)
Omran, M.G.H., Salman, A., Engelbrecht, A.P.: Dynamic Clustering Using Particle Swarm Optimization with Application in Image Segmentation. Pattern Analysis and Applications. 8(4), 332–344 (2005)
Kao, Y.T., Zahara, E., Kao, I.W.: A Hybridized Approach to Data Clustering. Expert Systems with Applications. 34(3), 1754–1762 (2008)
Alam, S., et al: Particle swarm optimization based hierarchical agglomerative clustering. In: The 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), pp. 64–68. IEEE (2010)
Yuwono, M., et al.: Data Clustering Using Variants of Rapid Centroid Estimation. IEEE Transactions on Evolutionary Computation 18(3), 366–377 (2014)
Rana, S., et al.: A Review on Particle Swarm Optimization Algorithms and Their Applications to Data Clustering. Artificial Intelligence Review 35(3), 211–222 (2011)
Radha, T., et al.: Particle Swarm Optimization: Hybridization Perspectives and Experimental Illustrations. Applied Mathematics and Computation 217(12), 5208–5226 (2011)
Mohamed, J.A.H., Sivakumar, R.: A Survey: Hybrid Evolutionary Algorithms for Clustering Analysis. Artificial Intelligence Review 36(3), 179–204 (2011)
Ratnaweera, A., Halgamuge, S., Watson, H.C.: Self-Organizing Hierarchical Particle Swarm Optimizer with Time-Varying Acceleration Coefficients. IEEE Transactions on Evolutionary Computation 8(3), 240–255 (2004)
Shi, Y., Eberhart, R.C.: A modified particle swarm optimizer. In: The Proceedings of IEEE Congress on Evolutionary Computation, pp. 69–73. IEEE (1998)
Eberhart, R.C., Shi, Y.: Comparing inertia weights and constriction factors in particle swarm optimization. In: The Proceedings of the Congress on Evolutionary Computation, pp. 84–88. IEEE (2000)
Clerc, M., Kennedy, J.: The Particle Swarm-Explosion, Stability, and Convergence in A Multidimensional Complex Space. IEEE Transactions on Evolutionary Computation 6(1), 58–73 (2002)
Mendes, B., Kennedy, J., Neves, J.: The Fully Informed Particle Swarm: Simpler, Maybe Better. IEEE Transactions on Evolutionary Computation 8(3), 204–210 (2004)
Liang, J.J., Qin, A.K., Suganthan, P.N., Baskar, S.: Comprehensive Learning Particle Swarm Optimizer for Global Optimization of Multimodal Functions. IEEE Transactions on Evolutionary Computation 10(3), 281–295 (2006)
Das, S., Abraham, A., Konar, A.: Automatic Clustering Using an Improved Differential Evolution Algorithm. IEEE Transactions on System, Man, and Cybernetics-Part A: Systems and Human 38(1), 218–237 (2008)
Bradley, P.S., Fayyad, U.M.: Refining Initial Points for K-Means Clustering. Microsoft Research (1998). http://research.microsoft.com/apps/pubs/default.aspx?id=68490 (MSR-TR-98-36)
Peñal, J.M., et al.: An Empirical Comparison of Four Initialization Methods for the K-Means Algorithm. Pattern Recognition Letters 20(10), 1027–1040 (1999)
Zhang, H., Yang, Z.R., Oja, E.: Improving Cluster Analysis by Co-initializations. Pattern Recognition Letters. 45(1), 71–77 (2014)
Davies, D., Bouldin, D.: A Cluster Separation Measure. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1(2), 224–227 (1979)
Rousseeuw, P.J.: Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis. Journal of Computational and Applied Mathematics. 20, 53–65 (1987)
Tsai, C.W., et al: A Fast Particle Swarm Optimization for Clustering. Soft Computing, 1–18 (2014)
Chioua, Y.C., Lan, L.W.: Genetic Clustering Algorithms. European Journal of Operational Research 135(2), 413–427 (2001)
Pham, D.T., Dimov, S.S., Nguyen C.D.: Selection of K in K-means Clustering (2005). http://www.ee.columbia.edu/~dpwe/papers/PhamDN05-kmeans.pdf
Milligan, G.W., Cooper, M.C.: An Examination of Procedures for Determining the Number of Clusters in a Data Set. Psychometrika 50(2), 159–179 (1985)
Hruschka, E.R., et al.: A Survey of Evolutionary Algorithms for Clustering. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews. 39(2), 133–155 (2009)
UCI Machine Learning Repository. University of California, Irvine, CA. http://archive.ics.uci.edu/ml/ (lasted visited April 15, 2015)
Lloyd, S.P.: Least Squares Quantization in PCM. IEEE Transaction Information Theory. 28(2), 129–137 (1982)
MacQueen, J.: Some Methods for Classification and Analysis of Multivariate Observations. In: The Proceedings of the Fifth Berkeley Symposium on Mathematics Statistics and Probability, pp. 281–296 (1967)
Hartigan, J.A., Wong, M.A.: Algorithm AS 136: A K-Means Clustering Algorithm. Applied Statistics, 100–108 (1979)
Source Code of five PSO-KM-based clustering algorithms and Related Data. http://share.weiyun.com/31ed301f38f47c7de9e84d2ba88ec0f9 (last update April 15, 2015)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Niu, B., Duan, Q., Tan, L., Liu, C., Liang, P. (2015). A Population-Based Clustering Technique Using Particle Swarm Optimization and K-Means. In: Tan, Y., Shi, Y., Buarque, F., Gelbukh, A., Das, S., Engelbrecht, A. (eds) Advances in Swarm and Computational Intelligence. ICSI 2015. Lecture Notes in Computer Science(), vol 9140. Springer, Cham. https://doi.org/10.1007/978-3-319-20466-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-20466-6_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-20465-9
Online ISBN: 978-3-319-20466-6
eBook Packages: Computer ScienceComputer Science (R0)