A Proposal of Hybrid Fuzzy Clustering Algorithm with Application in Condition Monitoring of Industrial Processes

  • Adrián Rodríguez-Ramos
  • Antônio José da Silva Neto
  • Orestes Llanes-SantiagoEmail author
Part of the Studies in Fuzziness and Soft Computing book series (STUDFUZZ, volume 377)


In this chapter a hybrid algorithm using fuzzy clustering techniques is presented. The algorithm is applied in a condition monitoring scheme with online detection of novel faults and automatic learning. The proposal, initially identifies the outliers based on data density. Later, the outliers are removed and the clustering process is performed. To extract the important features and improve the clustering, the maximum-entropy-regularized weighted fuzzy c-means is used. Then, the use of kernel functions is performed for clustering the data, where there is a non-linear relationship between the variables. Thus, the classification accuracy can be improved because better class separability is achieved. Next, the regulation factor of the resulting partition fuzziness (parameter m) and the Gaussian Kernel bandwidth (parameter \(\sigma \)) are optimized. The feasibility of the proposal is demonstrated by using the DAMADICS benchmark.



The authors acknowledge the financial support provided by FAPERJ, Fundacão Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro; CNPq, Conselho Nacional de Desenvolvimento Científico e Tecnológico; CAPES, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, research supporting agencies from Brazil; UERJ, Universidade do Estado do Rio de Janeiro and CUJAE, Universidad Tecnológica de La Habana José Antonio Echeverría and the help of Dr. Marcos Quiñones Grueiro (Universidad Tecnológica de La Habana José Antonio Echeverría)


  1. 1.
    Gosain, A., Dahika, S.: Performance analysis of various fuzzy clustering algorithms: a review. In: 7th International Conference on Communication. Comput. Virtualiz. 79, 100–111 (2016)CrossRefGoogle Scholar
  2. 2.
    Chi Man Vonga, K. I. W., Kin Wong, P.: Simultaneous-fault detection based on qualitative symptom descriptions for automotive engine diagnosis. Appl. Soft Comput. 22, 238–248 (2014)Google Scholar
  3. 3.
    Jiang, X.L., Wang, Q., He, B., Chen, S.J., Li, B.L.: Robust level set image segmentation algorithm using local correntropy-based fuzzy c-means clustering with spatial constraints. Neurocomputing 207, 22–35 (2016)CrossRefGoogle Scholar
  4. 4.
    Thong, P.H., Son, L.H.: Picture fuzzy clustering: a new computational intelligence method. Soft Comput. 20, 3549–3562 (2016)CrossRefGoogle Scholar
  5. 5.
    Kesemen, O., Tezel, O., Ozkul, E.: Fuzzy c-means clustering algorithm for directional data (\(fcm4dd\)). Expert Syst. Appl. 58, 76–82 (2016)CrossRefGoogle Scholar
  6. 6.
    Zhang, L., Lu, W., Liu, X., Pedrycz, W., Zhong, C.: Fuzzy c-means clustering of incomplete data based on probabilistic information granules of missing values. Knowl. Based Syst. 99, 51–70 (2016)CrossRefGoogle Scholar
  7. 7.
    Leski, J.M.: Fuzzy C-ordered-means clustering: Fuzzy Sets Syst. 286, 114–133 (2016)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Saltos, R., Weber, R.: A rough-fuzzy approach for support vector clustering. Inf. Sci. 339, 353–368 (2016)CrossRefGoogle Scholar
  9. 9.
    Aghajari, E., Chandrashekhar, G.D.: Self-Organizing Map based Extended Fuzzy C-Means (SEEFC) algorithm for image segmentation. Appl. Soft Comput. 54, 347–363 (2017)CrossRefGoogle Scholar
  10. 10.
    Kaur, P., Soni, A., Gosain, A.: Robust kernelized approach to clustering by incorporating new distance measure. Eng. Appl. Artif. Intell. 26, 833–847 (2013)CrossRefGoogle Scholar
  11. 11.
    Askari, S., Montazerin, N., Zarandi, M.H.: Generalized possibilistic fuzzy C-Means with novel cluster validity indices for clustering noisy data. Appl. Soft Comput. 53, 262–283 (2017)CrossRefGoogle Scholar
  12. 12.
    Chatzis, S.P.: A fuzzy c-means-type algorithm for clustering of data with mixed numeric and categorical attributes employing a probabilistic dissimilarity functional. Expert Syst. Appl. 38, 8684–8689 (2011)CrossRefGoogle Scholar
  13. 13.
    Kaur, P.: A density oriented fuzzy c-means clustering algorithm for recognising original cluster shapes from noisy data. Int. J. Innov. Comput. Appl. 3, 77–87 (2011)CrossRefGoogle Scholar
  14. 14.
    Ding, Y., Fu, X.: Kernel-based fuzzy c-means clustering algorithm based on genetic algorithm. Neurocomputing 188, 233–238 (2016)CrossRefGoogle Scholar
  15. 15.
    Akbulut, Y., Sengur, A., Guo, Y., Polat, K.: KNCM: kernel neutrosophic C-Means clustering. Appl. Soft Comput. 52, 714–724 (2017)CrossRefGoogle Scholar
  16. 16.
    Modha, D.S., Spangler, W.S.: Feature weighting in k-means clustering. Mach. Learn. 52, 217–237 (2003)CrossRefGoogle Scholar
  17. 17.
    Parsons, L., Haque, E., Liu, H.: Subspace clustering for high dimensional data: a review. SIGKDD Explor. 6, 90–105 (2004)CrossRefGoogle Scholar
  18. 18.
    Wang, X.Z., Wang, Y.D., Wang, L.J.: Improving fuzzy c-means clustering based on feature-weight learning. Pattern Recognit. Lett. 25, 1123–1132 (2004)CrossRefGoogle Scholar
  19. 19.
    Borgelt, C.: Feature weighting and feature selection in fuzzy clustering. Proc. IEEE Conf. Fuzzy Syst. 1, 838–844 (2008)Google Scholar
  20. 20.
    Deng, Z., Choi, K.S., Chung, F.L., Wang, S.: Enhanced soft subspace clustering integrating within-cluster and between-cluster information. Pattern Recognit. 43, 767–781 (2010)CrossRefGoogle Scholar
  21. 21.
    Ng, T.F., Pham, T.D., Jia, X.: Feature interaction in subspace clustering using the Choquet integral. Pattern Recognit. 45, 2645–2660 (2012)CrossRefGoogle Scholar
  22. 22.
    Tang, C.L., Wang, S.G., Xu, W.: New fuzzy c-means clustering model based on the data weighted approach. Data Knowl. Eng. 69, 881–900 (2010)CrossRefGoogle Scholar
  23. 23.
    Zhou, J., Chen, L., Philip Chen, C.L., Zhang, Y., Li, H.L.: Fuzzy clustering with the entropy of attribute weights. Neurocomputing 198, 125–134 (2016)CrossRefGoogle Scholar
  24. 24.
    Silva Filho, T.M., Pimentel, B.A., Souza, R.M., Oliveira, A.L.I.: Hybrid methods for fuzzy clustering based on fuzzy c-means and improved particle swarm optimization. Expert Syst. Appl. 42, 6315–6328 (2015)CrossRefGoogle Scholar
  25. 25.
    Bernal de Lázaro, J.M., Llanes-Santiago, O., Prieto Moreno, A., Knupp, D.C., Silva-Neto, A.J.: Enhanced dynamic approach to improve the detection of small-magnitude faults. Chemi. Eng. Sci. 146, 166–179 (2016)Google Scholar
  26. 26.
    Roubens, M.: Pattern classification problems and fuzzy sets. Fuzzy Sets Syst. 1, 239–253 (1978)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Hathaway, R.J., Davenport, J.W., Bezdek, J.C.: Relational duals of the c-means clustering algorithms. Pattern Recognit. 22, 205–212 (1989)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Hathaway, R.J., Bezdek, J.C.: NERF C-means: non-Euclidean relational fuzzy clustering. Pattern Recognit. 27, 429–437 (1994)CrossRefGoogle Scholar
  29. 29.
    Krishnapuram, R., Joshi A., Nasraoui, O., Yi, L.: Low-complexity fuzzy relational clustering algorithms for web mining. IEEE Trans. Fuzzy Syst. 9, 595–607 (2001)CrossRefGoogle Scholar
  30. 30.
    Dave, R., Sen, S.: Robust fuzzy clustering of relational data. IEEE Trans. Fuzzy Syst. 10, 713–727 (2002)CrossRefGoogle Scholar
  31. 31.
    Krishnapuram, R., Kim, J.: A note on the GustafsonKessel and adaptive fuzzy clustering algorithms. IEEE Trans. Fuzzy Syst. 7, 453–461 (1999)CrossRefGoogle Scholar
  32. 32.
    Li, C., Biswas G., Dale M., Dale P., Matryoshka.: A HMM based temporal data clustering methodology for modeling system dynamics. Intell. Data Anal. 6, 281–308 (2002)Google Scholar
  33. 33.
    Kasabov, N.K., Song, Q.: DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans. Fuzzy Syst. 10, 144–154 (2002)CrossRefGoogle Scholar
  34. 34.
    Aguilar, J., Lopez De Mantaras R.: The process of classification and learning the meaning of linguistic descriptors of concepts. Approx. Reason. Decis. Anal. 165–175 (1982)Google Scholar
  35. 35.
    Asuncion, A., Newman, D.: UCI machine learning repository, University of California, School of Information and Computer Science, Irvine, CA. [Online] Accessed
  36. 36.
    García, S., Herrera, F.: An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. J. Mach. Learn. Res. 9, 2677–2694 (2008)zbMATHGoogle Scholar
  37. 37.
    García, S., Molina, D., Lozano, M., Herrera, F.: A study on the use of non-parametric tests for analyzing the evolutionary algorithms behaviour: a case study on the cec 2005 special session on real parameter optimization. J. Heur. 15, 617–644 (2009)CrossRefGoogle Scholar
  38. 38.
    Luengo, J., García, S., Herrera, F.: A study on the use of statistical tests for experimentation with neural networks: analysis of parametric test conditions and non-parametric tests. Expert Syste. Appl. 36, 7798–7808 (2009)CrossRefGoogle Scholar
  39. 39.
    Li, C., Zhou, J., Kou, P., Xiao, J.: A novel chaotic particle swarm optimization based fuzzy clustering algorithm. Neurocomputing 83, 98–109 (2012)CrossRefGoogle Scholar
  40. 40.
    Pakhira, M., Bandyopadhyay, S., Maulik, S.: Validity index for crisp and fuzzy clusters. Pattern Recognit. 37, 487–501 (2004)CrossRefGoogle Scholar
  41. 41.
    Wu, K., Yang, M.: A cluster validity index for fuzzy clustering. Pattern Recognit. 26, 1275–1291 (2005)CrossRefGoogle Scholar
  42. 42.
    Camps Echevarría, L., Llanes-Santiago, O., Silva Neto, A.J.: An approach for fault diagnosis based on bio-inspired strategies. Stud. Comput. Intell. 284, 53–63 (2010)zbMATHGoogle Scholar
  43. 43.
    Liu, Q., Lv, W.: The study of fault diagnosis based on particle swarm optimization algorithm. Comput. Inf. Sci. 2, 87–91 (2009)Google Scholar
  44. 44.
    Lobato, F., Steffen Jr., F., Silva Neto, A. J.: Solution of inverse radiative transfer problems in two-layer participating media with Differential Evolution. Inverse Probl. Sci. Eng. 18, 183–195 (2009)MathSciNetCrossRefGoogle Scholar
  45. 45.
    : Bartys, M., Patton, R., Syfert, M., de las Heras, S., Quevedo. J.: Introduction to the damadics actuator FDI benchmark study. Control Eng. Pract. 14, 577–596 (2006)CrossRefGoogle Scholar
  46. 46.
    Kourd, Y., Lefebvre, D., Guersi, N.: FDI with neural network models of faulty behaviours and fault probability evaluation: application to DAMADICS. In: 8th IFAC Symposium on Fault Detection, Supervision and Safety of Technical Processes (SAFEPROCESS), pp. 744–7495 (2012)CrossRefGoogle Scholar
  47. 47.
    Yin, S., Ding, S.X., Haghani, A., Hao, H., Zhang, P.: A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process. J. Process Control 22, 1567–1581 (2012)CrossRefGoogle Scholar
  48. 48.
    Bolshakova, N., Azuaje, F.: Cluster validation techniques for genome expression data. Signal Process. 83, 825–833 (2003)CrossRefGoogle Scholar
  49. 49.
    Gunter, S. and Bunke, H.: Validation Indices for Graph Clustering. In: Jolion, J., Kropatsch, W., Vento, M. (eds.) Proceedings of the 3rd IAPR-TC15 Workshop on Graph-based Representations in Pattern Recognition, CUEN Ed., pp. 229–238. Italy(2001)Google Scholar
  50. 50.
    Rodríguez Ramos, A., Llanes-Santiago, O., Bernal de Lázaro, J.M., Cruz Corona, C., Silva Neto, A.J., Verdegay Galdeano, J.L.: A novel fault diagnosis scheme applying fuzzy clustering algorithms. Appl. Soft Comput. 58, 605–619 (2017)CrossRefGoogle Scholar
  51. 51.
    Rodríguez Ramos, A., Silva Neto, A.J., Llanes-Santiago, O.: An approach to fault diagnosis with online detection of novel faults using fuzzy clustering tools. Expert Syst. Appl. 113, 200–212 (2018)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Adrián Rodríguez-Ramos
    • 1
  • Antônio José da Silva Neto
    • 2
  • Orestes Llanes-Santiago
    • 1
    Email author
  1. 1.Departamento de Automática y ComputaciónUniversidad Tecnológica de la Habana José Antonio Echeverría, CUJAELa HabanaCuba
  2. 2.Instituto Politécnico da Universidade do Estado do Rio de Janeiro (IPRJ/UERJ)Nova FriburgoBrazil

Personalised recommendations