Advertisement

Unsupervised learning Clustering methods

  • Ernest Czogała
  • Jacek Łęski
Part of the Studies in Fuzziness and Soft Computing book series (STUDFUZZ, volume 47)

Abstract

In the learning method described in the previous chapter we assume that we have target (desired) output of network for inputs from training data set. In contrast to that, in this chapter we use data set without the desired output of network. Such an approach to network learning without a teacher or supervisor is called an unsupervised method. The effect of that learning are features, regularities and structure of data extraction, and sometimes it is called a method that search for structures of data. For example in biology and medicine, where sets of physical and biochemical measurements define species and diseases, respectively, unsupervised methods are very useful. In this book unsupervised methods will be used to search fuzzy if-then rules. Grouping found by unsupervised methods is frequently referred to as clusters. The cluster is a natural and homogeneous subset of data. The data in each cluster are as similar as possible to each other, and as different (dissimilar) as possible from other cluster’s data.

Keywords

Cluster Center Data Vector Vector Quantization Unsupervised Learning Learning Vector Quantization 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Bibliographical notes

  1. Duda, R.O., Hart, P.E. (1973): Pattern classification and scene analysis. John Wiley and Sons, New YorkMATHGoogle Scholar
  2. Fukunaga, K. (1990): Introduction to statistical pattern recognition. 2nd edn. Academic Press, San DiegoMATHGoogle Scholar
  3. Ripley, B.D. (1996): Pattern recognition and neural network. Cambridge University Press, Cambridge New York MelbourneGoogle Scholar
  4. Tou, J.T., Gonzalez, R.C. (1974): Pattern recognition principles. Adison-Wesley, LondonMATHGoogle Scholar
  5. Bezdek, J.C., Pal, S.K. (eds.) (1992): Fuzzy models for pattern recognition. Methods that search for structures in data. IEEE Press, New YorkGoogle Scholar
  6. Bezdek, J.C. (1982): Pattern recognition with fuzzy objective function algorithms. Plenum Press, New York LondonGoogle Scholar
  7. Bezdek, J.C., Hathaway, R.J., Sabin, M.J., Tucker, W.T. (1987): Convergence theory for fuzzy c-means: counterexamples and repairs. IEEE Trans. System, Man and Cybernetics 17 (5), 873–877MATHGoogle Scholar
  8. Davé, R.N., Krishnapuram, R. (1997): Robust clustering methods: a unified view. IEEE Trans. Fuzzy Systems 5 (2), 270–293CrossRefGoogle Scholar
  9. Karayiannis, N.B., Bezdek, J.C., Pal, N.R., Hathaway, R.J., Pai, P.-I. (1996): Repairs to GLVQ: a new family of competitive learning schemes. IEEE Trans. Neural Networks 7 (5), 1062–1071CrossRefGoogle Scholar
  10. Karayiannis, N.B., Pai, P.-I. (1996): Fuzzy algorithms for learning vector quantization. IEEE Trans. Neural Networks 7 (5), 1196–1211CrossRefGoogle Scholar
  11. Karayiannis, N.B., Bezdek, J.C. (1997): An integrated approach to fuzzy learning vector quantization and fuzzy c-means clustering. IEEE Trans. Fuzzy Systems 5(4),’622–628Google Scholar
  12. Krishnapuram, R., Kim, J. (1996): A clustering algorithm based on minimum volume, Proceedings of the Fifth IEEE International Conference on Fuzzy System, IEEE Press, 1387–1392Google Scholar
  13. Sato, M., Sato, Y., Jain, L.C. (1997): Fuzzy clustering models and applications. Springer, New York Scales, L.E. ( 1985 ): Introduction to nonlinear optimization. Macmillan, LondonGoogle Scholar
  14. Bezdek, J.C., Harris, J.D. (1978): Fuzzy partitions and relations; An axiomatic basis for clustering. Fuzzy Sets and Systems 1, 111–127Google Scholar
  15. Chen, C.H. (ed.) (1996): Fuzzy logic and neural network handbook. McGraw-Hill, Inc., New YorkGoogle Scholar
  16. Pedrycz, W. (1998): Conditional fuzzy clustering in the design of radial basis function neural network. IEEE Trans. Neural Networks 9 (4), 601–612CrossRefGoogle Scholar
  17. Imai, H., Tanaka, A., Miyakoshi, M. (1998): A method of identifying influential data in fuzzy clustering. IEEE Trans. Fuzzy Systems 6 (1), 90–101CrossRefGoogle Scholar
  18. Rose, K., Gurewitz, E., Fox, G.C. (1992): Vector quantization by deterministic annealing IEEE Trans. Information Theory 38 (4), 1249–1257MATHCrossRefGoogle Scholar
  19. Rose, K., Gurewitz, E., Fox, G.C. (1993): Constrained clustering as an optimization method. IEEE Trans. Pattern Analysis and Machine Intelligence 15 (8), 785–794CrossRefGoogle Scholar
  20. Windham, M.P. (1982): Cluster validity for the fuzzy c-means clustering algotithm. IEEE Trans. Pattern Analysis and Machine Intelligence 4 (4), 357–363CrossRefGoogle Scholar
  21. Tsao, E.C.-K., Bezdek, J.C., Pal, N.R. (1994): Fuzzy Kohonen clustering networks. Pattern Recognition 27 (5), 757–764CrossRefGoogle Scholar
  22. Pal, N.R., Bezdek, J.C. (1995): On cluster validity for the fuzzy c-means model. IEEE Trans. Fuzzy Systems 3 (3), 370–379CrossRefGoogle Scholar
  23. Rhee, H.-S., Oh, K.-W. (1996): A validity measure for fuzzy clustering and its use in selecting optimal number of clusters. Proceedings of the Fifth IEEE International Conference on Fuzzy System, IEEE Press, 1020–1025Google Scholar
  24. Flores-Sintas, A., Cadenas, J.M., Martin, F. (1998): A local geometrical properties application to fuzzy clustering. Fuzzy Sets and Systems 100, 245–256MathSciNetCrossRefGoogle Scholar
  25. Flores-Sintas, A., Cadenas, J.M., Martin, F. (1999): Membership functions in the fuzzy C-means algorithm. Fuzzy Sets and Systems 101, 49–58CrossRefGoogle Scholar
  26. Bajcsy, P., Ahuja, N. (1998): Location-and density-based hierarchical clustering using similarity analysis. IEEE Trans. Pattern Analysis and Machine Intelligence 20 (9), 1011–1015CrossRefGoogle Scholar
  27. Beni, G., Liu, X. (1994): A least biased fuzzy clustering method. IEEE Trans. Pattern Analysis and Machine Intelligence 16 (9), 954–960CrossRefGoogle Scholar
  28. Cheng, T.W.C., Goldgof, D.B., Hall, L.O. (1998): Fast fuzzy clustering. Fuzzy Sets and Systems 93, 49–56MATHCrossRefGoogle Scholar
  29. El-Sonbaty, Y., Ismail, M.A. (1998): Fuzzy clustering for symbolic data. IEEE Trans. Fuzzy Systems 6 (2), 195–204CrossRefGoogle Scholar
  30. Eltoft, T., deFigueiredo, R.J.P. (1998): A new neural network for cluster-detection-and-labeling. IEEE Trans. Neural Networks 9 (5), 1021–1035CrossRefGoogle Scholar
  31. Gath, I., Geva, A.B. (1989): Unsupervised optimal fuzzy clustering. IEEE Trans. Pattern Analysis and Machine Intelligence 11 (7), 773–781CrossRefGoogle Scholar
  32. Li, R.-P., Mukaidono, M. (1999): Gaussian clustering method based on maximum-fuzzy-entropy interpretation. Fuzzy Sets and Systems 102, 253–258MathSciNetMATHCrossRefGoogle Scholar
  33. Windham, M.P. (1983): Geometrical fuzzy clustering algorithms. Fuzzy Sets and Systems 10, 27 1279Google Scholar
  34. Mitra, S., Pal, S.K. (1996): Fuzzy self-organization, inferencing and rule generation. IEEE Trans. System, Man and Cybernetics 26 (5), 608–619CrossRefGoogle Scholar

Copyright information

© Physica-Verlag Heidelberg 2000

Authors and Affiliations

  • Ernest Czogała
    • 1
  • Jacek Łęski
    • 1
  1. 1.Institute of ElectronicsSilesian University of TechnologyGliwicePoland

Personalised recommendations