Skip to main content
SpringerLink
Log in

Advanced Developments and Applications of the Fuzzy ARTMAP Neural Network in Pattern Classification

  • Chapter
Book cover Computational Intelligence Paradigms

Part of the book series: Studies in Computational Intelligence ((SCI,volume 137))

Abstract

Since its inception in 1992, the fuzzy ARTMAP (FAM) neural network (NN) has attracted researchers’ attention as a fast, accurate, off and online pattern classifier. Since then, many studies have explored different issues concerning FAM optimization, training and evaluation, e.g., model sensitivity to parameters, ordering strategy for the presentation of the training patterns, training method and method of predicting the classification accuracy. Other studies have suggested variants to FAM to improve its generalization capability or overcome the prime limitation of the model, which is category proliferation (i.e., model complexity that increases with data complexity). Category proliferation is pronounced in problems that are noisy or contain a large degree of class statistical overlapping. In many investigations, FAM was improved by incorporating elements of optimization theory, Bayes’ decision theory, evolutionary learning, and cluster analysis. Due to its appealing characteristics, FAM and its variants have been applied extensively and successfully to real-world classification problems. Numerous applications were reported in, for example, the processing of signals from different sources, images, speech, and text; recognition of speakers, image objects, handwritten, and genetic abnormalities; and medical and fault diagnoses. When compared to other state-of-the-art machine learning classifiers, FAM and its variants showed superior speed and ease of training, and in most cases they delivered comparable classification accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bishop, C.M.: Neural networks for pattern recognition. Clarendon Press, Oxford (1995)

    Google Scholar 

  2. Vapnik, V.: The nature of statistical learning theory. Springer, New York (1995)

    MATH  Google Scholar 

  3. Heinke, D., Hamker, F.H.: Comparing neural networks: A benchmark on growing neural gas, growing cell structures, and fuzzy ARTMAP. IEEE Transactions on Neural Networks 9, 1279–1291 (1998)

    Article  Google Scholar 

  4. Carpenter, G.A., Grossberg, S., Markuzon, N., Reynolds, J., Rosen, D.: Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Transactions on Neural Networks 3, 698–713 (1992)

    Article  Google Scholar 

  5. Grossberg, S.: Adaptive pattern recognition and universal encoding II: Feedback, expectation, olfaction, and illusions. Biological Cybernetics 23, 187–202 (1976)

    Article  MathSciNet  Google Scholar 

  6. Carpenter, G.A., Grossberg, S., Reynolds, J.H.: ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks 4, 565–588 (1991)

    Article  Google Scholar 

  7. Marriott, S., Harrison, R.F.: A modified fuzzy ARTMAP architecture for the approximation of noisy mappings. Neural Networks 8, 619–641 (1995)

    Article  Google Scholar 

  8. Rubin, M.A.: Application of fuzzy ARTMAP and ART-EMAP to automatic target recognition using radar range profiles. Neural Networks 8, 1109–1116 (1995)

    Article  Google Scholar 

  9. Williamson, J.R.: Gaussian ARTMAP: A neural network for fast incremental learning of noisy multidimensional maps. Neural Networks 9, 881–897 (1996)

    Article  Google Scholar 

  10. Gomez-Sanchez, E., Dimitriadis, Y.A., Cano-Izquierdo, J.M., Lopez-Coronado, J.: μ ARTMAP: Use of mutual information for category reduction in fuzzy ARTMAP. IEEE Transactions on Neural Networks 13, 58–69 (2002)

    Article  Google Scholar 

  11. Suzuki, Y.: Self-organizing QRS-wave recognition in ECG using neural networks. IEEE Transactions on Neural Networks 6, 1469–1477 (1995)

    Article  Google Scholar 

  12. Carpenter, G.A., Markuzon, N.: ARTMAP-IC and medical diagnosis: Instance counting and inconsistent cases. Neural Networks 11, 323–336 (1998)

    Article  Google Scholar 

  13. Carpenter, G.A., Ross, W.D.: ART-EMAP: A neural network architecture for object recognition by evidence accumulation. IEEE Transactions on Neural Networks 6, 805–818 (1995)

    Article  Google Scholar 

  14. Charalampidis, D., Kasparis, T., Georgiopoulos, M.: Classification of noisy signals using fuzzy ARTMAP neural networks. IEEE Transactions on Neural Networks 12, 1023–1036 (2001)

    Article  Google Scholar 

  15. Palaniappan, R., Raveendran, P., Omatu, S.: VEP optimal channel selection using genetic algorithm for neural network classification of alcoholics. IEEE Transactions on Neural Networks 13, 486–491 (2002)

    Article  Google Scholar 

  16. Vigdor, B., Lerner, B.: Accurate and fast off and online fuzzy ARTMAP-based image classification with application to genetic abnormality diagnosis. IEEE Transactions on Neural Networks 17, 1288–1300 (2006)

    Article  Google Scholar 

  17. Lakhmi, J.C., Lazzerini, B., Halici, U. (eds.): Innovations in ART neural networks. Studies in Fuzziness and Soft Computing, vol. 43. Springer, Heidelberg (2000)

    MATH  Google Scholar 

  18. Tan, A.H.: Cascade ARTMAP: Integrating neural computation and symbolic knowledge processing. IEEE Transactions on Neural Networks 8, 237–250 (1997)

    Article  Google Scholar 

  19. Ramuhalli, P., Polikar, R., Udpa, L., Udpa, S.S.: Fuzzy ARTMAP network with evolutionary learning. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2000), pp. 3466–3469 (2000)

    Google Scholar 

  20. Murshed, N.A., Bortolozzi, F., Sabourin, R.: Off-line signature verification using fuzzy ARTMAP neural network. In: Proceedings of the IEEE International Conference on Neural Networks (ICNN 1995), pp. 2179–2184 (1995)

    Google Scholar 

  21. Aggarwal, R., Xuan, Q.Y., Johns, T., Li, F., Bennett, A.: A novel approach to fault diagnosis in multicircuit transimission lines using fuzzy ARTMAP neural networks. IEEE Transactions on Neural Networks 10, 1214–1221 (1999)

    Article  Google Scholar 

  22. Hush, D.R., Abdallah, C.T., Heileman, G.L., Docampo, D.: Neural networks in fault detection: A case study. In: Proceedings of the Americam Control Conference, pp. 918–921 (1997)

    Google Scholar 

  23. Granger, E., Rubin, M.A., Grossberg, S., Lavoie, P.: Classification of incomplete data using the fuzzy ARTMAP neural network. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN 2000), pp. 35–40 (2000)

    Google Scholar 

  24. Dagher, I., Georgiopoulos, M., Heilman, G., Bebis, G.: An ordering algorithm for pattern presentation in fuzzy ARTMAP that tends to improve generalization performnace. IEEE Transactions on Neural Networks 10, 768–778 (1999)

    Article  Google Scholar 

  25. Hernandez, E.P., Sanchez, E.G., Dimitriadis, Y.A.: Study of distributed learning as a solution of category proliferation in fuzzy ARTMAP based neural systems. Neural Networks 16, 1039–1057 (2003)

    Article  Google Scholar 

  26. Lin, T.H., Soo, V.W.: Pruning fuzzy ARTMAP using the minumum description length principle in learning from clinical databases. In: Proceedings of the 9th International Conference on Tools with Artificial Intelligence (ICTAI 1997), pp. 396–403 (1997)

    Google Scholar 

  27. Koufakou, A., Georgiopoulos, M., Anagnostopoulos, G., Kasparis, T.: Cross-validation in fuzzy ARTMAP for large databases. Neural Networks 14, 1279–1291 (2001)

    Article  Google Scholar 

  28. Al-Daraiseh, A., Kaylani, A., Georgiopoulos, M., Mollaghasemi, M., Wu, A.S., Anagnostopoulos, G.: GFAM: Evolving fuzzy ARTMAP neural networks. Neural Networks 20, 874–892 (2007)

    Article  MATH  Google Scholar 

  29. Vigdor, B., Lerner, B.: The Bayesian ARTMAP. IEEE Transactions on Neural Networks 18, 1628–1644 (2007)

    Article  Google Scholar 

  30. Carpenter, G.A., Grossberg, S., Rosen, D.: Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks 4, 759–771 (1991)

    Article  Google Scholar 

  31. Heilman, G., Bebis, G., Georgiopoulos, M.: Order of search in fuzzy ART and fuzzy ARTMAP: Effect of the choice parameter. Neural Networks 9, 1541–1559 (1996)

    Article  Google Scholar 

  32. Granger, E., Henniges, P., Sabourin, R., Oliveira, L.S.: Supervised learning of fuzzy ARTMAP neural networks through particle swarm optimization. Journal of Pattern Recognition Research 1, 27–60 (2007)

    Google Scholar 

  33. Taghi, M., Baghmisheh, V., Pavesic, N.: A fast simplified fuzzy ARTMAP network. Neural Processing Letters 17, 273–316 (2003)

    Article  Google Scholar 

  34. Kasuba, T.: Simplified fuzzy ARTMAP network. AI Expert 8, 18–25 (1993)

    Google Scholar 

  35. Su, M.C., Lu, W.Z., Lee, J., Chen, G.D., Hsieh, C.C.: The MSFAM: A modified fuzzy ARTMAP system. Pattern Analysis and Applications 8, 1–16 (2005)

    Article  MathSciNet  Google Scholar 

  36. Carpenter, G.A., Milenova, B.L., Noeske, B.W.: Distributed ARTMAP: A neural network for fast distributed supervised learning. Neural Networks 11, 793–813 (1998)

    Article  Google Scholar 

  37. Blume, M., Van Blerkom, D.A., Esner, S.C.: Fuzzy ARTMAP modifications for intersecting class distributions. In: Proceedings of the World Congress on Neural Networks (WCNN 1996), pp. 250–255 (1996)

    Google Scholar 

  38. Carpenter, G.A., Tan, A.H.: Classification of incomplete data using the fuzzy ARTMAP neural network. In: Proceedings of the World Congress on Neural Networks (WCNN 1993), pp. 501–506 (1993)

    Google Scholar 

  39. Rissanen, J.: A universal prior for integers and estimation by minimum description length. Annals of Statistics 11, 416–431 (1983)

    Article  MATH  MathSciNet  Google Scholar 

  40. Lim, C.P., Harrison, R.F.: An incremental adaptive network for online supervized learning and probability estimation. Neural Networks 10, 925–939 (1997)

    Article  Google Scholar 

  41. Specht, D.F.: Probabilistic neural networks. Neural Networks 3, 109–118 (1990)

    Article  Google Scholar 

  42. Lim, C.P., Harrison, R.F.: Modified fuzzy ARTMAP approaches Bayes optimal classification rates: An empirical demonstration. Neural Networks 10, 755–774 (1997)

    Article  Google Scholar 

  43. Lavoie, P., Crespo, J.F., Savaria, Y.: Generalizaion, discrimination, and multiple categorization using adaptive resonance theory. IEEE Transactions on Neural Networks 10, 757–767 (1999)

    Article  Google Scholar 

  44. Andonie, R., Sasu, L.: A fuzzy ARTMAP probability estimator with relevance factor. In: Proceedings of the 11th European Symposium on Artificial Neural Networks (ESANN 2003), pp. 367–372 (2003)

    Google Scholar 

  45. Andonie, R., Sasu, L.: Fuzzy ARTMAP with input relevances. IEEE Transactions on Neural Networks 17, 929–941 (2006)

    Article  Google Scholar 

  46. Tan, S.C., Rao, M.V.C., Lim, C.P.: Fuzzy ARTMAP dynamic decay adjustment: An improved fuzzy ARTMAP with a conflict resolving facility. Applied Soft Computing 8, 543–554 (2008)

    Article  Google Scholar 

  47. Verzi, S.J., Heileman, G.L., Georgiopoulos, M., Healy, M.J.: Boosting the performance of ARTMAP. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN 1998), pp. 396–401 (1998)

    Google Scholar 

  48. Verzi, S.J., Heileman, G.L., Georgiopoulos, M., Healy, M.J.: Rademacher penalization applied to fuzzy ARTMAP and boosted ARTMAP. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN 2001), pp. 1191–1196 (2001)

    Google Scholar 

  49. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern classification, 2nd edn. Wiley, NY (2001)

    MATH  Google Scholar 

  50. Parsons, O., Carpenter, G.A.: ARTMAP neural networks for information fusion and data mining: Map production and target recognition methodologies. Neural Networks 16, 1075–1089 (2003)

    Article  Google Scholar 

  51. Fukunaga, K.: Introduction to statistical pattern recognition, 2nd edn. Academic Press, San Diego (1990)

    MATH  Google Scholar 

  52. Howell, O.C.: Statistical methods for Psychology. Duxbury Press, Belmont (1992)

    Google Scholar 

  53. Quinlan, J.R.: The effect of noise on concept learning. In: Michalski, R.S., Carbonell, J.C., Mitchell, T. (eds.) Machine learning: An artificial intelligence approach, pp. 149–166. Morgan Kaufmann, San Mateo (1986)

    Google Scholar 

  54. Blake, C., Merz, C.: UCI repository of machine learning databases (1998), www.ics.uci.edu/~mlearn/MLRepository.html

  55. Kohonen, T.: Self-organization and associative memory, 2nd edn. Springer, Berlin (1998)

    Google Scholar 

  56. Tay, Y.H., Khalid, M.: Comparison of fuzzy ARTMAP and MLP neural networks for hand-written character recognition. In: Proceedings of the IFAC Symposium on AI in Real-Time Control (AIRTC 1997), pp. 363–371 (1997)

    Google Scholar 

  57. Carpenter, G.A., Tan, A.H.: Rule extraction: From neural architecture to symbolic representation. Connection Science 7, 3–26 (1995)

    Article  Google Scholar 

  58. Quinlan, J.R.: C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo (1993)

    Google Scholar 

  59. Akley, D.H., Hinton, G.E., Sejnowski, T.J.: A learning algorithm for Boltzmann machines. Cognitive Science 9, 147–169 (1985)

    Article  Google Scholar 

  60. Kohonen, T., Barna, G., Chirsley, R.: Statistical pattern recognition with neural networks: Benchmarking studies. In: Proceedings of the IEEE International Conference on Neural Networks (ICNN 1988), pp. 61–68 (1988)

    Google Scholar 

  61. Grother, P.J.: NIST special database 19 – handprinted forms and characters database (1995)

    Google Scholar 

  62. Tan, K.H., Lim, C.P., Platts, K., Koay, H.S.: An intelligent decision support system for manufacturing technology investments. International Journal of Production Economics 104, 179–190 (2006)

    Article  Google Scholar 

  63. Downs, J., Harrison, R.F., Kennedy, R.L., Cross, S.S.: Application of the fuzzy ARTMAP neural network model to medical pattern classification tasks. Artificial Intelligence in Medicine 8, 403–428 (1996)

    Article  Google Scholar 

  64. Lopes, M.L.M., Minussi, C.R., Lotufo, A.D.P.: Electric load forecasting using a fuzzy ART & ARTMAP neural network. Applied Soft Computing 5, 235–244 (2005)

    Article  Google Scholar 

  65. Zhang, H.Y., Chan, C.W., Cheung, K.C., Ye, Y.J.: Fuzzy ARTMAP neural network and its application to fault diagnosis of navigation systems. Automatica 37, 1065–1070 (2001)

    Article  MATH  Google Scholar 

  66. Llobet, E., Hines, E.L., Gardner, J.W., Barlett, P.N., Mottram, T.T.: Fuzzy ARTMAP based electronic nose data analysis. Sensors and Actuators B 61, 183–190 (1999)

    Article  Google Scholar 

  67. Keyvan, S., Song, X., Kelly, M.: Nuclear fuel pellet inspection using artificial neural networks. Journal of Nuclear Materials 264, 141–154 (1999)

    Article  Google Scholar 

  68. Lerner, B., Lawrence, N.D.: A comparison of state-of-the-art classification techniques with application to cytogenetics. Neural Computing & Applications 10, 39–47 (2001)

    Article  Google Scholar 

  69. Anagnostopoulos, G., Georgiopoulos, M.: Ellipsoid ART and ARTMAP for incremental clustering and classification. In: Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2001), pp. 1221–1226 (2001)

    Google Scholar 

  70. US postal service handwritten digits recognition corpus, http://www.cedar.buffalo.edu/Databases/CDROM1/

  71. Lerner, B., Clocksin, W.F., Dhanjal, S., Hultén, M.A., Bishop, C.M.: Feature representation and signal classification in fluorescence in-situ hybridization image analysis. IEEE Transactions on Systems, Man, and Cybernetics A 31, 655–665 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Industrial Engineering and Management, Ben-Gurion University, Beer-Sheva, 84105, Israel

    Boaz Lerner

  2. Department of Electrical and Computer Engineering, Ben-Gurion University, Beer-Sheva, 84105, Israel

    Hugo Guterman

Authors
  1. Boaz Lerner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hugo Guterman
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Lakhmi C. Jain Mika Sato-Ilic Maria Virvou George A. Tsihrintzis Valentina Emilia Balas Canicious Abeynayake

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Lerner, B., Guterman, H. (2008). Advanced Developments and Applications of the Fuzzy ARTMAP Neural Network in Pattern Classification. In: Jain, L.C., Sato-Ilic, M., Virvou, M., Tsihrintzis, G.A., Balas, V.E., Abeynayake, C. (eds) Computational Intelligence Paradigms. Studies in Computational Intelligence, vol 137. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79474-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-79474-5_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-79473-8

  • Online ISBN: 978-3-540-79474-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation