Learning Fuzzy Models and Potential Outliers
Outliers or distorted attributes very often severely interfere with data analysis algorithms that try to extract few meaningful rules. Most methods to deal with outliers try to completely ignore them. This can be potentially harmful since the very outlier that was ignored might have described a rare but still extremely interesting phenomena. In this paper we describe an approach that tries to build an interpretable model while still maintaining all the information in the data. This is achieved through a two stage process. A first phase builds an outlier-model for data points of low relevance, followed by a second stage which uses this model as filter and generates a simpler model, describing only examples with higher relevance, thus representing a more general concept. The outlier-model on the other hand may point out potential areas of interest to the user. Preliminary experiments indicate that the two models in fact have lower complexity and sometimes even offer superior performance.
KeywordsMembership Function Fuzzy Rule Fuzzy Model Potential Outlier Fuzzy Graph
Unable to display preview. Download preview PDF.
- 1.C. Apte, S. Hong, J. Hosking, J. Lepre, E. Pednault, and B. K. Rosen. Decomposition of heterogeneous classification problems. Intelligent Data Analysis, 2 (2), 1998. ( http://www.elsevier.nl/locate/ida ).
- 2.M. R. Berthold and K.-P. Huber. Constructing fuzzy graphs from examples. Intelligent Data Analysis, 3 (1), 1999. ( http://www.elsevier.nl/locate/ida).Google Scholar
- 3.V. Cherkassky and F. Mulier. Learning from Data. John Wiley and Sons Inc., 1998.Google Scholar
- 4.S. K. Halamuge and M. Glesner. FuNe Deluxe: A group of fuzzy-neural methods for complex data analysis problems. In Proceedings of the EUFIT’95, Aug. 1995.Google Scholar
- 6.C. M. Higgins and R. M. Goodman. Learning fuzzy rule-based neural networks for control. In Advances in Neural Information Processing Systems 5, pages 350–357, California, 1993. Morgan Kaufmann.Google Scholar
- 7.K.-P. Huber and M. R. Berthold. Building precise classifiers with automatic rule extraction. In IEEE International Conference on Neural Networks, 3, pages 12631268, 1995.Google Scholar
- 8.D. Michie, D. J. Spiegelhalter, and C. C. Taylor, editors. Machine Learning, Neural and Statistical Classification. Ellis Horwood Limited, 1994.Google Scholar
- 9.R. Silipo and M. R. Berthold. Discriminative power of input features. In , 1999.Google Scholar
- 12.L.-X. Wang and J. M. Mendel. Generating rules by learning from examples. In International Symposium on Intelligent Control, pages 263–268. IEEE, 1991.Google Scholar
- 14.L. A. Zadeh. Soft computing and fuzzy logic. IEEE Software, pages 48–56, Nov. 1994.Google Scholar