Abstract
A common problem in Data Mining (DM) is the presence of noise in the data being mined. Artificial neural networks (ANN) are robust and have a good tolerance to noise, which makes them suitable for mining very noisy data. Although they may achieve high classification accuracy, they have the well-known disadvantage of having black-box nature and not discovering any high-level rule that can be used as a support for human understanding. The main challenge in using ANN in DM applications is to get explicit knowledge from these models. For this purpose, a study on knowledge acquirement from trained ANNs for classification problems is presented. The proposed method uses Touring Ant Colony Optimization (TACO) algorithm for extracting accurate and comprehensible rules from databases via trained artificial neural networks. The suggested algorithm is experimentally evaluated on different benchmark data sets. Results show that the proposed approach has a potential to generate accurate and concise rules.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Andrews, R., Diederich, J., Tickle, A.B.: A Survey, Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks. Knowledge Based Sys. 8(6), 373–389 (1995)
Arbatlı, A.D., Akın, H.L.: Rule Extraction from Trained Neural Networks Using Genetic Algorithms. Nonlinear Analysis, Theory, Methods & Applications 30(3), 1639–1648 (1997)
Baykasoğlu, A., Özbakır, L.: MEPAR-miner: Multi-Expression Programming for Classification Rule Mining. European Journal of Operational Research 183(2), 767–784 (2007)
Chen, G., Liu, H., Yu, L., Wei, Q., Zhang, X.: A New Approach to Classification Based on Association Rule Mining. Decision Support Systems 42, 674–689 (2006)
Dehuri, S., Mall, R.: Predictive and Comprehensible Rule Discovery Using A Multi-Objective Genetic Algorithm. Knowledge-Based Systems 19, 413–421 (2006)
Dorigo, M., Maniezzo, V., Colorni, A.: Positive Feedback as A Search Strategy, Technical Report, N. 91-016, Politecnico di Milano (1991)
Elalfi, E., Haque, R., Elalami, M.E.: Extracting Rules from Trained Neural Network Using GA for Managing E-business. Applied Soft Computing 4, 65–77 (2004)
Fayyad, U., Irani, K.B.: Multi-interval Discretization of Continuous-valued Attributes for Classification Learning. In: Proceedings of 13th International Joint Conference on Artificial Intelligence, pp. 1022–1027 (1993)
Frawley, W., Piatetsky-Shapiro, G., Matheus, C.W.: Knowledge Discovery in Databases: An Overview. AI Magazine, 213–228 (1992)
Han, J., Kamber, M.: Data Mining: Concepts and Techniques, p. 24. Academic Press, London (2001)
Hiroyasu, T., Miki, M., Ono, Y., Minami, Y.: Ant Colony for Continuous Functions, The Science and Engineering Doshisha University XX(Y) (2000)
Hruschka, E.R., Ebecken, N.F.F.: Extracting Rules from Multilayer Perceptrons in Classification Problems: A Clustering-based Approach. Neurocomputing 70, 384–397 (2006)
Kalinli, A., Karaboga, N., Karaboga, D.: A Modified Touring Ant Colony Optimisation Algorithm For Continuous Functions. In: The 16th International Symposium on Computer and Information Sciences (ISCIS XVI), pp. 437–444. Isik University, Antalya (2001)
Karaboga, N., Kalinli, A., Karaboga, D.: Designing Digital IIR Filters Using Ant Colony Optimisation Algorithm. Engineering Applications of Artificial Intelligence 17, 301–309 (2004)
Kuttuyil, A.S.: Survey of Rule Extraction Methods, Master of Science Thesis, 1 (2004)
Markowska-Kaczmar, U.: The Influence of Prameters in Evolutionary Based Rule Extraction Method from Neural Network. In: Proceedings of the 2005 5th International Conference on Intelligent Systems Design and Applications, ISDA 2005 (2005)
Markowska-Kaczmar, U., Wnuk-Lipinski, P.: Rule Extraction from Neural Network by Genetic Algorithm with Pareto Optimization. In: Rutkowski, L., Siekmann, J.H., Tadeusiewicz, R., Zadeh, L.A. (eds.) ICAISC 2004. LNCS, vol. 3070, pp. 450–455. Springer, Heidelberg (2004)
Santos, R.T., Nievola, J.C., Freitas, A.A.: Extracting Comprehensible Rules From Neural Network via Genetic Algorithms. In: Proc. 2000 IEEE Symp. On Combinations of Evolutionary Computation and Neural Networks (ECNN 2000), San Antonio, TX, USA, pp. 130–139 (2000)
Tan, K.C., Yu, Q., Ang, J.H.: A Dual-Objective Evolutionary Algorithm for Rules Extraction in Data Mining. Computational Optimization and Applications 34, 273–294 (2006)
Thabtah, F.A., Cowling, P.I.: A Greedy Classification Algorithm Based on Association Rule. Applied Soft Computing 7, 1102–1111 (2007)
Tokinaga, S., Lu, J., Ikeda, Y.: Neural Network Rule Extraction by Using the Genetic Programming and Its Applications to Explanatory Classifications. IECE Trans. Fundamentas E88-A(10), 2627–2635 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Özbakır, L., Baykasoğlu, A., Kulluk, S. (2008). Rule Extraction from Neural Networks Via Ant Colony Algorithm for Data Mining Applications. In: Maniezzo, V., Battiti, R., Watson, JP. (eds) Learning and Intelligent Optimization. LION 2007. Lecture Notes in Computer Science, vol 5313. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92695-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-92695-5_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92694-8
Online ISBN: 978-3-540-92695-5
eBook Packages: Computer ScienceComputer Science (R0)