Abstract
Rule induction is a data mining process for acquiring knowledge in terms of symbolic decision rules that explain the data in terms of causal relationship between conditional factors and a given decision/outcome. We present a Decision Rule Acquisition Workbench (DRAW) that discovers symbolic decision rules, in CNF form, from un-annotated data-sets. Our rule-induction strategy involves three phases: (a) conceptual clustering to cluster and generate a conceptual hierarchy of the data-set; (b) rough sets based rule induction algorithm to generate decision rules from the emergent data clusters; and (c) attribute oriented induction to generalize the derived decision rules to yield high-level decision rules and a minimal rule-set size. We evaluate DRAW with five standard machine learning datasets and apply to derive decision rules to understand optic nerve images in the realm of glaucoma decision support.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fayyad, U.M., Piatetsky-Shapiro, G., Smyth, P.: Knowledge Discovery and Data Mining: Towards a Unifying Framework. In: International Conference on Knowledge Discovery in Databases, pp. 82–88 (1996)
Abidi, S.S.R., Hoe, K.M., Goh, A.: Analyzing Data Clusters: A Rough Set Approach to Extract Cluster Defining Symbolic Rules. In: Hoffmann, F., Adams, N., Fisher, D., Guimarães, G., Hand, D.J. (eds.) IDA 2001. LNCS, vol. 2189, pp. 248–257. Springer, Heidelberg (2001)
Pawlak, Z.: Rough Sets. In: Lin, T.Y., Cercone, N. (eds.) Rough Sets and Data Mining: Analysis of Imprecise Data, pp. 3–7. Kluwer Academic Publishers, Dordrecht (1997)
Biswas, G., Weinberg, J., Li, C.: ITERATE: A Conceptual Clustering Method for Knowledge Discovery in Database. In: Braunshweig, B., Day, R. (eds.) Artificial Intelligence in the Petroleum Industry, ch. 3, Techniq edn., pp. 111–139 (1995)
Slowinski, K., Slowinski, R., Stefanowski, J.: Rough Sets Approach to Analysis of Data from Peritoneal Lavage in Acute Pancreatitis. Medical Informatics 13, 143–159 (1988)
Han, J., Cai, Y., Cercone, N.: Knowledge Discovery in Databases: An Attribute-Oriented Approach. In: Proceedings of the 18th VLDB Conference, Vancouver, British Columbia, Canada, pp. 547–559 (1992)
Shavlik, J.W., Dietterich, T.G.: Readings in Machine learning. Morgan Kaufmann, San Francisco (1990)
Quinlan, R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, California (1993)
Hu, X., Cercone, N.: Learning Maximal Generalized Decision Rules via Discretization, Generalization and Rough Set Feature Selection. In: Proc. 9th Int. Conf. on Tools with Artificial Intelligence (1997)
Grzymala Busse, J.W.: LERS A System for Learning from Examples Based on Rough Sets. In: Slowinski, R. (ed.) Intelligent Decision Support, pp. 3–18. Kluwer Publishers, Dordrecht (1992)
Chan, C.C., Grzymala Busse, J.W.: On the Two Local Inductive Algorithms: PRISM and LEM2. Foundations of Computing and Decision Sciences 19(4), 185–204 (1994)
Skowron, A., Polkowski, L.: Synthesis of Decision Systems from Data Tables. In: Lin, T.Y., Cecrone, N. (eds.) Rough Sets and Data Mining, pp. 289–299. Kluwer Publishers, Dordrecht (1997)
Ohrn, A., Komorowski, J.: Diagnosing Acute Appendicitis with Very Simple Classification Rules. In: Żytkow, J.M., Rauch, J. (eds.) PKDD 1999. LNCS (LNAI), vol. 1704, pp. 462–467. Springer, Heidelberg (1999)
Goodall, D.W.: A New Similarity Index Based on Probability. Biometrics 22, 882–907 (1966)
Arabie, P., Hubert, L.J.: An Overview of Combinatorial Data Analysis. In: Arabie, P., Hubert, L.J., Soete, G.D. (eds.) Clustering and Classification, pp. 5–63. World Scientific Publishing Co, NJ (1996)
Bazan, J.G.: Dynamic Reducts and Statistical Inference. In: Proc. 6th Int. Conf. on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMIU 1996), Granada, Spain, vol. 3, pp. 1147–1152 (1996)
Wróblewski, J.: Finding Minimal Reducts using Genetic Algorithms. In: Proc. 2nd Annual Joint Conf. on Information Sciences, Wrightsville Beach, NC, USA, pp. 186–189 (1995)
Komorowski, J., Bjorvand, A.T.: Practical Applications of Genetic Algorithms for Efficient Reduct Computation. In: Proc. of 15th IMACS World Congress on Scientific Computation, Modelling and Applied Mathematics, Berlin (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, Q., Abidi, S.S.R. (2006). From Clusters to Rules: A Hybrid Framework for Generalized Symbolic Rule Induction. In: Yeung, D.S., Liu, ZQ., Wang, XZ., Yan, H. (eds) Advances in Machine Learning and Cybernetics. Lecture Notes in Computer Science(), vol 3930. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11739685_23
Download citation
DOI: https://doi.org/10.1007/11739685_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33584-9
Online ISBN: 978-3-540-33585-6
eBook Packages: Computer ScienceComputer Science (R0)