Abstract
In order to support rule evaluation procedure of human experts, objective rule evaluation indices, such as accuracy, coverage, support and other interestingness measures have been developed. However, the relationship between their values and real human evaluations has not been clarified. In this paper, we compared the availability of sorting of composed objective rule evaluation indices to that of each index. To compose objective rule evaluation indices, we used Principle Component Analysis to a dataset of their values for rule sets from 32 UCI common datasets. By using a rule set with the real human evaluation for the meningitis dataset, we performed a comparison of a sorting availability to determine the human evaluations between the composed objective rule evaluation indices and each single index. The result shows that the composed indices perform equally by comparing to the best single indices based on the sorting avalibality.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Hilderman, R.J., Hamilton, H.J.: Knowledge Discovery and Measure of Interest. Kluwer Academic Publishers, Dordrecht (2001)
Tan, P.N., Kumar, V., Srivastava, J.: Selecting the right interestingness measure for association patterns. In: Proceedings of International Conference on Knowledge Discovery and Data Mining KDD 2002, pp. 32–41 (2002)
Yao, Y.Y., Zhong, N.: An analysis of quantitative measures associated with rules. In: Zhong, N., Zhou, L. (eds.) PAKDD 1999. LNCS, vol. 1574, pp. 479–488. Springer, Heidelberg (1999)
Ohsaki, M., Abe, H., Yokoi, H., Tsumoto, S., Yamaguchi, T.: Evaluation of rule interestingness measures in medical knowledge discovery in databases. Artificial Intelligence in Medicine 41(3), 177–196 (2007)
Freitas, A.A.: On rule interestingness measures. Knowledge-Based Systems 12(5-6), 309–315 (1999)
Vaillant, B., Lenca, P., Lallich, S.: A clustering of interestingness measures. In: Proceedings of the Discovery Science Conference 2004, pp. 290–297 (2004)
Huynh, X.-H., Guillet, F., Briand, H.: A data analysis approach for evaluating the behavior of interestingness measures. In: Proceeding of the Discovery Science Conference 2005, pp. 330–337 (2005)
Blanchard, J., Guillet, F., Gras, R., Briand, H.: Using information-theoretic measures to assess association rule interestingness. In: Proceedings of the fifth IEEE International Conference on Data Mining ICDM 2005, pp. 66–73. IEEE Computer Society, Los Alamitos (2005)
Abe, H., Tsumoto, S., Ohsaki, M., Yamaguchi, T.: A rule evaluation support method with learning models based on objective rule evaluation indexes. In: Proceeding of the IEEE International Conference on Data Mining ICDM 2005, pp. 549–552 (2005)
Ohsaki, M., Kitaguchi, S., Kume, S., Yokoi, H., Yamaguchi, T.: Evaluation of rule interestingness measures with a clinical dataset on hepatitis. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) PKDD 2004. LNCS (LNAI), vol. 3202, pp. 362–373. Springer, Heidelberg (2004)
Hettich, S., Blake, C.L., Merz, C.J.: UCI repository of machine learning databases. University of California, Department of Information and Computer Science, Irvine (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco (2000)
Frank, E., Witten, I.H.: Generating accurate rule sets without global optimization. In: The Fifteenth International Conference on Machine Learning, pp. 144–151 (1998)
Holte, R.C.: Very simple classification rules perform well on most commonly used datasets. Machine Learning 11, 63–91 (1993)
Tsumoto, S.: Guide to the meningoencephalitis diagnosis data set. In: International workshop of kdd challenge on real-world data (2000), http://www.slab.dnj.ynu.ac.jp/challenge2000/menin.htm
Hatazawa, H., Negishi, N., Suyama, A., Tsumoto, S., Yamaguchi, T.: Knowledge discovery support from a meningoencephalitis database using an automatic composition tool for inductive applications. In: KDD Challenge 2000 in conjunction with PAKDD 2000, pp. 28–33 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abe, H., Tsumoto, S. (2009). A Comparison of Composed Objective Rule Evaluation Indices Using PCA and Single Indices. In: Wen, P., Li, Y., Polkowski, L., Yao, Y., Tsumoto, S., Wang, G. (eds) Rough Sets and Knowledge Technology. RSKT 2009. Lecture Notes in Computer Science(), vol 5589. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02962-2_20
Download citation
DOI: https://doi.org/10.1007/978-3-642-02962-2_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02961-5
Online ISBN: 978-3-642-02962-2
eBook Packages: Computer ScienceComputer Science (R0)