Abstract
This paper presents a study on the combination of different classifiers for toxicity prediction. Two combination operators for the Multiple-Classifier System definition are also proposed. The classification methods used to generate classifiers for combination are chosen in terms of their representability and diversity and include the Instance-based Learning algorithm (IBL), Decision Tree learning algorithm (DT), Repeated Incremental Pruning to Produce Error Reduction (RIPPER), Multi-Layer Perceptrons (MLPs) and Support Vector Machine (SVM). An effective approach of combining class-wise expertise of diverse classifiers is proposed and evaluated on seven toxicity data sets. The experimental results show that the performance of the combined classifier based on our approach over seven data sets can achieve 69.24% classification accuracy on average, which is better than that of the best classifier (generated by MLP) and four combination schemes studied.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Ellis Horwood (1994)
Ho, T.K., Hull, J.J., Srihari, S.N.: Decision Combination in Multiple Classifier Systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(1), 66–75 (1994)
Baykut, A., Ercil, A.: Towards Automated Classifier Combination for Pattern Recognition. In: Windeatt, T., Roli, F. (eds.) MCS 2003. LNCS, vol. 2709, pp. 94–105. Springer, Heidelberg (2003)
Nadal, C., Legault, R., Suen, C.Y.: Complementary Algorithms for the Recognition of Totally Unconstrained Hand Written Numeral. In: Proc. of the 10th International Conference on Pattern Recognition, vol. A, pp. 434–449 (1990)
Saerens, M., Fouss, F.: Yet Another Method for Combining Classifiers Outputs: A Maximum Entropy Approach. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 82–91. Springer, Heidelberg (2004)
Zhang, B., Srihari, S.N.: Class-Wise Multi-Classifier Combination Based on Dempster-Shafer Theory. In: Proc. of ICARV (2002)
Bi, Y., Bell, D., Wang, H., Guo, G., Greer, K.: Combining Multiple Classifiers Using Dempster-Shafer’s Rule for Text Categorization. In: Torra, V., Narukawa, Y. (eds.) MDAI 2004. LNCS (LNAI), vol. 3131, pp. 127–138. Springer, Heidelberg (2004)
Xu, L., Krzyzak, A., Suen, C.: Methods of Combination Multiple Classifiers and Their Applications to Handwritten Recognition. IEEE Transactions on Systems, Man and Cybernetics SMC-22(3), 418–435 (1992)
Guo, G., Neagu, D.: Similarity-based Classifier Combination for Decision Making. In: IEEE International Conference on Systems, Man and Cybernetics (SMC 2005), Hawail, USA, pp. 176–181 (2005)
Neagu, D., Palade, V.: Modular Neuro-Fuzzy Networks: An Overview of Explicit and Implicit Knowledge Integration. In: Proc. of the 15th International FLAIRS-02 Conference, Special Track on Integrated Intelligent Systems, Pensacola, Florida, USA, May 14-16, 2002, pp. 277–281. AAAI Press, Menlo Park (2002)
Kuncheva, L.I.: Combining Classifiers: Soft Computing Solutions. In: Pal, S.K. (ed.) Pattern Recognition: From Classical to Modern Approaches, pp. 427–452. World Scientific, Singapore (2001)
EU FP5 Quality of Life DEMETRA QLRT-2001-00691: Development of Environmental Modules for Evaluation of Toxicity of pesticide Residues in Agriculture, http://www.demetra-tox.net
CSL (Central Science Laboratory York): Development of Artificial Intelligence-based In-silico Toxicity Models for Use in Pesticide Risk Assessment (2004-2007), http://www.csl.gov.uk
Schultz, T.W.: TETRATOX: Tetrahymena Pyriformis Population Growth Impairment Endpoint - A Surrogate for Fish Lethality. Toxicol. Methods 7, 289–309 (1997)
Witten, I.H., Frank, G.: Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann, San Francisco (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Neagu, D., Guo, G., Wang, S. (2006). An Effective Combination Based on Class-Wise Expertise of Diverse Classifiers for Predictive Toxicology Data Mining. In: Li, X., Zaïane, O.R., Li, Z. (eds) Advanced Data Mining and Applications. ADMA 2006. Lecture Notes in Computer Science(), vol 4093. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11811305_18
Download citation
DOI: https://doi.org/10.1007/11811305_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37025-3
Online ISBN: 978-3-540-37026-0
eBook Packages: Computer ScienceComputer Science (R0)