Abstract
The present paper is devoted to the pattern recognition methods for combining heterogeneous sets of learning data: set of training examples and the set of expert rules with unprecisely formulated weights understood as conditional probabilities. Adopting the probabilistic model two concepts of recognition learning are proposed. In the first approach two classifiers trained on homogeneous data set are generated and next their decisions are combined using local weighted voting combination rule. In the second method however, one set of data is transformed into the second one and next only one classifier trained on homogeneous set of data is used. Furthermore, the important problem of consistency of expert rules and the learning set is discussed and the method for checking it is proposed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Chen, D., Cheng, X.: An asymptotic analysis of some expert fusion methods. Pattern Recognition Letters 22, 901–904 (2001)
Czabanski, R.: Self-generating fuzzy rules from numerical data. Techn. Report Silesian Technical Univ. Gliwice (PhD Thesis) (2002) (in Polish)
Devroye, L., Gyorfi, P., Lugossi, G.: A Probabilistic Theory of Pattern Recognition. Springer, New York (1996)
Dubois, D., Lang, J.: Possibilistic logic. In: Handbook of Logic in Artificial Intelligence and Logic Programming, pp. 439–513. Oxford Univ. Press, Oxford (1994)
Duda, R., Hart, P., Stork, D.: Pattern Classification. John Wiley and Sons, Chichester (2001)
Halpern, J.: Reasoning about Uncertainty. MIT Press, Cambridge (2003)
Jacobs, R.: Methods for combining experts probability assessments. Neural Computation 7, 867–888 (1995)
Kittler, J., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. on PAMI 20, 226–239 (1998)
Kuncheva, L.: Combining classifiers: Soft computing solutions. In: Pal, S., Pal, A. (eds.) Pattern Recognition: from Classical to Modern Approaches, pp. 427–451. World Scientific, Singapore (2001)
Kurzynski, M., Sas, J., Blinowska, A.: Rule-Based Medical Decision-Making with Learning. In: Proc. 12th World IFAC Congress, Sydney, vol. 4, pp. 319–322 (1993)
Kurzynski, M., Wozniak, M.: Rule-Based Algorithms with Learning for Sequential Recognition Problem. In: Proc. 3rd Int. Conf. Fusion 2000, Paris, pp. 10–13 (2000)
Kurzynski, M., Puchala, E.: Hybrid Pattern Recognition Algorithms Applied to the Computer-Aided Medical Diagnosis. In: Crespo, J.L., Maojo, V., Martin, F. (eds.) ISMDA 2001. LNCS, vol. 2199, pp. 133–139. Springer, Heidelberg (2001)
Kurzynski, M.: Consistency Conditions of the Expert Rule Set in the Probabilistic Pattern Recognition. In: Zhang, J., He, J.-H., Fu, Y. (eds.) CIS 2004. LNCS, vol. 3314, pp. 831–836. Springer, Heidelberg (2004)
Mitchell, T.: Machine Learning. McGraw-Hill Science, New York (1997)
Kuratowski, K., Mostowski, A.: Set Theory. Nort-Holland Publishing Co., Amsterdam (1986)
Sachs, L.: Applied Statistics. A Handbook of Techniques. Springer, Heidelberg (1982)
Woods, K., Kegelmeyer, W.: Combination of multiple classifiers using local accuracy estimates. IEEE Trans. on PAMI 19, 405–410 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kurzynski, M. (2005). Combining Rule-Based and Sample-Based Classifiers – Probabilistic Approach. In: De Gregorio, M., Di Maio, V., Frucci, M., Musio, C. (eds) Brain, Vision, and Artificial Intelligence. BVAI 2005. Lecture Notes in Computer Science, vol 3704. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11565123_29
Download citation
DOI: https://doi.org/10.1007/11565123_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29282-1
Online ISBN: 978-3-540-32029-6
eBook Packages: Computer ScienceComputer Science (R0)