Abstract
It is a well-known fact that the Bayesian Networks’ (BNs) use as classifiers in different fields of application has recently witnessed a noticeable growth. Yet, the Naïve Bayes’ application, and even the augmented Naïve Bayes’, to classifier-structure learning, has been vulnerable to certain limits, which explains the practitioners’ resort to other more sophisticated types of algorithms. Consequently, the use of such algorithms has paved the way for raising the problem of super-exponential increase in computational complexity of the Bayesian classifier learning structure, with the increasing number of descriptive variables. In this context, the present work’s major objective lies in setting up a further solution whereby a remedy can be conceived for the intricate algorithmic complexity imposed during the learning of Bayesian classifiers’ structure with the use of sophisticated algorithms. Noteworthy, the present paper’s framework is organized as follows. We start, in the first place, by to propose a novel approach designed to reduce the algorithmic complexity without engendering any loss of information when learning the structure of a Bayesian classifier. We, then, go on to test our approach on a car diagnosis and a Lymphography diagnosis databases. Ultimately, an exposition of our conducted work’s interests will be a closing step to this work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Langley, P., Sage, S.: Induction of Selective Bayesian Classifiers. In: Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, pp. 399–406 (1994)
Friedman, N., Geiger, D., Goldszmid, M.: Bayesian Network classifiers. In: Machine Learning, pp. 131–163 (1997)
Pernkopf, F.: Bayesian Network Classifiers Versus Selective k-NN Classifier. In: Pattern Recognition, pp. 1–10 (2005)
Stuart, M., Yulan, H., Kecheng, L.: Choosing the Best Bayesian Classifier: An Empirical Study. IAENG International Journal of Computer Science, 1–10 (2009)
Madden, M.G.: A New Bayesian Network Structure for Classification Tasks. In: Irish Conference on Artificial Intelligence & Cognitive Science, pp. 203–208 (2002)
Lerner, B., Malka, R.: Investigation of the K2 algorithm in learning Bayesian Network Classifiers. In: Applied Artificial Intelligence, pp. 74–96 (2011)
Witten, H.I., Eibe, F.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann (1999)
Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by Simulated Annealing. Science, 671–681 (1983)
Domingos, P., Pazzani, M.: On the Optimality of the Simple Bayesian Classifier under Zero-one Loss. In: Machine Learning, pp. 103–130 (1997)
Cooper, G., Hersovits, E.: A Bayesian Method for the Induction of Probabilistic Networks from Data. In: Machine Learning, vol. 9, pp. 309–347 (1992)
Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction, and Search, 2nd edn. MIT Press (2000)
Judea, P., Tom, V.: A Theory of Inferred Causation. In: Allen, J., Fikes, R., Sandewall, E. (eds.) KR 1991, Principles of Knowledge Representation and Reasoning, pp. 441–452 (1991)
Robinson, R.W.: Counting Unlabeled Acyclic Digraphs. Combinatorial Mathematics 622, 28–43 (1977)
Tufféry, S.: Data Mining Et Statistique Décisionnelle: l’intelligence des données, Editions TECHNIP (2010)
Jain, A.K.: Data Clustering: 50 years beyond K-means. Pattern Recognition Letters 31, 651–666 (2010)
Chavent, M., Kuentz, V., Liquet, B., Saracco, J.: ClustOfVar: an R Package for the Clustering of Variables. In: The R User Conference (2011)
Chavent, M., Kuentz, V., Saracco, J.: A Partitioning Method for the Clustering of Categorical Variables. In: Locarek-Junge, H., Weihs, C. (eds.) Proceedings of the IFCS Classification as a Tool for Research. Springer (2009)
Lerman, I.C.: Likelihood Linkage Analysis (LLA) Classification Method: An example treated by hand. Biochimie. 75(5), 379–397 (1993)
Green, P., Kreiger, A.: A Generalized Rand-Index Method for Consensus Clustering of Separate Partitions of the Same Data Base. Journal of Classification, 63–89 (1999)
Chow, C., Liu, C.: Approximating Discrete Probability Distributions with Dependence Trees. IEEE Transactions on Information Theory 14(3), 462–467 (1968)
Francois, O., Leray, P.: Evaluation D’algorithmes D’apprentissage de Structure pour les réseaux bayésiens. In: Proceedings of 14ème Congrès Francophone Reconnaissance des Formes et Intelligence Artificielle, pp. 1453–1460 (2004)
Murphy, K.: The BayesNet Toolbox for Matlab. In: Computing Science and Statistics: Proceedings of Interface, vol. 33 (2001), http://www.ai.mit.edu/~murphyk/Software/BNT/bnt.html
Sprinthall, R.C.: Basic Statistical Analysis, 7th edn. (2003)
Ezawa, K., Singh, M., Norton, S.: Learning Goal Oriented Bayesian Networks for Telecommunications Risk Management. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 139–147 (1996)
Porwal, A., Carranza, E., Hale, M.: Bayesian Network Classifiers for Mineral Potential Mapping. Computers & Geosciences 32, 1–16 (2006)
Malka, R., Lerner, B.: Classification of Fluorescence in Situ Hybridization Images using Belief Networks. Pattern Recognition Letters 25, 1777–1785 (2004)
Estevam, R., Hruschka, J., Ebecken, N.: Towards Efficient Variables Ordering for Bayesian Networks Classifier. Data & Knowledge Engineering 63, 258–269 (2007)
Carta, J.A., Velázquez, S., Matías, J.M.: Use of Bayesian Networks Classifiers for long-Term Mean Wind Turbine Energy Output Estimation at a Potential Wind Energy Conversion Site. Energy Conversion and Management 52, 1137–1149 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bouhamed, H., Masmoudi, A., Lecroq, T., Rebaï, A. (2012). A New Approach for Bayesian Classifier Learning Structure via K2 Algorithm. In: Huang, DS., Gupta, P., Zhang, X., Premaratne, P. (eds) Emerging Intelligent Computing Technology and Applications. ICIC 2012. Communications in Computer and Information Science, vol 304. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31837-5_56
Download citation
DOI: https://doi.org/10.1007/978-3-642-31837-5_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31836-8
Online ISBN: 978-3-642-31837-5
eBook Packages: Computer ScienceComputer Science (R0)