Skip to main content

A New Approach for Bayesian Classifier Learning Structure via K2 Algorithm

  • Conference paper
Emerging Intelligent Computing Technology and Applications (ICIC 2012)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 304))

Included in the following conference series:

Abstract

It is a well-known fact that the Bayesian Networks’ (BNs) use as classifiers in different fields of application has recently witnessed a noticeable growth. Yet, the Naïve Bayes’ application, and even the augmented Naïve Bayes’, to classifier-structure learning, has been vulnerable to certain limits, which explains the practitioners’ resort to other more sophisticated types of algorithms. Consequently, the use of such algorithms has paved the way for raising the problem of super-exponential increase in computational complexity of the Bayesian classifier learning structure, with the increasing number of descriptive variables. In this context, the present work’s major objective lies in setting up a further solution whereby a remedy can be conceived for the intricate algorithmic complexity imposed during the learning of Bayesian classifiers’ structure with the use of sophisticated algorithms. Noteworthy, the present paper’s framework is organized as follows. We start, in the first place, by to propose a novel approach designed to reduce the algorithmic complexity without engendering any loss of information when learning the structure of a Bayesian classifier. We, then, go on to test our approach on a car diagnosis and a Lymphography diagnosis databases. Ultimately, an exposition of our conducted work’s interests will be a closing step to this work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Langley, P., Sage, S.: Induction of Selective Bayesian Classifiers. In: Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, pp. 399–406 (1994)

    Google Scholar 

  2. Friedman, N., Geiger, D., Goldszmid, M.: Bayesian Network classifiers. In: Machine Learning, pp. 131–163 (1997)

    Google Scholar 

  3. Pernkopf, F.: Bayesian Network Classifiers Versus Selective k-NN Classifier. In: Pattern Recognition, pp. 1–10 (2005)

    Google Scholar 

  4. Stuart, M., Yulan, H., Kecheng, L.: Choosing the Best Bayesian Classifier: An Empirical Study. IAENG International Journal of Computer Science, 1–10 (2009)

    Google Scholar 

  5. Madden, M.G.: A New Bayesian Network Structure for Classification Tasks. In: Irish Conference on Artificial Intelligence & Cognitive Science, pp. 203–208 (2002)

    Google Scholar 

  6. Lerner, B., Malka, R.: Investigation of the K2 algorithm in learning Bayesian Network Classifiers. In: Applied Artificial Intelligence, pp. 74–96 (2011)

    Google Scholar 

  7. Witten, H.I., Eibe, F.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann (1999)

    Google Scholar 

  8. Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by Simulated Annealing. Science, 671–681 (1983)

    Google Scholar 

  9. Domingos, P., Pazzani, M.: On the Optimality of the Simple Bayesian Classifier under Zero-one Loss. In: Machine Learning, pp. 103–130 (1997)

    Google Scholar 

  10. Cooper, G., Hersovits, E.: A Bayesian Method for the Induction of Probabilistic Networks from Data. In: Machine Learning, vol. 9, pp. 309–347 (1992)

    Google Scholar 

  11. Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction, and Search, 2nd edn. MIT Press (2000)

    Google Scholar 

  12. Judea, P., Tom, V.: A Theory of Inferred Causation. In: Allen, J., Fikes, R., Sandewall, E. (eds.) KR 1991, Principles of Knowledge Representation and Reasoning, pp. 441–452 (1991)

    Google Scholar 

  13. Robinson, R.W.: Counting Unlabeled Acyclic Digraphs. Combinatorial Mathematics 622, 28–43 (1977)

    Google Scholar 

  14. Tufféry, S.: Data Mining Et Statistique Décisionnelle: l’intelligence des données, Editions TECHNIP (2010)

    Google Scholar 

  15. Jain, A.K.: Data Clustering: 50 years beyond K-means. Pattern Recognition Letters 31, 651–666 (2010)

    Article  Google Scholar 

  16. Chavent, M., Kuentz, V., Liquet, B., Saracco, J.: ClustOfVar: an R Package for the Clustering of Variables. In: The R User Conference (2011)

    Google Scholar 

  17. Chavent, M., Kuentz, V., Saracco, J.: A Partitioning Method for the Clustering of Categorical Variables. In: Locarek-Junge, H., Weihs, C. (eds.) Proceedings of the IFCS Classification as a Tool for Research. Springer (2009)

    Google Scholar 

  18. Lerman, I.C.: Likelihood Linkage Analysis (LLA) Classification Method: An example treated by hand. Biochimie. 75(5), 379–397 (1993)

    Article  Google Scholar 

  19. Green, P., Kreiger, A.: A Generalized Rand-Index Method for Consensus Clustering of Separate Partitions of the Same Data Base. Journal of Classification, 63–89 (1999)

    Google Scholar 

  20. Chow, C., Liu, C.: Approximating Discrete Probability Distributions with Dependence Trees. IEEE Transactions on Information Theory 14(3), 462–467 (1968)

    Article  MathSciNet  MATH  Google Scholar 

  21. Francois, O., Leray, P.: Evaluation D’algorithmes D’apprentissage de Structure pour les réseaux bayésiens. In: Proceedings of 14ème Congrès Francophone Reconnaissance des Formes et Intelligence Artificielle, pp. 1453–1460 (2004)

    Google Scholar 

  22. Murphy, K.: The BayesNet Toolbox for Matlab. In: Computing Science and Statistics: Proceedings of Interface, vol. 33 (2001), http://www.ai.mit.edu/~murphyk/Software/BNT/bnt.html

  23. Sprinthall, R.C.: Basic Statistical Analysis, 7th edn. (2003)

    Google Scholar 

  24. Ezawa, K., Singh, M., Norton, S.: Learning Goal Oriented Bayesian Networks for Telecommunications Risk Management. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 139–147 (1996)

    Google Scholar 

  25. Porwal, A., Carranza, E., Hale, M.: Bayesian Network Classifiers for Mineral Potential Mapping. Computers & Geosciences 32, 1–16 (2006)

    Article  Google Scholar 

  26. Malka, R., Lerner, B.: Classification of Fluorescence in Situ Hybridization Images using Belief Networks. Pattern Recognition Letters 25, 1777–1785 (2004)

    Article  Google Scholar 

  27. Estevam, R., Hruschka, J., Ebecken, N.: Towards Efficient Variables Ordering for Bayesian Networks Classifier. Data & Knowledge Engineering 63, 258–269 (2007)

    Article  Google Scholar 

  28. Carta, J.A., Velázquez, S., Matías, J.M.: Use of Bayesian Networks Classifiers for long-Term Mean Wind Turbine Energy Output Estimation at a Potential Wind Energy Conversion Site. Energy Conversion and Management 52, 1137–1149 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bouhamed, H., Masmoudi, A., Lecroq, T., Rebaï, A. (2012). A New Approach for Bayesian Classifier Learning Structure via K2 Algorithm. In: Huang, DS., Gupta, P., Zhang, X., Premaratne, P. (eds) Emerging Intelligent Computing Technology and Applications. ICIC 2012. Communications in Computer and Information Science, vol 304. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31837-5_56

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31837-5_56

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31836-8

  • Online ISBN: 978-3-642-31837-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics