Skip to main content

Adaptive Learning of Nominal Concepts for Supervised Classification

  • Conference paper
Knowledge-Based and Intelligent Information and Engineering Systems (KES 2010)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6276))

Abstract

In recent decades, several machine learning methods based on F ormal C oncept A nalysis have been proposed. The learning process is based on the construction of the mathematical structure of the Galois lattice. Two major limits characterize these methods. First, most of them are limited to the binary data processing. Second, the exponential complexity of a Galois lattice generation limits their fields of application. In this paper, we consider the Boosting of classifiers, which is an adaptive approach of classification. We propose the Boosting of classifiers based on Nominal Concepts. This method builds part of the lattice including the best concepts (pertinent concepts). It is distinguished from the other methods based on F ormal C oncept A nalysis by its ability to handle nominal data. The discovered concepts are called Nominal Concepts and they are used as classification rules. The comparative studies and the experimental results carried out, prove the interest of this method compared to those existing in literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Asuncion, A., Newman, D.: UCI machine learning repository (2007)

    Google Scholar 

  2. Khalfi, B., Cherif, R., Meddouri, N., Maddouri, M.: Développement de méthodes de classification basées sur l’analyse de concepts formels sous la palteforme weka. In: 10èmes Journées Francophones en Extraction et Gestion des Connaissances, Hammamet, Tunisia (2010)

    Google Scholar 

  3. Breiman, L.: Bagging predictors. Machine Learning 24, 123–140 (1996)

    MATH  MathSciNet  Google Scholar 

  4. Carpineto, C., Romano, G.: Galois: An order-theoretic approach to conceptual clustering. In: 10th International Conference on Machine Learning, Amherst, MA, USA (1993)

    Google Scholar 

  5. Douar, B., Latiri, C.C., Slimani, Y.: Approche hybride de classification supervisée à base de treillis de galois: application à la reconnaissance de visages. In: 8èmes Journées Francophones en Extraction et Gestion des Connaissances, Sophia Antipolis, France, pp. 309–320 (2008)

    Google Scholar 

  6. Freund, Y.: Boosting a weak learning algorithm by majority. Information and Computation 121, 256–285 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  7. Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: 13th International Conference on Machine Learning, Bari, Italy (1996)

    Google Scholar 

  8. Guillas, S., Bertet, K., Ogier, J.-M.: Reconnaissance de symboles bruités à l’aide d’un treillis de Galois. In: 9èmes Colloque International Francophone sur l’Ecrit et le Document, Fribourg, Switzerland (2006)

    Google Scholar 

  9. Guillet, F., Hamilton, H.J.: Quality Measures in Data Mining. Studies in Computational Intelligence, vol. 43. Springer, Heidelberg (2007)

    Book  MATH  Google Scholar 

  10. Lenca, P., Meyer, P., Vaillant, B., Lallich, S.: On selecting interestingness measures for association rules: User oriented description and multiple criteria decision aid. European Journal of Operational Research 184, 610–626 (2008)

    Article  MATH  Google Scholar 

  11. Liquiere, M.: Mephu nguifo, E.: Legal: learning with galois lattice. In: 5èmes Journées Franaises sur l’Apprentissage. Lannion, France (1990)

    Google Scholar 

  12. Maddouri, M.: Towards a machine learning approach based on incremental concept formation. Intelligent Data Analysis 8, 267–280 (2004)

    Google Scholar 

  13. Meddouri, N., Maddouri, M.: Générer des règles de classification par dopage de concepts formels. In: 9èmes Journées Francophones en Extraction et Gestion des Connaissances, Strasbourg, France (2009)

    Google Scholar 

  14. Meddouri, N., Maddouri, M.: Boosting formal concepts to discover classification rules. In: 22nd International Conference on Industrial, Engineering & Other Applications of Applied Intelligent Systems, Tainan, Taiwan (2009)

    Google Scholar 

  15. Nguifo, E.M., Njiwoua, P.: Treillis de concepts et classification supervisée. Technique et Science Informatiques 24, 449–488 (2005)

    Article  Google Scholar 

  16. Njiwoua, P., Mephu Nguifo, E.: Améliorer l’apprentissage partir d’instances grâce à l’induction de concepts: le systme cible. Revue d’Intelligence Artifcielle 13, 413–440 (1999)

    Google Scholar 

  17. Oosthuizen, D.: The use of a Lattice in Knowledge Processing. Thèse d’université, University of Strathclyde, Glasgow, UK (1988)

    Google Scholar 

  18. Oueslati, M., Zouari, H., Maddouri, M., Heutte, L.: Étude de la combinaison de classifieurs dans le cadre du boosting. In: 6ième édition des ateliers de travail sur le Traitement et Analyse de l’Information: Méthodes et Applications, Hammamet, Tunisia (2009)

    Google Scholar 

  19. Sahami, M.: Learning classification rules using lattices (extended abstract). In: 8th European Conference on Machine Learning, Heraclion, Crete, Greece (1995)

    Google Scholar 

  20. Sebban, M., Suchier, M.: On boosting improvement: Error reduction and convergence speed-up. In: 4th European Conference on Machine Learning, Cavtat-Dubrovnik, Croatia (2003)

    Google Scholar 

  21. Torre, F.: Globoost: Boosting de moindres généralisés. In: 6ième Conférence d’Apprentissage, Montpellier, France (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Meddouri, N., Maddouri, M. (2010). Adaptive Learning of Nominal Concepts for Supervised Classification. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based and Intelligent Information and Engineering Systems. KES 2010. Lecture Notes in Computer Science(), vol 6276. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15387-7_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15387-7_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15386-0

  • Online ISBN: 978-3-642-15387-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics