Skip to main content
SpringerLink
Log in

Ensemble Enhanced Evidential k-NN Classifier Through Rough Set Reducts

  • Conference paper
  • First Online:
Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations (IPMU 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 853))

Abstract

Data uncertainty is seen as one of the main issues of several real world applications that can affect the decision of experts. Several studies have been carried out, within the data mining and the pattern recognition fields, for processing the uncertainty that is associated to the classifier outputs. One solution consists of transforming classifier outputs into evidences within the framework of belief functions. To gain the best performance, ensemble systems with belief functions have been well studied for several years now. In this paper, we aim to construct an ensemble of the Evidential Editing k-Nearest Neighbors classifier (EEk-NN), which is an extension of the standard k-NN classifier for handling data with uncertain attribute values expressed within the belief function framework, through rough set reducts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bhatt, R.B., Gopal, M.: On fuzzy-rough sets approach to feature selection. Pattern Recogn. Lett. 26(7), 965–975 (2005)

    Article  Google Scholar 

  2. Bryll, R., Gutierrez-Osuna, R., Quek, F.: Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets. Pattern Recogn. 36(6), 1291–1302 (2003)

    Article  Google Scholar 

  3. Debie, E., Shafi, K., Lokan, C., Merrick, K.: Reduct based ensemble of learning classifier system for real-valued classification problems. In: IEEE Symposium on Computational Intelligence and Ensemble Learning (CIEL), pp. 66–73. IEEE (2013)

    Google Scholar 

  4. Dempster, A.P.: Upper and lower probabilities induced by a multivalued mapping. Ann. Math. Stat. 38, 325–339 (1967)

    Article  MathSciNet  Google Scholar 

  5. Günter, S., Bunke, H.: Feature selection algorithms for the generation of multiple classifier systems and their application to handwritten word recognition. Pattern Recogn. Lett. 25(11), 1323–1336 (2004)

    Article  Google Scholar 

  6. Jensen, R., Cornelis, C.: Fuzzy-rough nearest neighbour classification and prediction. Theor. Comput. Sci. 412(42), 5871–5884 (2011)

    Article  MathSciNet  Google Scholar 

  7. Jousselme, A., Grenier, D., Bossé, E.: A new distance between two bodies of evidence. Inf. Fusion 2(2), 91–101 (2001)

    Article  Google Scholar 

  8. Khoo, L., Tor, S., Zhai, L.: A rough-set-based approach for classification and rule induction. Int. J. Adv. Manuf. Technol. 15(6), 438–444 (1999)

    Article  Google Scholar 

  9. Kim, Y.: Toward a successful CRM: variable selection, sampling, and ensemble. Decis. Support Syst. 41(2), 542–553 (2006)

    Article  Google Scholar 

  10. Komorowski, J., Øhrn, A., Skowron, A.: The ROSETTA rough set software system. In: Handbook of Data Mining and Knowledge Discovery, pp. 2–3 (2002)

    Google Scholar 

  11. Kumar, P., Vadakkepat, P., Poh, L.A.: Fuzzy-rough discriminative feature selection and classification algorithm, with application to microarray and image datasets. Appl. Soft Comput. 11(4), 3429–3440 (2011)

    Article  Google Scholar 

  12. Murphy, P., Aha, D.: UCI repository databases. http://www.ics.uci.edu/mlear (1996)

  13. Opitz, D., Maclin, R.: Popular ensemble methods: an empirical study. J. Artif. Intell. Res. 11, 169–198 (1999)

    MATH  Google Scholar 

  14. Parmar, D., Wu, T., Blackhurst, J.: MMR: an algorithm for clustering categorical data using rough set theory. Data Knowl. Eng. 63(3), 879–893 (2007)

    Article  Google Scholar 

  15. Pawlak, Z.: Rough sets. Int. J. Comput. Inf. Sci. 11(5), 341–356 (1982)

    Article  Google Scholar 

  16. Phon-Amnuaisuk, S., Ang, S.-P., Lee, S.-Y. (eds.): MIWAI 2017. LNCS (LNAI), vol. 10607. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-69456-6

    Book  Google Scholar 

  17. Ponti Jr., M.P.: Combining classifiers: from the creation of ensembles to the decision fusion. In: 24th SIBGRAPI Conference on Graphics, Patterns and Images Tutorials (SIBGRAPI-T), pp. 1–10. IEEE (2011)

    Google Scholar 

  18. Ristic, B., Smets, P.: The TBM global distance measure for the association of uncertain combat id declarations. Inf. Fusion 7(3), 276–284 (2006)

    Article  Google Scholar 

  19. Saha, S., Murthy, C.A., Pal, S.K.: Classification of web services using tensor space model and rough ensemble classifier. In: An, A., Matwin, S., Raś, Z.W., Ślęzak, D. (eds.) ISMIS 2008. LNCS (LNAI), vol. 4994, pp. 508–513. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-68123-6_55

    Chapter  Google Scholar 

  20. Shi, L., Ma, X., Xi, L., Duan, Q., Zhao, J.: Rough set and ensemble learning based semi-supervised algorithm for text classification. Expert Syst. Appl. 38(5), 6300–6306 (2011)

    Article  Google Scholar 

  21. Shi, L., Xi, L., Ma, X., Weng, M., Hu, X.: A novel ensemble algorithm for biomedical classification based on ant colony optimization. Appl. Soft Comput. 11(8), 5674–5683 (2011)

    Article  Google Scholar 

  22. Skowron, A., Rauszer, C.: The discernibility matrices and functions in information systems. In: Słowiński, R. (ed.) Intelligent Decision Support, pp. 331–362. Springer, Dordrecht (1992). https://doi.org/10.1007/978-94-015-7975-9_21

    Chapter  Google Scholar 

  23. Smets, P.: The combination of evidence in the transferable belief model. IEEE Trans. Pattern Anal. Mach. Intell. 12(5), 447–458 (1990)

    Article  Google Scholar 

  24. Smets, P.: Decision making in the TBM: the necessity of the pignistic transformation. Int. J. Approx. Reas. 38(2), 133–147 (2005)

    Article  MathSciNet  Google Scholar 

  25. Smets, P., Kennes, R.: The transferable belief model. Artif. Intell. 66(2), 191–234 (1994)

    Article  MathSciNet  Google Scholar 

  26. Tessem, B.: Approximations for efficient computation in the theory of evidence. Artif. Intell. 61(2), 315–329 (1993)

    Article  MathSciNet  Google Scholar 

  27. Trabelsi, A., Elouedi, Z., Lefevre, E.: Feature selection from partially uncertain data within the belief function framework. In: Carvalho, J.P., Lesot, M.-J., Kaymak, U., Vieira, S., Bouchon-Meunier, B., Yager, R.R. (eds.) IPMU 2016. CCIS, vol. 611, pp. 643–655. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40581-0_52

    Chapter  Google Scholar 

  28. Trabelsi, A., Elouedi, Z., Lefevre, E.: Ensemble enhanced evidential k-NN classifier through random subspaces. In: Antonucci, A., Cholvy, L., Papini, O. (eds.) ECSQARU 2017. LNCS (LNAI), vol. 10369, pp. 212–221. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-61581-3_20

    Chapter  Google Scholar 

  29. Tumer, K., Ghosh, J.: Classifier combining: analytical results and implications. In: Proceedings of the National Conference on Artificial Intelligence, pp. 126–132. Citeseer (1996)

    Google Scholar 

  30. Tumer, K., Oza, N.C.: Input decimated ensembles. Pattern Anal. Appl. 6(1), 65–77 (2003)

    Article  MathSciNet  Google Scholar 

  31. Turner, K., Oza, N.C.: Decimated input ensembles for improved generalization. In: Proceedings of International Joint Conference on Neural Network (IJCNN 1999), vol. 5, pp. 3069–3074. IEEE (1999)

    Google Scholar 

  32. Wang, S.-L., Li, X., Zhang, S., Gui, J., Huang, D.-S.: Tumor classification by combining PNN classifier ensemble with neighborhood rough set based gene reduction. Comput. Biol. Med. 40(2), 179–189 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. LARODEC, Institut Supérieur de Gestion de Tunis, Université de Tunis, Tunis, Tunisia

    Asma Trabelsi & Zied Elouedi

  2. Laboratoire de Génie Informatique et d’Automatique de l’Artois (LGI2A), Univ. Artois, EA 3926, 62400, Béthune, France

    Asma Trabelsi & Eric Lefevre

Authors
  1. Asma Trabelsi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zied Elouedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Eric Lefevre
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Asma Trabelsi .

Editor information

Editors and Affiliations

  1. Universidad de Cádiz, Cádiz, Cadiz, Spain

    Jesús Medina

  2. Universidad de Málaga, Málaga, Málaga, Spain

    Manuel Ojeda-Aciego

  3. Universidad de Granada, Granada, Spain

    José Luis Verdegay

  4. Universidad de Granada, Granada, Spain

    David A. Pelta

  5. Universidad de Málaga, Málaga, Málaga, Spain

    Inma P. Cabrera

  6. LIP6, Université Pierre et Marie Curie, CNRS, Paris, France

    Bernadette Bouchon-Meunier

  7. Iona College, New Rochelle, New York, USA

    Ronald R. Yager

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Trabelsi, A., Elouedi, Z., Lefevre, E. (2018). Ensemble Enhanced Evidential k-NN Classifier Through Rough Set Reducts. In: Medina, J., et al. Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Foundations. IPMU 2018. Communications in Computer and Information Science, vol 853. Springer, Cham. https://doi.org/10.1007/978-3-319-91473-2_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-91473-2_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-91472-5

  • Online ISBN: 978-3-319-91473-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation