An Ensemble Learning Approach Based on Missing-Valued Tables

  • Seiki UbukataEmail author
  • Taro Miyazaki
  • Akira Notsu
  • Katsuhiro Honda
  • Masahiro Inuiguchi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9437)


In classification problems on rough sets, the effectiveness of ensemble learning approaches such as bagging, random forests, and attribute sampling ensemble has been reported. We focus on occurrences of deficiencies in columns on the original decision table in random forests and attribute sampling ensemble approaches. In this paper, we generalize such deficiencies of columns to deficiencies of cells and propose an ensemble learning approach based on missing-valued decision tables. We confirmed the effectiveness of the proposed method for the classification performance through numerical experiments and the two-tailed Wilcoxon signed-rank test. Furthermore, we consider the robustness of the method in absences of condition attribute values of unknown objects.


Rough sets Ensemble learning MLEM2 Incomplete data Missing attribute values 


  1. 1.
    Błaszczyński, J., Słowiński, R., Stefanowski, J.: Variable consistency bagging ensembles. Trans. Rough Sets 5946, 40–52 (2010)Google Scholar
  2. 2.
    Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)zbMATHGoogle Scholar
  3. 3.
    Breiman, L.: Random forests. Mach. Learn. 45, 5–32 (2001)CrossRefGoogle Scholar
  4. 4.
    Grzymala-Busse, J. W., Siddhaye, S.: Rough set approaches to rule induction from incomplete data. In: Proceedings of the IPMU’2004, the 10th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, Perugia, vol. 2, pp. 923–930 (2004)Google Scholar
  5. 5.
    Grzymala-Busse, J.W., Clarka, P.G., Kuehnhausen, M.: Generalized probabilistic approximations of incomplete data. Int. J. Approximate Reasoning 55(1), 180–196 (2014). Part 2MathSciNetCrossRefGoogle Scholar
  6. 6.
    Kryszkiewicz, M.: Rough set approach to incomplete information systems. Inf. Sci. 112, 39–49 (1998)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Latkowski, R.: On decomposition for incomplete data. Fundamenta Informaticae 54, 1–16 (2003). IOS PressMathSciNetzbMATHGoogle Scholar
  8. 8.
    Miyazaki, T., Ubukata, S., Inuiguchi, M.: Ensemble learning approach based on rough set theory. In: Proceedings of the 59th Annual Conference of the Institute of Systems, Control and Information Engineers (ISCIE), Osaka, vol. 316, no. 6, pp. 1–2 (2015)Google Scholar
  9. 9.
    Pawlak, Z.: Rough sets. Int. J. Comput. Inf. Sci. 11(5), 341–356 (1982)CrossRefGoogle Scholar
  10. 10.
    Skowron, A.: Boolean reasoning for decision rules generation. In: Komorowski, J., Raś, Z.W. (eds.) ISMIS 1993. LNCS, vol. 689, pp. 295–305. Springer, Heidelberg (1993) CrossRefGoogle Scholar
  11. 11.
    Stefanowski, J., Tsoukias, A.: Incomplete information tables and rough classification. Comput. Intell. 17(3), 545–566 (2001)CrossRefGoogle Scholar
  12. 12.
    Stefanowski, J.: The bagging and n2-classifiers based on rules induced by MODLEM. In: Tsumoto, S., Słowiński, R., Komorowski, J., Grzymała-Busse, J.W. (eds.) RSCTC 2004. LNCS (LNAI), vol. 3066, pp. 488–497. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  13. 13.
    UCI machine learning repository.

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (, which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  • Seiki Ubukata
    • 1
    Email author
  • Taro Miyazaki
    • 2
  • Akira Notsu
    • 1
  • Katsuhiro Honda
    • 1
  • Masahiro Inuiguchi
    • 2
  1. 1.Graduate School of Engineering, Osaka Prefecture UniversitySakaiJapan
  2. 2.Graduate School of Engineering Science, Osaka UniversityToyonakaJapan

Personalised recommendations