Fuzzy Rough Decision Trees for Multi-label Classification

  • Xiaoxue Wang
  • Shuang An
  • Hong Shi
  • Qinghua HuEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9437)


Multi-label classification exists widely in medical analysis or image annotation. Although there are some algorithms to train models for multi-label classification, few of them are able to extract comprehensible rules. In this paper, we propose a multi-label decision tree algorithm based on fuzzy rough sets, named ML-FRDT. This method can tackle with symbolic, continuous and fuzzy data. We conduct experiments on two multi-label datasets. And the experiment results show that ML-FRDT achieves good performance than some well-established multi-label classification algorithms.


Multi-label learning Fuzzy rough sets Decision tree 


  1. 1.
    McCallum., A.: Multi-label text classification with a mixture model trained by EM. In: AAAI\({^{\prime }}\)99 Workshop on Text Learning, pp. 1–7 (1999)Google Scholar
  2. 2.
    Lewis, D.D., Yang, Y., Rose, T.G., Li, F.: Rcv1: A new benchmark collection for text categorization research. J. Mach. Learn. Res. 5, 361–397 (2004)Google Scholar
  3. 3.
    Gao, S., Wu, W., Lee C.H., et al.: A MFoM learning approach to robust multiclass multi-label text categorization. In: Proceedings of the Twenty-first International Conference on Machine Learning (ICML 2004), pp. 42. ACM (2004)Google Scholar
  4. 4.
    Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37, 1757–1771 (2004)CrossRefGoogle Scholar
  5. 5.
    Wu, F., Han, Y., Tian, Q., Zhuang, Y.: Multi-label boosting for image annotation by structural grouping sparsity. In: Proceedings of the International Conference on Multimedia (MM 2010), pp. 15–24. ACM (2010)Google Scholar
  6. 6.
    Wang, Z., Hu, Y., Chia, L.T.: Multi-label learning by image-to-class distance for scene classification and image annotation. In: Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR 2010), pp. 105–112. ACM (2010)Google Scholar
  7. 7.
    Snoek, C.G., Worring, M., Van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of the 14th Annual ACM International Conference on Multimedia, pp. 421–430. ACM (2006)Google Scholar
  8. 8.
    Sanden, C., Zhang, J.Z.: Enhancing multi-label music genre classification through ensemble techniques. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2011), pp. 705–714. ACM (2011)Google Scholar
  9. 9.
    Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26, 1819–1837 (2013)CrossRefGoogle Scholar
  10. 10.
    Clare, A.J., King, R.D.: Knowledge discovery in multi-label phenotype data. In: Siebes, A., De Raedt, L. (eds.) PKDD 2001. LNCS (LNAI), vol. 2168, pp. 42–53. Springer, Heidelberg (2001) CrossRefGoogle Scholar
  11. 11.
    Zhang, M.L., Zhou, Z.H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40, 2038–2048 (2007)CrossRefGoogle Scholar
  12. 12.
    Zhang, M.L.: ML-RBF: RBF neural networks for multi-label learning. Neural Process. Lett. 29, 61–74 (2009)CrossRefGoogle Scholar
  13. 13.
    Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets\({^{*}}\). Int. J. Gen. Syst. 17, 191–209 (1990)CrossRefGoogle Scholar
  14. 14.
    Bhatt, R.B., Gopal, M.: FRCT: fuzzy-rough classification trees. Pattern Anal. Appl. 11, 73–88 (2008)MathSciNetCrossRefGoogle Scholar
  15. 15.
    An, S., Hu, Q.: Fuzzy rough decision trees. In: Yao, J.T., Yang, Y., Słowiński, R., Greco, S., Li, H., Mitra, S., Polkowski, L. (eds.) RSCTC 2012. LNCS, vol. 7413, pp. 397–404. Springer, Heidelberg (2012) CrossRefGoogle Scholar
  16. 16.
    Zhang, L., Hu, Q., Duan, J., Wang, X.: Multi-label feature selection with fuzzy rough sets. In: Miao, D., Pedrycz, W., Slezak, D., Peters, G., Hu, Q., Wang, R. (eds.) RSKT 2014. LNCS, vol. 8818, pp. 121–128. Springer, Heidelberg (2014) Google Scholar
  17. 17.
    Quinlan, J.R.: C4. 5: Programs for Machine Learning. Elsevier, Burlington (1993) Google Scholar
  18. 18.
    Godbole, S., Sarawagi, S.: Discriminative methods for multi-labeled classification. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 22–30. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  19. 19.
    Correa, G.E., Plastino, A., Freitas, A.A.: A genetic algorithm for optimizing the label ordering in multi-label classifier chains. In: IEEE 25th International Conference on Tools with Artificial Intelligence (ICTAI) 2013, pp. 469–476. IEEE (2013)Google Scholar
  20. 20.
    Briggs, F., Huang, Y., Raich, R., Eftaxias, K., Lei, Z., Cukierski, W., et al.: The 9th annual MLSP competition: new methods for acoustic classification of multiple simultaneous bird species in a noisy environment. In: IEEE International Workshop on Machine Learning for Signal Processing (MLSP) 2013, pp. 1–8. IEEE (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (, which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  1. 1.School of Computer Science and TechnologyTianjin UniversityTianjinChina

Personalised recommendations