ReliefF-ML: An Extension of ReliefF Algorithm to Multi-label Learning

  • Oscar Gabriel Reyes Pupo
  • Carlos Morell
  • Sebastián Ventura Soto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8259)


In the last years, the learning from multi-label data has attracted significant attention from a lot of researchers, motivated from an increasing number of modern applications that contain this type of data. Several methods have been proposed for solving this problem, however how to make feature weighting on multi-label data is still lacking in the literature. In multi-label data, each data point can be attributed to multiple labels simultaneously, thus a major difficulty lies in the determinations of the features useful for all multi-label concepts. In this paper, a new method for feature weighting in multi-label learning area is presented, based on the principles of the well-known ReliefF algorithm. The experimental stage shows the effectiveness of the proposal.


multi-label learning feature weighting ReliefF algorithm 


  1. 1.
    McCallum, A.: Multi-label text classification with a mixture model trained by EM. In: Working Notes of the AAAI-99 Workshop on Text Learning (1999)Google Scholar
  2. 2.
    Li, T., Ogihara, M.: Detecting emotion in music. In: Proceedings of the International Symposium on Music Information Retrieval (2003)Google Scholar
  3. 3.
    Yang, S., Kim, S., Ro, Y.: Semantic home photo categorization. IEEE Transactions on Circuits and Systems for Video Technology 17, 324–335 (2007)CrossRefGoogle Scholar
  4. 4.
    Kononenko, I.: Estimating attributes: Analysis and extensions of RELIEF. In: Bergadano, F., De Raedt, L. (eds.) ECML 1994. LNCS, vol. 784, pp. 171–182. Springer, Heidelberg (1994)CrossRefGoogle Scholar
  5. 5.
    Wettschereck, D., Aha, D.W., Mohri, T.: A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artificial Intelligence Review 11, 273–314 (1997)CrossRefGoogle Scholar
  6. 6.
    Brinker, K., Furnkranz, J., Hullermeier, E.: A unified model for multilabel classification and ranking. In: Proceedings of the 17th European Conference on Artificial Intelligence (ECAI 2006), pp. 489–493 (2006)Google Scholar
  7. 7.
    Reyes, O., Morell, C., Ventura, S.: Learning similarity metric to improve the performance of lazy multi-label ranking algorithms. In: IEEE Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 246–251 (2012)Google Scholar
  8. 8.
    Kong, D., Ding, C., Huang, H., Zhao, H.: Multi-label ReliefF and F-statistic Feature Selections for Image Annotation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), pp. 2352–2359 (2012)Google Scholar
  9. 9.
    Spolaôr, N., Cherman, E.A., Monard, M.C., Lee, H.D.: Filter approach feature selection methods to support multi-label learning based on reliefF and information gain. In: Barros, L.N., Finger, M., Pozo, A.T., Gimenénez-Lugo, G.A., Castilho, M. (eds.) SBIA 2012. LNCS, vol. 7589, pp. 72–81. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  10. 10.
    Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining Multi-label Data. In: Data Mining and Knowledge Discovery Handbook, 2nd edn., pp. 667–686. Springer (2010)Google Scholar
  11. 11.
    Wilson, D., Martinez, T.R.: Improved heterogeneous distance functions. Journal of Artificial Intelligence Research (JAIR) 6, 1–34 (1997)MathSciNetzbMATHGoogle Scholar
  12. 12.
    Zhang, M.L., Zhou, Z.H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)CrossRefzbMATHGoogle Scholar
  13. 13.
    Younes, Z., Abdallah, F., Denceux, T.: Multi-label classification algorithm derived from k-nearest neighbor rule with label dependencies. In: Proceedings of the 16th Eropean Signal Processing Conference, Lausanne, Switzerland (2008)Google Scholar
  14. 14.
    Xu, J.: Multi-label weighted k-nearest neighbor classifier with adaptive weight estimation. In: Lu, B.-L., Zhang, L., Kwok, J. (eds.) ICONIP 2011, Part II. LNCS, vol. 7063, pp. 79–88. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  15. 15.
    Tsoumakas, G., Spyromitros-Xioufi, E., Vilcek, J., Vlahavas, I.: MULAN: A java library for multi-label learning. Journal of Machine Learning Research 12, 2411–2414 (2011)Google Scholar
  16. 16.
    Demsar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Oscar Gabriel Reyes Pupo
    • 1
  • Carlos Morell
    • 2
  • Sebastián Ventura Soto
    • 3
  1. 1.University of HolguínCuba
  2. 2.Universidad Central ”Marta Abreu” de Las VillasCuba
  3. 3.University of CórdobaSpain

Personalised recommendations