Abstract
In the last years, the learning from multi-label data has attracted significant attention from a lot of researchers, motivated from an increasing number of modern applications that contain this type of data. Several methods have been proposed for solving this problem, however how to make feature weighting on multi-label data is still lacking in the literature. In multi-label data, each data point can be attributed to multiple labels simultaneously, thus a major difficulty lies in the determinations of the features useful for all multi-label concepts. In this paper, a new method for feature weighting in multi-label learning area is presented, based on the principles of the well-known ReliefF algorithm. The experimental stage shows the effectiveness of the proposal.
Chapter PDF
References
McCallum, A.: Multi-label text classification with a mixture model trained by EM. In: Working Notes of the AAAI-99 Workshop on Text Learning (1999)
Li, T., Ogihara, M.: Detecting emotion in music. In: Proceedings of the International Symposium on Music Information Retrieval (2003)
Yang, S., Kim, S., Ro, Y.: Semantic home photo categorization. IEEE Transactions on Circuits and Systems for Video Technology 17, 324–335 (2007)
Kononenko, I.: Estimating attributes: Analysis and extensions of RELIEF. In: Bergadano, F., De Raedt, L. (eds.) ECML 1994. LNCS, vol. 784, pp. 171–182. Springer, Heidelberg (1994)
Wettschereck, D., Aha, D.W., Mohri, T.: A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artificial Intelligence Review 11, 273–314 (1997)
Brinker, K., Furnkranz, J., Hullermeier, E.: A unified model for multilabel classification and ranking. In: Proceedings of the 17th European Conference on Artificial Intelligence (ECAI 2006), pp. 489–493 (2006)
Reyes, O., Morell, C., Ventura, S.: Learning similarity metric to improve the performance of lazy multi-label ranking algorithms. In: IEEE Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 246–251 (2012)
Kong, D., Ding, C., Huang, H., Zhao, H.: Multi-label ReliefF and F-statistic Feature Selections for Image Annotation. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), pp. 2352–2359 (2012)
Spolaôr, N., Cherman, E.A., Monard, M.C., Lee, H.D.: Filter approach feature selection methods to support multi-label learning based on reliefF and information gain. In: Barros, L.N., Finger, M., Pozo, A.T., Gimenénez-Lugo, G.A., Castilho, M. (eds.) SBIA 2012. LNCS, vol. 7589, pp. 72–81. Springer, Heidelberg (2012)
Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining Multi-label Data. In: Data Mining and Knowledge Discovery Handbook, 2nd edn., pp. 667–686. Springer (2010)
Wilson, D., Martinez, T.R.: Improved heterogeneous distance functions. Journal of Artificial Intelligence Research (JAIR) 6, 1–34 (1997)
Zhang, M.L., Zhou, Z.H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)
Younes, Z., Abdallah, F., Denceux, T.: Multi-label classification algorithm derived from k-nearest neighbor rule with label dependencies. In: Proceedings of the 16th Eropean Signal Processing Conference, Lausanne, Switzerland (2008)
Xu, J.: Multi-label weighted k-nearest neighbor classifier with adaptive weight estimation. In: Lu, B.-L., Zhang, L., Kwok, J. (eds.) ICONIP 2011, Part II. LNCS, vol. 7063, pp. 79–88. Springer, Heidelberg (2011)
Tsoumakas, G., Spyromitros-Xioufi, E., Vilcek, J., Vlahavas, I.: MULAN: A java library for multi-label learning. Journal of Machine Learning Research 12, 2411–2414 (2011)
Demsar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7, 1–30 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pupo, O.G.R., Morell, C., Soto, S.V. (2013). ReliefF-ML: An Extension of ReliefF Algorithm to Multi-label Learning. In: Ruiz-Shulcloper, J., Sanniti di Baja, G. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2013. Lecture Notes in Computer Science, vol 8259. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41827-3_66
Download citation
DOI: https://doi.org/10.1007/978-3-642-41827-3_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41826-6
Online ISBN: 978-3-642-41827-3
eBook Packages: Computer ScienceComputer Science (R0)