Abstract
Multi-label classification has been applied to several applications since it can assign multiple class labels to an object. However, its effectiveness might be sacrificed due to high-dimensionality problem in both feature space and label space. To address these issues, several dimensionality reduction methods have been proposed to transform the high-dimensional spaces to low-dimensional spaces. This paper aims to provide a comprehensive review on ten-dimensionality reduction methods that applied to multi-label classification. These methods can be categorized into two main approaches: single space reduction and dual space reduction. While the former approach aims to reduce the complexity in either feature space or label space, the latter approach transforms both feature and label spaces into two subspaces. Moreover, a comparative study on single space reduction and dual space reduction approaches with five real-world datasets are also reported. The experimental results indicated that dual space reduction approach tends to give better performance comparing to the single reduction approach. Furthermore, experiments have been conducted to investigate the effect of dataset characteristics on classification performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
An, A., Cercone, N.: Rule quality measures for rule induction systems: description and evaluation. Comput. Intell. 17(3), 409–424 (2001)
Chekina, L., Rokach, L., Shapira, B.: Meta-learning for selecting a multi-label classification algorithm. In: IEEE 11th International Conference on Data Mining Workshops (ICDMW), pp. 220–227, Dec 2011
Golub, G., Reinsch, C.: Singular value decomposition and least squares solutions. Numerische Mathematik 14, 403–420 (1970)
Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. In: Proceedings of the Advances in Neural Information Processing Systems, vol. 22, pp. 772–780 (2009)
Madjarov, G., Kocev, D., Gjorgjevikj, D., Deroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recogn. 45(9), 3084–3104 (2012)
Miettinen, P.: The boolean column and column-row matrix decompositions. Data Min. Knowl. Disc. 17(1), 39–56 (2008)
Pacharawongsakda, E., Theeramunkong, T.: Towards more efficient multi-label classification using dependent and independent dual space reduction. In: Proceedings of the 16th Pacific-Asia Conference on Knowledge Discovery and Data Mining(PAKDD), PAKDD’12, pp. 383–394 (2012)
Pacharawongsakda, E., Theeramunkong, T.: A two-stage dimensionality reduction framework for multi-label classification. In: Proceedings of the PAKDD Workshop on quality issues, measures of interestingness and evaluation of data mining models (QIMIE), QIMIE 2013, pp. 330–341 (2013)
Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 1–27 (2011)
Schapire, R., Singer, Y.: Boostexter: a boosting-based system for text categorization. Machine Learn. 39(2/3), 135–168 (2000)
Tai, F., Lin, H.T.: Multi-label classification with principle label space transformation. In: Proceedings of the 2nd International Workshop on Learning from Multi-Label Data (MLD’10), pp. 45–52 (2010)
Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining Multi-label Data. Data Mining and Knowledge Discovery Handbook, 2nd edn. Springer, New York (2010)
Wang, H., Ding, C., Huang, H.: Multi-label linear discriminant analysis. In: Proceedings of the 11th European Conference on Computer Vision: Part VI, pp. 126–139. Springer, Berlin (2010)
Wicker, J., Pfahringer, B., Kramer, S.: Multi-label classification using boolean matrix decomposition. In: Proceedings of the 27th Annual ACM Symposium on Applied Computing, pp. 179–186. Springer, Berlin (2012)
Yu, K., Yu, S., Tresp, V.: Multi-label informed latent semantic indexing. In: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 258–265 (2005)
Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 99(PrePrints), 1 (2013)
Zhang, Y., Zhou, Z.H.: Multilabel dimensionality reduction via dependence maximization. ACM Trans. Knowl. Disc. Data (TKDD) 4(3), 1–21 (2010)
Acknowledgments
This work has been supported by the TRF Royal Golden Jubilee Ph.D. Program [PHD/0304/2551]; and the Government Research Fund via Thammasat University, Thailand, and the National Research University Project of Thailand Office of Higher Education Commission.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Pacharawongsakda, E., Theeramunkong, T. (2016). A Comparative Study on Single and Dual Space Reduction in Multi-label Classification. In: Skulimowski, A., Kacprzyk, J. (eds) Knowledge, Information and Creativity Support Systems: Recent Trends, Advances and Solutions. Advances in Intelligent Systems and Computing, vol 364. Springer, Cham. https://doi.org/10.1007/978-3-319-19090-7_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-19090-7_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19089-1
Online ISBN: 978-3-319-19090-7
eBook Packages: Computer ScienceComputer Science (R0)