Abstract
An accurate image classification system often requires many labeled training instances to train the classification models, which is expensive and time-consuming. Therefore, machine learning technologies which could utilize unlabeled instances to promote classification accuracy attract more attentions in the image classification field. Active learning and semi-supervised learning could both automatically discovery the hidden useful information from unlabeled instances. In this article, we try to combine active learning and semi-supervised learning to improve the classification performance of multi-class images. Specifically, extreme learning machine (ELM) is adopted as baseline classifier to accelerate the learning procedure, and an uncertainty estimation strategy is used to evaluate the information of each unlabeled instance. The experimental results on five multi-class image data sets show that the proposed method outperforms both random sampling and active learning. Meanwhile, we found that contrast with support vector machine (SVM), ELM could save much training time without obvious loss of performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alajlan, N., Pasolli, E., Melgani, F., Franzoso, A.: Large-scale image classification using active learning. IEEE Geosci. Remote Sens. Lett. 11, 259–263 (2014)
Tong, S., Chang, E.: Support vector machine active learning for image retrieval. In: Proceedings of the 9th ACM International Conference on Multimedia, pp. 107–118. ACM Press, New York, USA (2001)
Gu, Y.J., Jin, Z., Chiu, S.C.: Active learning combining uncertainty and diversity for multi-class image classification. IET Comput. Vis. (2014). doi:10.1049/iet-cvi.2014.0140
Li, L., Huaxiang, Z., Xiaojun, H., Feifei, S.: Semi-supervised image classification learning based on random feature subspace. In: Li, S., Liu, C., Wang, Y. (eds.) Pattern Recognition, pp. 237–242. Springer, Berlin, Heidelberg (2014)
Chen, R., Cao, Y.F., Sun, H.: Multi-class active learning and a semi-supervised learning for image classification (in Chinese). Acta Automatica Sinica 37, 954–962 (2011)
Settles, B.: Active learning literature survey. Univ. Wis. Madison 52, 55–66 (2010)
Chapelle, O., Scholkopf, B., Zien, A. (eds.): Semi-Supervised Learning. MIT Press, Cambridge (2006)
Zhou, Z.H., Li, M.: Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans. Knowl. Data Eng. 17, 1529–1541 (2005)
Joshi, A.J., Porikli, F., Papanikolopoulos, N.: Multi-class active learning for image classification. In: Proceedings of 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2372–2379. IEEE press, Miami, USA (2009)
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)
Huang, G.B., Wang, D.H., Lan, Y.: Extreme learning machine: a survey. Int. J. Mach. Learn. Cybernet. 2, 107–122 (2011)
Huang, G.B., Zhou, H., Ding, X., Zhang, R.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. B Cybern. 42, 513–529 (2012)
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagation errors. Nature 323, 533–536 (1986)
Fletcher, R.: Practical Methods of Optimization, Constrained Optimization, vol. 2. Wiley, New York (1981)
Platt, J.C.: Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods, Advances in Large-Margin Classifiers. MIT Press, Cambridge (2000)
Alcalá-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., GarcÃa, S., Sánchez, L., Herrera, F.: KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. J. Multiple-Valued Logic Soft Comput. 17, 255–287 (2011)
Chatfield, K., Lempitsky, V., Vedaldi, A., Zisserman, A.: The devil is in the details: an evaluation of recent feature encoding methods. In: British Machine Vision Conference (2011)
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157. IEEE Press (1999)
Guyon, I., Gawley, G., Dror, G., Lemaire, V.: Results of active learning challenge. JMLR Workshop Conf. Proc. 16, 19–45 (2011)
Acknowledgments
The work was supported in part by National Natural Science Foundation of China under Grant No. 61305058, No. 61473086, No. 61375001, Natural Science Foundation of Jiangsu Province of China under Grant No. BK20130471 and No. BK20140638, China Postdoctoral Science Foundation under grant No. 2013M540404, Jiangsu Planned Projects for Postdoctoral Research Funds under grant No. 1401037B, open fund of Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education under Grant No. MCCSE2013B01, the Open Project Program of Key Laboratory of Child Development and Learning Science of Ministry of Education, Southeast University (No. CDLS-2014-04), and A Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD), and the Fundamental Research Funds for the Central Universities.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, J., Yu, H., Yang, W., Sun, C. (2015). Combining Active Learning and Semi-Supervised Learning Based on Extreme Learning Machine for Multi-class Image Classification. In: He, X., et al. Intelligence Science and Big Data Engineering. Image and Video Data Engineering. IScIDE 2015. Lecture Notes in Computer Science(), vol 9242. Springer, Cham. https://doi.org/10.1007/978-3-319-23989-7_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-23989-7_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23987-3
Online ISBN: 978-3-319-23989-7
eBook Packages: Computer ScienceComputer Science (R0)