Abstract
In many problems of machine learning and computer vision, there exists side information, i.e., information contained in the training data and not available in the testing phase. This motivates the recent development of a new learning approach known as learning with side information that aims to incorporate side information for improved learning algorithms. In this work, we describe a new training method of boosting classifiers that uses side information, which we term as AdaBoost+. In particular, AdaBoost+ employs a novel classification label imputation method to construct extra weak classifiers from the available information that simulate the performance of better weak classifiers obtained from the features in side information. We apply our method to two problems, namely handwritten digit recognition and facial expression recognition from low resolution images, where it demonstrates its effectiveness in classification performance.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ahmad, S., Tresp, V.: Some solutions to the missing feature problem in vision. In: NIPS (1998)
Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: Application to face recognition. IEEE T-PAMI 28(12), 2037–2041 (2006)
Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Recognizing facial expression: machine learning and application to spontaneous behavior. In: CVPR (2005)
Basu, S., Bilenko, M., Mooney, R.J.: A probabilistic framework for semisupervised clustering. In: KDD (2004)
Chapelle, O., Schölkopf, B., Zien, A.: Semi-Supervised Learning. MIT Press, Cambridge (2006)
Bishop, C.M.: Pattern Recognition and Machine Learning, 1st edn. Information Science and Statistics. Springer (2007)
Chechik, G., Tishby, N.: Extracting relevant structures with side information. In: NIPS (2002)
Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequences: temporal and static modeling. CVIU 91(1-2), 160–187 (2003)
Cover, T., Thomas, J.: Elements of Information Theory, 2nd edn. Wiley-Interscience (2006)
Dekel, O., Shamir, O., Xiao, L.: Learning to classify with missing and corrupted features. Machine learning (2010)
Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: CVPR (2009)
Friedman, J., Hastie, T., Tibshirani, R.: Additive logistic regression: a statistical view of boosting. Annals of Statistics 28(2), 337–407 (2000)
Garcia-Laencina, P.J., Sancho-Gomez, J.-L., Figueiras-Vidal, A.R.: Pattern classification with missing data: a review. Neural Comput. Appl. 19(2), 263–282 (2010)
Globerson, A., Roweis, S.: Nightmare at test time: robust learning by feature deletion. In: ICML (2006)
Gunturk, B.K., Batur, A.U., Altunbasak, Y., Hayes III, M.H., Mersereau, R.M.: Eigenface-domain super-resolution for face recognition. IEEE T-IP 12(5), 597–606 (2003)
Hennings-Yeomans, P.H., Baker, S., Kumar, B.V.K.V.: Simultaneous super-resolution and feature extraction for recognition of low-resolution faces. In: CVPR (2008)
Hoi, S.C.H., Jin, R., Lyu, M.R.: Learning nonparametric kernel matrices from pairwise constraints. In: ICML (2007)
Hwang, S.J., Sha, F., Grauman, K.: Sharing features between objects and their attributes. In: CVPR (2011)
Jia, K., Gong, S.: Multi-modal tensor face for simultaneous super-resolution and recognition. In: ICCV (2005)
Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: FG (2000)
Kuusela, P., Ocone, D.: Learning with side information: PAC learning bounds. J. Comput. Syst. Sci. 68(3), 521–545 (2004)
Tian, Y.-l.: Evaluation of face resolution for expression analysis. In: CVPRW (2004)
Liao, S., Fan, W., Chung, A.C.S., Yeung, D.-Y.: Facial expression recognition using advanced local binary patterns, tsallis entropies and global appearance features. In: ICIP (2006)
Little, R.J.A., Rubin., D.B.: Statistical Analysis with Missing Data. John Wiley and Sons, Inc. (1987)
Pechyony, D., Vapnik, V.: On the theory of learning with privileged information. In: NIPS (2010)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press (2005)
Saar-Tsechansky, M., Provost, F.: Handling missing values when applying classification model. Journal of Machine Learning Research 8, 1623–1657 (2007)
Shan, C., Gong, S., McOwan, P.W.: Robust facial expression recognition using local binary patterns. In: ICIP (2005)
Shashua, A., Wolf, L.: Kernel Feature Selection with Side Data Using a Spectral Approach. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3023, pp. 39–53. Springer, Heidelberg (2004)
Su, Y., Allen, M., Jurie, F.: Improving object classification using semantic attributes. In: BMVC (2010)
Tong, Y., Liao, W., Ji, Q.: Facial action unit recognition by exploiting their dynamic and semantic relationships. IEEE T-PAMI 29(10), 1683–1699 (2007)
Vapnik, V., Vashist, A.: A new learning paradigm: Learning using privileged information. Neural Networks 22(5-6), 544–557 (2009)
Vapnik, V., Vashist, A., Pavlovitch, N.: Learning using hidden information (learning with teacher). In: IJCNN (2009)
Xing, E.P., Ng, A.Y., Jordan, M.I., Russell, S.: Distance metric learning, with application to clustering with side-information. In: NIPS (2003)
Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE T-PAMI 31(1), 39–58 (2009)
Zhang, L., Samaras, D., Tomasi, D., Volkow, N., Goldstein, R.: Machine learning for clinical diagnosis from functional magnetic resonance imaging. In: CVPR (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, J., Liu, X., Lyu, S. (2013). Boosting with Side Information. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7724. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37331-2_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-37331-2_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37330-5
Online ISBN: 978-3-642-37331-2
eBook Packages: Computer ScienceComputer Science (R0)