Advertisement

Reverse Training: An Efficient Approach for Image Set Classification

  • Munawar Hayat
  • Mohammed Bennamoun
  • Senjian An
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8694)

Abstract

This paper introduces a new approach, called reverse training, to efficiently extend binary classifiers for the task of multi-class image set classification. Unlike existing binary to multi-class extension strategies, which require multiple binary classifiers, the proposed approach is very efficient since it trains a single binary classifier to optimally discriminate the class of the query image set from all others. For this purpose, the classifier is trained with the images of the query set (labelled positive) and a randomly sampled subset of the training data (labelled negative). The trained classifier is then evaluated on rest of the training images. The class of these images with their largest percentage classified as positive is predicted as the class of the query image set. The confidence level of the prediction is also computed and integrated into the proposed approach to further enhance its robustness and accuracy. Extensive experiments and comparisons with existing methods show that the proposed approach achieves state of the art performance for face and object recognition on a number of datasets.

Keywords

Image Set Classification Face and Object Recognition 

References

  1. 1.
    Eth80, http://www.d2.mpi-inf.mpg.de/Datasets/ETH80 (accessed: July 05, 2014)
  2. 2.
    Arandjelovic, O., Shakhnarovich, G., Fisher, J., Cipolla, R., Darrell, T.: Face recognition with image sets using manifold density divergence. In: 2005 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 581–588. IEEE (2005)Google Scholar
  3. 3.
    Cevikalp, H., Triggs, B.: Face recognition based on image sets. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010, pp. 2567–2573. IEEE (2010)Google Scholar
  4. 4.
    Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: LIBLINEAR: A library for large linear classification. Journal of Machine Learning Research 9, 1871–1874 (2008)zbMATHGoogle Scholar
  5. 5.
    Fanelli, G., Gall, J., Van Gool, L.: Real time head pose estimation with random regression forests. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 617–624. IEEE (2011)Google Scholar
  6. 6.
    Fanelli, G., Weise, T., Gall, J., Van Gool, L.: Real time head pose estimation from consumer depth cameras. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 101–110. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  7. 7.
    Gross, R., Shi, J.: The cmu motion of body (mobo) database. Tech. rep. (2001)Google Scholar
  8. 8.
    Harandi, M.T., Sanderson, C., Shirazi, S., Lovell, B.C.: Graph embedding discriminant analysis on grassmannian manifolds for improved image set matching. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2705–2712. IEEE (2011)Google Scholar
  9. 9.
    Hayat, M., Bennamoun, M., An, S.: Learning non-linear reconstruction models for image set classification. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2014)Google Scholar
  10. 10.
    Hayat, M., Bennamoun, M., El-Sallam, A.A.: Clustering of video-patches on grassmannian manifold for facial expression recognition from 3d videos. In: 2013 IEEE Workshop on Applications of Computer Vision, WACV (2013)Google Scholar
  11. 11.
    Hu, Y., Mian, A.S., Owens, R.: Face recognition using sparse approximated nearest points between image sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(10), 1992–2004 (2012)CrossRefGoogle Scholar
  12. 12.
    Khan, S.H., Bennamoun, M., Sohel, F., Togneri, R.: Automatic feature learning for robust shadow detection. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2014)Google Scholar
  13. 13.
    Kim, M., Kumar, S., Pavlovic, V., Rowley, H.: Face tracking and recognition with visual constraints in real-world videos. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8. IEEE (2008)Google Scholar
  14. 14.
    Kim, T.K., Kittler, J., Cipolla, R.: Discriminative learning and recognition of image set classes using canonical correlations. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6), 1005–1018 (2007)CrossRefGoogle Scholar
  15. 15.
    Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Video-based face recognition using probabilistic appearance manifolds. In: 2003 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, p. I–313. IEEE (2003)Google Scholar
  16. 16.
    Leibe, B., Schiele, B.: Analyzing appearance and contour based methods for object categorization. In: 2003 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, p. II–409. IEEE (2003)Google Scholar
  17. 17.
    Li, B.Y., Mian, A.S., Liu, W., Krishna, A.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: 2013 IEEE Workshop on Applications of Computer Vision (WACV), pp. 186–192. IEEE (2013)Google Scholar
  18. 18.
    Lu, J., Wang, G., Moulin, P.: Image set classification using holistic multiple order statistics features and localized multi-kernel metric learning. In: 2013 IEEE Conference on International Conference on Computer Vision, ICCV (2013)Google Scholar
  19. 19.
    Oja, E.: Subspace methods of pattern recognition, vol. 4. Research Studies Press, England (1983)Google Scholar
  20. 20.
    Ortiz, E., Wright, A., Shah, M.: Face recognition in movie trailers via mean sequence sparse representation-based classification. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3531–3538 (2013)Google Scholar
  21. 21.
    Ross, D.A., Lim, J., Lin, R.S., Yang, M.H.: Incremental learning for robust visual tracking. International Journal of Computer Vision 77(1-3), 125–141 (2008)CrossRefGoogle Scholar
  22. 22.
    Shakhnarovich, G., Fisher, J.W., Darrell, T.: Face recognition from long-term observations. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 851–865. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  23. 23.
    Uzair, M., Mahmood, A., Mian, A., McDonald, C.: A compact discriminative representation for efficient image-set classification with application to biometric recognition. In: 2013 International Conference on Biometrics (ICB). IEEE (2013)Google Scholar
  24. 24.
    Viola, P., Jones, M.J.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)CrossRefGoogle Scholar
  25. 25.
    Wang, R., Chen, X.: Manifold discriminant analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 429–436. IEEE (2009)Google Scholar
  26. 26.
    Wang, R., Guo, H., Davis, L.S., Dai, Q.: Covariance discriminative learning: A natural and efficient approach to image set classification. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2496–2503. IEEE (2012)Google Scholar
  27. 27.
    Wang, R., Shan, S., Chen, X., Gao, W.: Manifold-manifold distance with application to face recognition based on image set. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)Google Scholar
  28. 28.
    Yamaguchi, O., Fukui, K., Maeda, K.I.: Face recognition using temporal image sequence. In: 1998 IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 318–323. IEEE (1998)Google Scholar
  29. 29.
    Yang, M., Zhu, P., Gool, L.V., Zhang, L.: Face recognition based on regularized nearest points between image sets, pp. 1–7 (2013)Google Scholar
  30. 30.
    Zhu, P., Zhang, L., Zuo, W., Zhang, D.: From point to set: Extend the learning of distance metrics. In: 2013 IEEE Conference on International Conference on Computer Vision (ICCV). IEEE (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Munawar Hayat
    • 1
  • Mohammed Bennamoun
    • 1
  • Senjian An
    • 1
  1. 1.School of Computer Science and Software EnginneringThe University of Western AustraliaCrawleyAustralia

Personalised recommendations