Skip to main content
SpringerLink
Log in

An Extended Sparse Classification Framework for Domain Adaptation in Video Surveillance

  • Conference paper
  • First Online:
Computer Vision – ACCV 2016 Workshops (ACCV 2016)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10118))

Included in the following conference series:

Abstract

Still-to-video face recognition (FR) systems used in video surveillance applications capture facial trajectories across a network of distributed video cameras and compare them against stored distributed facial models. Currently, the performance of state-of-the-art systems is severely affected by changes in facial appearance caused by variations in, e.g., pose, illumination and scale in different camera viewpoints. Moreover, since an individual is typically enrolled using one or few reference stills captured during enrolment, face models are not robust to intra-class variation. In this paper, the Extended Sparse Representation Classification through Domain Adaptation (ESRC-DA) algorithm is proposed to improve performance of still-to-video FR. The system’s facial models are thereby enhanced by integrating variational information from its operational domain. In particular, robustness to intra-class variations is improved by exploiting: (1) an under-sampled dictionary from target reference facial stills captured under controlled conditions; and (2) an auxiliary dictionary from an abundance of unlabelled facial trajectories captured under different conditions, from each camera viewpoint in the surveillance network. Accuracy and efficiency of the proposed technique is compared to state-of-the-art still-to-video FR techniques using videos from the Chokepoint and COX-S2V databases. Results indicate that ESRC-DA with dictionary learning of unlabelled trajectories provides the highest level of accuracy, while maintaining a low complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chen, S., Mau, S., Harandi, M.T., Sanderson, C., Bigdeli, A., Lovell, B.C.: Face recognition from still images to video sequences: a local-feature-based framework. EURASIP J. Image Video Process. 2011, 790598 (2011)

    Google Scholar 

  2. Kamgar-Parsi, B., Lawson, W., Kamgar-Parsi, B.: Toward development of a face recognition system for watchlist surveillance. IEEE Trans. PAMI 33, 1925–1937 (2011)

    Article  Google Scholar 

  3. Dewan, M.A.A., Granger, E., Marcialis, G.L., Sabourin, R., Roli, F.: Adaptive appearance model tracking for still-to-video face recognition. Pattern Recogn. 49, 129–151 (2016)

    Article  Google Scholar 

  4. Pato, J., Millett, L.: Biometric recognition: challenges and opportunities. Whither Biometrics Committee, National Research Council of the NSA (2010)

    Google Scholar 

  5. Pagano, C.C., Granger, E., Sabourin, R., Gorodnichy, D.O.: Detector ensembles for face recognition in video surveillance. In: IJCNN, pp. 1–8 (2012)

    Google Scholar 

  6. Tan, X., Chen, S., Zhou, Z.H., Zhang, F.: Face recognition from a single image per person: a survey. Pattern Recogn. 39, 1725–1745 (2006)

    Article  MATH  Google Scholar 

  7. Kan, M., Shan, S., Su, Y., Xu, D., Chen, X.: Adaptive discriminant learning for face recognition. Pattern Recog. 46, 2497–2509 (2013)

    Article  Google Scholar 

  8. Bashbaghi, S., Granger, E., Sabourin, R., Bilodeau, G.: Ensembles of exemplar-SVMs for video face recognition from a single sample per person. In: IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 1–6 (2015)

    Google Scholar 

  9. Patel, V.M., Gopalan, R., Li, R., Chellappa, R.: Visual domain adaptation: a survey of recent advances. IEEE Sig. Process. Mag. 32, 53–69 (2015)

    Article  Google Scholar 

  10. Minku, L.L., White, A.P., Yao, X.: The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Trans. Knowl. Data Eng. 22, 730–742 (2010)

    Article  Google Scholar 

  11. Snidaro, L., Garca, J., Llinas, J.: Context-based information fusion: a survey and discussion. Inf. Fusion 25, 16–31 (2015)

    Article  Google Scholar 

  12. Huang, Z., Wang, R., Shan, S., Li, X., Chen, X.: Log-euclidean metric learning on symmetric positive definite manifold with application to image set classification. In: ICML. JMLR Workshop and Conference Proceedings (2015)

    Google Scholar 

  13. Margolis, A.: Automatic annotation of spoken language using out-of-domain resources and domain adaptation. IEEE Trans. Knowl. Data Eng. (2011)

    Google Scholar 

  14. Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 1345–1359 (2010)

    Article  Google Scholar 

  15. Deng, W., Hu, J., Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. PAMI 34, 1864–1870 (2012)

    Article  Google Scholar 

  16. Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 210–227 (2009)

    Article  Google Scholar 

  17. Naseem, I., Togneri, R., Bennamoun, M.: Sparse representation for video-based face recognition. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 219–228. Springer, Heidelberg (2009). doi:10.1007/978-3-642-01793-3_23

    Chapter  Google Scholar 

  18. Nagendra, S., Baskaran, R., Abirami, S.: Video-based face recognition and face-tracking using sparse representation based categorization. Procedia Comput. Sci. 54, 746–755 (2015). International Conference on Data Mining and Warehousing

    Article  Google Scholar 

  19. Cui, Z., Chang, H., Shan, S., Ma, B., Chen, X.: Joint sparse representation for video-based face recognition. Neurocomputing 135, 306–312 (2014)

    Article  Google Scholar 

  20. Gu, J., Liu, L., Hu, H.: Patch-based sparse dictionary representation for face recognition with single sample per person. In: Yang, J., Yang, J., Sun, Z., Shan, S., Zheng, W., Feng, J. (eds.) Biometric Recognition. LNCS, vol. 9428, pp. 120–126. Springer, Heidelberg (2015). doi:10.1007/978-3-319-25417-3_15

    Chapter  Google Scholar 

  21. Qiu, Q., Patel, V.M., Turaga, P., Chellappa, R.: Domain adaptive dictionary learning. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7575, pp. 631–645. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33765-9_45

    Chapter  Google Scholar 

  22. Ni, J., Qiu, Q., Chellappa, R.: Subspace interpolation via dictionary learning for unsupervised domain adaptation. In: IEEE Conference on Computer Vision and Pattern Recognition (2013)

    Google Scholar 

  23. Qiu, Q., Ni, J., Chellappa, R.: Dictionary-based domain adaptation methods for the re-identification of faces. In: Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.) Person Re-Identification. ACVPR, pp. 269–285. Springer, Heidelberg (2014). doi:10.1007/978-1-4471-6296-4_13

    Chapter  Google Scholar 

  24. Shekhar, S., Patel, V.M., Nguyen, H.V., Chellappa, R.: Generalized domain-adaptive dictionaries. In: IEEE Conference on Computer Vision and Pattern Recognition (2013)

    Google Scholar 

  25. Duan, L., Tsang, I.W., Xu, D., Chua, T.: Domain adaptation from multiple sources via auxiliary classifiers. In: Proceedins of International Conference on Machine Learning (2009)

    Google Scholar 

  26. Duan, L., Tsang, I.W., Xu, D.: Domain transfer multiple kernel learning. IEEE Trans. Pattern Anal. Mach. Intell. 34, 465–479 (2012)

    Article  Google Scholar 

  27. Guo, H., Jiang, Z., Davis, L.S.: Discriminative dictionary learning with pairwise constraints. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7724, pp. 328–342. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37331-2_25

    Chapter  Google Scholar 

  28. Shafiee, S., Kamangar, F., Athitsos, V., Huang, J.: The role of dictionary learning on sparse representation-based classification. In: International Conference on PErvasive Technologies Related to Assistive Environments (2013)

    Google Scholar 

  29. Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. Trans. Sig. Proc. 54, 4311–4322 (2006)

    Article  Google Scholar 

  30. Engan, K., Aase, S.O., Hakon Husoy, J.: Method of optimal directions for frame design. In: International Conference on Acoustics, Speech, and Signal Processing (1999)

    Google Scholar 

  31. Nourbakhsh, F., Bulò, S.R., Pelillo, M.: A matrix factorization approach to graph compression with partial information. Int. J. Mach. Learn. Cybern. 6, 523–536 (2015)

    Article  Google Scholar 

  32. Nourbakhsh, F., Granger, E.: Learning of graph compressed dictionaries for sparse representation classification. In: International Conference on Pattern Recognition Applications and Methods, ICPRAM, pp. 309–316 (2016)

    Google Scholar 

  33. Yang, M., Van Gool, L., Zhang, L.: Sparse variation dictionary learning for face recognition with a single training sample per person. In: The IEEE International Conference on Computer Vision (ICCV) (2013)

    Google Scholar 

  34. Wei, C., Wang, Y.F.: Undersampled face recognition via robust auxiliary dictionary learning. IEEE Trans. Image Process. 24, 1722–1734 (2015)

    Article  MathSciNet  Google Scholar 

  35. Wong, Y., Chen, S., Mau, S., Sanderson, C., Lovell, B.C.: Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition. In: (CVPR) Workshops on Biometrics. IEEE (2011)

    Google Scholar 

  36. Huang, Z., Shan, S., Wang, R., Zhang, H., Lao, S., Kuerban, A., Chen, X.: A benchmark and comparative study of video-based face recognition on COX face database. IEEE Trans. Image Proccess. 24, 5967–5981 (2015)

    Article  MathSciNet  Google Scholar 

  37. Yang, M., Zhang, L., Yang, J., Zhang, D.: Robust sparse coding for face recognition. In: International Conference on Computer Vision and Pattern Recognition (2011)

    Google Scholar 

  38. Elhamifar, E., Sapiro, G., Vidal, R.: See all by looking at a few: sparse modeling for finding representative objects. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)

    Google Scholar 

  39. Donoho, D.L., Tsaig, Y.: Fast solution of \({\rm l}_1\)-norm minimization problems when the solution may be sparse. IEEE Trans. Inf. Theory 54, 4789–4812 (2008)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratoire d’imagerie de vision et d’intelligence artificielle École de technologie supérieure, Université du Québec, Montréal, Canada

    Farshad Nourbakhsh, Eric Granger & Giorgio Fumera

  2. Department of Electrical and Electronic Engineering, University of Cagliari Piazza d’Armi, 09123, Cagliari, Italy

    Farshad Nourbakhsh, Eric Granger & Giorgio Fumera

Authors
  1. Farshad Nourbakhsh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eric Granger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Giorgio Fumera
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Farshad Nourbakhsh .

Editor information

Editors and Affiliations

  1. Institute of Information Science, Academia Sinica, Taipei, Taiwan

    Chu-Song Chen

  2. Tsinghua University , Beijing, China

    Jiwen Lu

  3. School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore

    Kai-Kuang Ma

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Nourbakhsh, F., Granger, E., Fumera, G. (2017). An Extended Sparse Classification Framework for Domain Adaptation in Video Surveillance. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10118. Springer, Cham. https://doi.org/10.1007/978-3-319-54526-4_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-54526-4_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-54525-7

  • Online ISBN: 978-3-319-54526-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation