Advertisement

Person Re-identification with Patch-Based Local Sparse Matching and Metric Learning

  • Bo JiangEmail author
  • Yibing Lv
  • Aihua Zheng
  • Bin Luo
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11902)

Abstract

Recently, patch based matching has been demonstrated effectively to address the spatial misalignment issue caused by camera-view changes or human pose variations in person re-identification (Re-ID) problem. In this paper, we propose a novel local sparse matching model to obtain a reliable patch-wise matching for Re-ID problem. In particular, in the training phase, we develop a robust Local Sparse Matching model to learn more precise corresponding relationship between patches of positive sample image pairs. In the testing phase, we adopt a local-global distance metric learning for Re-ID task by considering global and local information simultaneously. Extensive experiments on four benchmarks demonstrate the effectiveness of our approach.

Keywords

Person re-identification Graph matching Metric learning 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgment

This work was supported by the National Natural Science Foundation of China (61602001), Natural Science Foundation of Anhui Province (1708085QF139), Open Project Program of the National Laboratory of Pattern Recognition (NLPR) (201900046).

References

  1. 1.
    Ahmed, E., Jones, M., Marks, T.K.: An improved deep learning architecture for person re-identification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 3908–3916 (2015)Google Scholar
  2. 2.
    Bak, S., Carr, P.: Person re-identification using deformable patch metric learning. In: International Workshop on Applications of Computer Vision, pp. 1–9 (2016)Google Scholar
  3. 3.
    Jiang, B., Tang, J., Ding, C., Luo, B.: A local sparse model for matching problem. In: American Association for Artificial Intelligence, pp. 3790–3796 (2015)Google Scholar
  4. 4.
    Jiang, B., Tang, J., Ding, C., Luo, B.: Binary constraint preserving graph matching. In: Proceedings of Computer Vision and Pattern Recognition, pp. 4402–4409 (2017)Google Scholar
  5. 5.
    Chen, J., Wang, Y., Qin, J., Liu, L., Shao, L.: Fast person re-identification via cross-camera semantic binary transformation. In: Proceedings of Computer Vision and Pattern Recognition, p. 1 (2017)Google Scholar
  6. 6.
    Chen, J., Zhang, Z., Wang, Y.: Relevance metric learning for person re-identification by exploiting listwise similarities. IEEE Trans. Image Process. 24(12), 4741–4755 (2015)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Chen, S.Z., Guo, C.C., Lai, J.H.: Deep ranking for person re-identification via joint representation learning. IEEE Trans. Image Process. 25(5), 2353–2367 (2016)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Chen, Y.C., Zheng, W.S., Lai, J.: Mirror representation for modeling view-specific transform in person re-identification. In: International Joint Conference on Artificial Intelligence, pp. 3402–3408 (2015)Google Scholar
  9. 9.
    Cheng, D., Gong, Y., Zhou, S., Wang, J., Zheng, N.: Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In: Proceedings of Computer Vision and Pattern Recognition, pp. 1335–1344 (2016)Google Scholar
  10. 10.
    Gray, D., Brennan, S., Tao, H.: Evaluating appearance models for recognition, reacquisition, and tracking. In: Proceedings of International Workshop on Performance Evaluation for Tracking and Surveillance, pp. 1–7 (2007)Google Scholar
  11. 11.
    Jiang, B., Tang, J., Ding, C., Gong, Y., Luo, B.: Graph matching via multiplicative update algorithm. In: Proceedings of Neural Information Processing Systems, pp. 3187–3195 (2017)Google Scholar
  12. 12.
    Koestinger, M., Hirzer, M., Wohlhart, P., Roth, P.M., Bischof, H.: Large scale metric learning from equivalence constraints. In: Computer Vision and Pattern Recognition, pp. 2288–2295 (2012)Google Scholar
  13. 13.
    Li, W., Zhao, R., Wang, X.: Human reidentification with transferred metric learning. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7724, pp. 31–44. Springer, Heidelberg (2013).  https://doi.org/10.1007/978-3-642-37331-2_3CrossRefGoogle Scholar
  14. 14.
    Li, Z., Chang, S., Liang, F., Huang, T.S., Cao, L., Smith, J.R.: Learning locally-adaptive decision functions for person verification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 3610–3617 (2013)Google Scholar
  15. 15.
    Liao, S., Hu, Y., Zhu, X., Li, S.Z.: Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of Computer Vision and Pattern Recognition, pp. 2197–2206 (2015)Google Scholar
  16. 16.
    Lin, W., et al.: Learning correspondence structures for person re-identification. IEEE Trans. Image Process. 26(5), 2438–2453 (2017)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Ma, L., Yang, X., Xu, Y., Zhu, J.: A generalized emd with body prior for pedestrian identification. J. Vis. Commun. Image Represent. 24(6), 708–716 (2013)CrossRefGoogle Scholar
  18. 18.
    Martinel, N., Das, A., Micheloni, C., Roy-Chowdhury, A.K.: Temporal model adaptation for person re-identification. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9908, pp. 858–877. Springer, Cham (2016).  https://doi.org/10.1007/978-3-319-46493-0_52CrossRefGoogle Scholar
  19. 19.
    Matsukawa, T., Okabe, T., Suzuki, E., Sato, Y.: Hierarchical gaussian descriptor for person re-identification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 1363–1372 (2016)Google Scholar
  20. 20.
    Oreifej, O., Mehran, R., Shah, M.: Human identity recognition in aerial images. In: Computer Vision and Pattern Recognition, pp. 709–716 (2010)Google Scholar
  21. 21.
    Paisitkriangkrai, S., Shen, C., Van Den Hengel, A.: Learning to rank in person re-identification with metric ensembles. In: Proceedings of Computer Vision and Pattern Recognition, pp. 1846–1855 (2015)Google Scholar
  22. 22.
    Roth, P.M., Hirzer, M., Köstinger, M., Beleznai, C., Bischof, H.: Mahalanobis distance learning for person re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C. (eds.) Person Re-Identification. ACVPR, pp. 247–267. Springer, London (2014).  https://doi.org/10.1007/978-1-4471-6296-4_12CrossRefzbMATHGoogle Scholar
  23. 23.
    Shen, Y., Lin, W., Yan, J., Xu, M., Wu, J., Wang, J.: Person re-identification with correspondence structure learning. In: Proceedings of International Conference on Computer Vision, pp. 3200–3208 (2015)Google Scholar
  24. 24.
    Sheng, H., Huang, Y., Zheng, Y., Chen, J., Xiong, Z.: Person re-identification via learning visual similarity on corresponding patch pairs. In: Zhang, S., Wirsing, M., Zhang, Z. (eds.) KSEM 2015. LNCS (LNAI), vol. 9403, pp. 787–798. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-25159-2_73CrossRefGoogle Scholar
  25. 25.
    Shi, Z., Hospedales, T.M., Xiang, T.: Transferring a semantic representation for person re-identification and search. In: Proceedings of Computer Vision and Pattern Recognition, pp. 4184–4193 (2015)Google Scholar
  26. 26.
    Suh, Y., Adamczewski, K., Lee, K.M.: Subgraph matching using compactness prior for robust feature correspondence. In: Proceedings of Computer Vision and Pattern Recognition, p. 1 (2015)Google Scholar
  27. 27.
    Wang, F., Zuo, W., Lin, L., Zhang, D., Zhang, L.: Joint learning of single-image and cross-image representations for person re-identification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 1288–1296 (2016)Google Scholar
  28. 28.
    Xiong, F., Gou, M., Camps, O., Sznaier, M.: Person re-identification using kernel-based metric learning methods. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 1–16. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-10584-0_1CrossRefGoogle Scholar
  29. 29.
    Yang, Y., Wen, L., Lyu, S., Li, S.Z.: Unsupervised learning of multi-level descriptors for person re-identification. In: American Association for Artificial Intelligence, p. 1 (2017)Google Scholar
  30. 30.
    Yang, Y., Yang, J., Yan, J., Liao, S., Yi, D., Li, S.Z.: Salient color names for person re-identification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 536–551. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-10590-1_35CrossRefGoogle Scholar
  31. 31.
    Zhang, L., Xiang, T., Gong, S.: Learning a discriminative null space for person re-identification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 1239–1248 (2016)Google Scholar
  32. 32.
    Zhang, Y., Li, X., Zhao, L., Zhang, Z.: Semantics-aware deep correspondence structure learning for robust person re-identification. In: International Joint Conference on Artificial Intelligence, pp. 3545–3551 (2016)Google Scholar
  33. 33.
    Zhao, R., Ouyang, W., Wang, X.: Unsupervised salience learning for person re-identification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 3586–3593 (2013)Google Scholar
  34. 34.
    Zhao, R., Ouyang, W., Wang, X.: Learning mid-level filters for person re-identification. In: Proceedings of Computer Vision and Pattern Recognition, pp. 144–151 (2014)Google Scholar
  35. 35.
    Zhao, R., Oyang, W., Wang, X.: Person re-identification by saliency learning. IEEE Trans. Pattern Anal. Mach. Intell. 39(2), 356–370 (2017)CrossRefGoogle Scholar
  36. 36.
    Zhou, Q., et al.: Graph correspondence transfer for person re-identification, p. 1. arXiv preprint. arXiv:1804.00242 (2018)

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.School of Computer Science and TechnologyAnhui UniversityHefeiChina

Personalised recommendations

Cite paper

Buy options