Skip to main content
SpringerLink
Log in

Person Re-Identification from different views based on dynamic linear combination of distances

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Person re-identification from videos taken by multiple cameras from different views is a very challenging problem that has attracted growing interest in last years. In fact, the same person from significant cross-view has different appearances from clothes change, illumination, and cluttered background. To deal with this issue, we use the skeleton information since it is not affected by appearance and pose variations. The skeleton as an input is projected on the Grassmann manifold in order to model the human motion as a trajectory. Then, we calculate the distance on the Grassmann manifold, in order to guarantee invariance against rotation, as well as local distances allowing to discriminate anthropometric for each person. The two distances are thereafter combined while defining dynamically the optimal combination weight for each person. Indeed, a machine learning process learns to predict the best weight for each person according to the rank metric of its re-identification results. Experimental results, using challenging 3D (IAS-Lab RGBD-ID and BIWI-Lab RGBD-ID) and 2D (Prid-2011 and i-LIDS-VID) benchmarks, show that the proposed method can boost re-identification ranking thanks to its ability to define the optimal weight for each person independently of view and pose changes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Bai S, Tang P, Torr PHS, Latecki L J (2019) Re-ranking via metric fusion for object retrieval and person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 740–749

  2. Barbosa I B, Cristani M, Del Bue A, Bazzani L, Murino V (2012) Re-identification with rgb-d sensors. In: European Conference on Computer Vision. Springer, pp 433–442

  3. Belagiannis V, Amin S, Andriluka M, Schiele B, Navab N, Ilic S (2014) 3d pictorial structures for multiple human pose estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1669–1676

  4. Belmonte-Hernández A, Solachidis V, Theodoridis T, Hernandez-Penaloza G, Conti G, Vretos N, Alvarez F, Daras P (2017) Person tracking association using multi-modal systems. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE, pp 1–6

  5. Cao Z, Simon T, Wei S-E, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 7291–7299

  6. Chen D, Li H, Xiao T, Yi S, Wang X (2018) Video person re-identification with competitive snippet-similarity aggregation and co-attentive snippet embedding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1169–1178

  7. Chen Y, He F, Li H, Zhang D, Wu Y (2020) A full migration bbo algorithm with enhanced population quality bounds for multimodal biomedical image registration. Appl Soft Comput:106335

  8. Elaoud A, Barhoumi W, Drira H, Zagrouba E (2017) Analysis of skeletal shape trajectories for person re-identification. In: International Conference on Advanced Concepts for Intelligent Vision Systems. Springer, pp 138–149

  9. Fan X, Jiang W, Luo H, Fei M (2019) Spherereid: Deep hypersphere manifold embedding for person re-identification. J Vis Commun Image Represent 60:51–58

    Article  Google Scholar 

  10. Gao Z, Zhang H, Dong S, Sun S, Wang X, Yang G, Wu W, Li S, de Albuquerque V H C (2020) Salient object detection in the distributed cloud-edge intelligent network. IEEE Netw 34(2):216–224

    Article  Google Scholar 

  11. Geng Y, Liang R-Z, Li W, Wang J, Liang G, Xu C, Wang J-Y (2017) Learning convolutional neural network to maximize pos@ top performance measure. European Symposium on Artificial Neural Networks(ESANN)

  12. Geng Y, Zhang G, Li W, Gu Y, Liang R-Z, Liang G, Wang J, Wu Y, Patil N, Wang J-Y (2017) A novel image tag completion method based on convolutional neural transformation. In: International conference on artificial neural networks. Springer, pp 539–546

  13. Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Scandinavian conference on Image analysis. Springer, pp 91–102

  14. Imani Z, Soltanizadeh H (2016) Person reidentification using local pattern descriptors and anthropometric measures from videos of kinect sensor. IEEE Sens J 16:6227–6238

    Article  Google Scholar 

  15. Imani Z, Soltanizadeh H, Orouji AA (2019) Short-term person re-identification using rgb, depth and skeleton information of rgb-d sensors. Iran J Sci Technol Trans Electr Eng:1–13

  16. Jing Y, Si C, Wang J, Wang W, Wang L, Tan T (2018) Cascade attention network for person search: Both image and text-image similarity selection. CoRR arXiv:1809.08440

  17. Khan FM, Brèmond F (2017) Multi-shot person re-identification using part appearance mixture. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, pp 605–614

  18. Li H, He F, Chen Y, Luo J (2020) Multi-objective self-organizing optimization for constrained sparse array synthesis. Swarm Evol Comput 58:100743

    Article  Google Scholar 

  19. Li H, He F, Liang Y, Quan Q (2019) A dividing-based many-objective evolutionary algorithm for large-scale feature selection. Soft Comput:1–20

  20. Li J, Wang J, Tian Q, Gao W, Zhang S (2019) Global-local temporal representations for video person re-identification. In: Proceedings of the IEEE International Conference on Computer Vision, pp 3958–3967

  21. Li W, Zhao R, Xiao T, Wang X (2014) Deepreid: Deep filter pairing neural network for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 152–159

  22. Li Y-J, Luo Z, Weng X, Kitani KM (2020) Learning shape representations for clothing variations in person re-identification. CoRR arXiv:2003.07340

  23. Liang G, Lan X, Chen X, Zheng K, Wang S, Zheng N (2019) Cross-view person identification based on confidence-weighted human pose matching. IEEE Trans Image Process 28(8):3821–3835

    Article  MathSciNet  Google Scholar 

  24. Liu H, Jie Z, Jayashree K, Qi M, Jiang J, Yan S, Feng J (2017) Video-based person re-identification with accumulative motion context. IEEE Trans Circ Syst Video Technol 28(10):2788–2802

    Article  Google Scholar 

  25. Liu K, Ma B, Zhang W, Huang R (2015) A spatio-temporal appearance representation for viceo-based pedestrian re-identification. In: Proceedings of the IEEE International Conference on Computer Vision, pp 3810–3818

  26. Martinez J, Hossain R, Romero J, Little JJ (2017) A simple yet effective baseline for 3d human pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp 2640–2649

  27. Matsukawa T, Okabe T, Suzuki E, Sato Y (2019) Hierarchical gaussian descriptors with application to person re-identification. IEEE transactions on pattern analysis and machine intelligence

  28. McLaughlin N, Martinez del Rincon J, Miller P (2016) Recurrent convolutional network for video-based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1325–1334

  29. Munaro M, Basso A, Fossati A, Van Gool L, Menegatti E (2014) 3d reconstruction of freely moving persons for re-identification with a depth sensor. In: 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp 4512–4519

  30. Munaro M, Fossati A, Basso A, Menegatti E, Van Gool L (2014) One-shot person re-identification with a consumer depth camera. In: Person Re-Identification. Springer, pp 161–181

  31. Niu K, Huang Y, Ouyang W, Wang L (2020) Improving description-based person re-identification by multi-granularity image-text alignments. IEEE Trans Image Process 29:5542–5556

    Article  Google Scholar 

  32. Paisitkriangkrai S, Shen C, Van Den Hengel A (2015) Learning to rank in person re-identification with metric ensembles. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1846–1855

  33. Pala P, Seidenari L, Berretti S, Del Bimbo A (2019) Enhanced skeleton and face 3d data for person re-identification from depth cameras. Comput Graph 79:69–80

    Article  Google Scholar 

  34. Rao H, Wang S, Hu X, Tan M, Da H, Cheng J, Hu B (2020) Self-supervised gait encoding with locality-aware attention for person re-identification. In: Twenty-Ninth International Joint Conference on Artificial Intelligence (IJCAI-20)

  35. Sakoe H, Chiba S (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process 26(1):43–49

    Article  Google Scholar 

  36. Singh A, Kiran GV, Harsh O, Kumar R, Singh Rajput K, SS Vamsi C, et al (2019) Real-time aerial suspicious analysis (asana) system for the identification and re-identification of suspicious individuals using the bayesian scatternet hybrid (bsh) network. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp 0–0

  37. Takač B, Catala A, Rauterberg M, Chen W (2014) People identification for domestic non-overlapping rgb-d camera networks. In: 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14). IEEE, pp 1–6

  38. Tompson JJ, Jain A, LeCun Y, Bregler C (2014) Joint training of a convolutional network and a graphical model for human pose estimation. In: Advances in neural information processing systems, pp 1799–1807

  39. Valada A, Mohan R, Burgard W (2019) Self-supervised model adaptation for multimodal semantic segmentation. Int J Comput Vis:1–47

  40. Wang F, Zuo W, Lin L, Zhang D, Zhang L (2016) Joint learning of single-image and cross-image representations for person re-identification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1288–1296

  41. Wang J, Zhong Y, Li Y, Zhang C, Wei Y (2019) Re-identification supervised texture generation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 11846–11856

  42. Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European conference on computer vision. Springer, pp 688–703

  43. Wang Z, Wei D, Hu X, Luo Y (2020) Human skeleton mutual learning for person re-identification. Neurocomputing

  44. Wu A, Zheng W-S, Gong S, Lai J (2020) Rgb-ir person re-identification by cross-modality similarity preservation. Int J Comput Vis:1–21

  45. Wu Y, Bourahla OEF, Li X, Wu F, Tian Q (2020) Adaptive graph representation learning for video person re-identification. IEEE Trans Image Process

  46. Yang Y, Lei Z, Wang J, Li SZ (2019) In defense of color names for small-scale person re-identification. In: 2019 International Conference on Biometrics (ICB). IEEE, pp 1–6

  47. Yasin H, Iqbal U, Kruger B, Weber A, Gall J (2016) A dual-source approach for 3d pose estimation from a single image. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 4948–4956

  48. Yasuko C (2003) Statistics on special manifolds, lecture notes in statistics. vol 174. Springer, New York

  49. Zhang G, Liang G, Li W, Fang J, Wang J, Geng Y, Wang J-Y (2017) Learning convolutional ranking-score function by query preference regularization. In: International conference on intelligent data engineering and automated learning. Springer, pp 1–8

  50. Zhang G, Liang G, Su F, Qu F, Wang J-Y (2018) Cross-domain attribute representation based on convolutional neural network. In: International Conference on Intelligent Computing. Springer, pp 134–142

  51. Zhang L, Shi Z, Zhou JT, Cheng M-M, Liu Y, Bian J-W, Zeng Z, Shen C (2020) Ordered or orderless: A revisit for video based person re-identification. IEEE Transactions on Pattern Analysis and Machine Intelligence

  52. Zhang L, Zhang L, Du B, You J, Tao D (2019) Hyperspectral image unsupervised classification by robust manifold matrix factorization. Inf Sci 485:154–169

    Article  MathSciNet  Google Scholar 

  53. Zhang R, Li J, Sun H, Ge Y, Luo P, Wang X, Lin L (2019) Scan: Self-and-collaborative attention network for video person re-identification. IEEE Trans Image Process 28(10):4870–4882

    Article  MathSciNet  Google Scholar 

  54. Zhao C, Wang X, Zuo W, Shen F, Shao L, Miao D (2020) Similarity learning with joint transfer constraints for person re-identification. Pattern Recogn 97:107014

    Article  Google Scholar 

  55. Zheng W, Li L, Zhang Z, Huang Y, Wang L (2019) Relational network for skeleton-based action recognition. In: 2019 IEEE International Conference on Multimedia and Expo (ICME). IEEE, pp 826–831

Download references

Author information

Authors and Affiliations

  1. Institut Supérieur d’Informatique, Research Team on Intelligent Systems in Imaging and Artificial Vision (SIIVA), LR16ES06 Laboratoire de recherche en Informatique, Modélisation et Traitement de l’Information et de la Connaissance (LIMTIC), Université de Tunis El Manar, 2 Rue Bayrouni, 2080, Ariana, Tunisia

    Amani Elaoud, Walid Barhoumi & Ezzeddine Zagrouba

  2. Ecole Nationale d’Ingénieurs de Carthage (ENICarthage), Université de Carthage, 45 Rue des Entrepreneurs, 2035, Tunis-Carthage, Tunisia

    Walid Barhoumi

  3. CNRS, UMR 9189 – CRIStAL – Centre de Recherche en Informatique Signal et Automatique de Lille, IMT Lille Douai, Univ. Lille, F-59000, Lille, France

    Hassen Drira

Authors
  1. Amani Elaoud
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Walid Barhoumi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hassen Drira
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ezzeddine Zagrouba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Walid Barhoumi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Elaoud, A., Barhoumi, W., Drira, H. et al. Person Re-Identification from different views based on dynamic linear combination of distances. Multimed Tools Appl 80, 17685–17704 (2021). https://doi.org/10.1007/s11042-021-10588-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10588-7

Keywords

Search

Navigation