Key Frame Selection for Multi-shot Person Re-identification

  • Mayssa FrikhaEmail author
  • Omayma Chebbi
  • Emna Fendri
  • Mohamed Hammami
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 684)


Typical person re-identification approaches rely on a single image to model the visual appearance characteristics for each target. The performance of these systems is very limited as they ignore the immense amount of video data produced by the practical surveillance systems. In this paper, we present a novel multi-shot person re-identification approach based on key frame selection. We propose to conduct a global appearance signature by automatically selecting a set of representative appearance images depicting the different body postures from the target’s trajectory. Then, these images will be modeled into a global appearance signature to perform the re-identification task based on set matching strategy. The robustness of our approach is validated on the challenging HDA+ dataset in contrast to the limitations of existing approaches.


Person re-identification Multi-shot approach Key frame selection Global appearance signature Histogram of Oriented Gradients Set matching 



This work was supported by the PHC Utique program for the CMCU DEFI project (N 34882WK).


  1. 1.
    Doretto, G., Sebastian, T., Tu, P.H., Rittscher, J.: Appearance-based person reidentification in camera networks: problem overview and current approaches. J. Ambient Intell. Humaniz. Comput. 2, 127–151 (2011)CrossRefGoogle Scholar
  2. 2.
    Bird, N.D., Masoud, O., Papanikolopoulos, N.P., Isaacs, A.: Detection of loitering individuals in public transportation areas. IEEE Trans. Intell. Transp. Syst. 6(2), 167–177 (2005)CrossRefGoogle Scholar
  3. 3.
    Cheng, D.S., Cristani, M., Stoppa, M., Bazzani, L., Murino, V.: Custom pictorial structures for re-identification. In: British Machine Vision Conference, pp. 1–11 (2011)Google Scholar
  4. 4.
    Zeng, M., Wu, Z., Tian, C., Zhang, L., Hu, L.: Efficient person re-identification by hybrid spatiogram and covariance descriptor. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 48–56 (2015)Google Scholar
  5. 5.
    Vezzani, R., Baltieri, D., Cucchiara, R.: People reidentification in surveillance and forensics: A survey. ACM Comput. Surv. 46(2), 29.1–29.37 (2013)Google Scholar
  6. 6.
    Bazzani, L., Cristani, M., Perina, A., Farenzena, M., Murino, V.: Multiple-shot person re-identification by hpe signature. In: 20th International Conference on Pattern Recognition (2010)Google Scholar
  7. 7.
    Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: Person reidentification by symmetry-driven accumulation of local features. In: IEEE Conference on Computer Vision and Pattern Recognition (2010)Google Scholar
  8. 8.
    Bazzani, L., Cristani, M., Murino, V.: SDALF: modeling human appearance with symmetry-driven accumulation of local features. In: Gong, S., Cristani, M., Yan, S., et al. (eds.) Person Re-Identification, pp. 43–69. Springer, London (2014)CrossRefGoogle Scholar
  9. 9.
    Bak, S., Zaidenberg, S., Boulay, B., Bremond, F.: Improving person reidentification by viewpoint cues. In: 11th IEEE International Conference on Advanced Video and Signal-based Surveillance, pp. 175–180 (2014)Google Scholar
  10. 10.
    Wang, T., Gong, S., Zhu, X., Wang, S.: Person re-identification by video ranking. In: 13th European Conference Computer Vision (2014)Google Scholar
  11. 11.
    Figueiredo, M., Jain, A.: Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 381–396 (2002)CrossRefGoogle Scholar
  12. 12.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)Google Scholar
  13. 13.
    Frikha, M., Fendri, E., Hammami, M.: A new appearance signature for real time person re-identification. In: 15th International Conference Intelligent Data Engineering and Automated Learning, pp. 175–182 (2014)Google Scholar
  14. 14.
    Pudil, P., Novovicova, J., Kittler, J.: Floating search methods in feature selection. In: 12th International Conference on Pattern Recognition (1994)Google Scholar
  15. 15.
    Figueira, D., Taiana, M., Nambiar, A., Nascimento, J., Bernardino, A.: The HDA+ data set for research on fully automated re-identification systems. In: Workshop of European Conference on Computer Vision, pp. 241–255 (2014)Google Scholar
  16. 16.
    Bhattacharyya, A.: On a measure of divergence between two statistical populations defined by their probability distribution. Bull. Calcutta. Math. Soc. 35, 99–109 (1943)MathSciNetzbMATHGoogle Scholar
  17. 17.
    Buchsbaum, G.: A spatial processor model for object colour perception. J. Franklin Institute 300, 1–26 (1980)CrossRefGoogle Scholar
  18. 18.
    Prosser, B., Zheng, W.S., Gong, S., Xiang, T.: Person re-identification by support vector ranking. In: British Machine Vision Conference (2010)Google Scholar
  19. 19.
    Gray, D., Tao, H.: Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: 10th European Conference on Computer Vision, pp. 262–275 (2008)Google Scholar
  20. 20.
    Layne, R., Hospedales, T.M., Gong, S.: Attributes-based re-identification. In: Gong, S., et al. (eds.) Person Re-Identification, pp. 93–117. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  21. 21.
    Martinel, N., Micheloni, C., Foresti, G.L.: A pool of multiple person re-identification experts. Pattern Recogn. Lett. 71, 23–30 (2016)CrossRefGoogle Scholar
  22. 22.
    Liu, J., Liang, C., Ye, M., Wang, Z., Yang, Y., Han, Z., Sun, K.: Person re-identification via attribute confidence and saliency. In: 16th Pacific-Rim Conference on Multimedia, pp. 591–600 (2015)Google Scholar
  23. 23.
    Wang, T., Gong, S., Zhu, X., Wang, S.: Person re-identification by discriminative selection in video ranking. IEEE Trans. Pattern Anal. Mach. Intell. 38, 2501–2514 (2016)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Mayssa Frikha
    • 1
    Email author
  • Omayma Chebbi
    • 2
  • Emna Fendri
    • 2
  • Mohamed Hammami
    • 2
  1. 1.MIRACL-FSEGSfax UniversitySfaxTunisia
  2. 2.MIRACL-FSSfax UniversitySfaxTunisia

Personalised recommendations