A General Method for Appearance-Based People Search Based on Textual Queries

  • Riccardo Satta
  • Giorgio Fumera
  • Fabio Roli
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7583)


Person re-identification consists of recognising a person appearing in different video sequences, using an image as a query. We propose a general approach to extend appearance-based re-identification systems, enabling also textual queries describing clothing appearance (e.g., “person wearing a white shirt and checked blue shorts”). This functionality can be useful, e.g., in forensic video analysis, when textual descriptions of individuals of interest given by witnesses are available, instead of images. Our approach is based on turning any given appearance descriptor into a dissimilarity-based one. This allows us to build detectors of the clothing characteristics of interest using supervised classifiers trained in a dissimilarity space, independently on the original descriptor. Our approach is evaluated using the descriptors of three different re-identification methods, on a benchmark data set.


  1. 1.
    Doretto, G., Sebastian, T., Tu, P., Rittscher, J.: Appearance-based person reidentification in camera networks: problem overview and current approaches. Journal of Ambient Intelligence and Humanized Computing 2, 127–151 (2011)CrossRefGoogle Scholar
  2. 2.
    Wang, L., Tan, T., Ning, H., Hu, W.: Silhouette analysis-based gait recognition for human identification. IEEE Transactions on Pattern Anallisys and Machine Intelligence 25, 1505–1518 (2003)CrossRefGoogle Scholar
  3. 3.
    Vaquero, D., Feris, R., Tran, D., Brown, L., Hampapur, A., Turk, M.: Attribute-based people search in surveillance environments. In: IEEE Workshop on Applications of Computer Vision, WACV 2009 (2009)Google Scholar
  4. 4.
    Thornton, J., Baran-Gale, J., Butler, D., Chan, M., Zwahlen, H.: Person attribute search for large-area video surveillance. In: 2011 IEEE International Conference on Technologies for Homeland Security (HST), pp. 55–61 (2011)Google Scholar
  5. 5.
    Satta, R., Fumera, G., Roli, F.: Fast person re-identification based on dissimilarity representations. Pattern Recognition Letters, Special Issue on Novel Pattern Recognition-Based Methods for Reidentification in Biometric Context (in press, 2012)Google Scholar
  6. 6.
    Satta, R., Fumera, G., Roli, F., Cristani, M., Murino, V.: A Multiple Component Matching Framework for Person Re-identification. In: Maino, G., Foresti, G.L. (eds.) ICIAP 2011, Part II. LNCS, vol. 6979, pp. 140–149. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  7. 7.
    Pekalska, E., Duin, R.P.W.: The Dissimilarity Representation for Pattern Recognition: Foundations And Applications (Machine Perception and Artificial Intelligence). World Scientific Publishing Co., Inc., River Edge (2005)zbMATHGoogle Scholar
  8. 8.
    Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: Person re-identification by symmetry-driven accumulation of local features. In: Proc. of the 2010 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 2360–2367 (2010)Google Scholar
  9. 9.
    Andriluka, M., Roth, S., Schiele, B.: Pictorial structures revisited: People detection and articulated pose estimation. In: Proc. of the 2009 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 1014–1021 (2009)Google Scholar
  10. 10.
    Gray, D., Brennan, S., Tao, H.: Evaluating appearance models for recognition, reacquisition, and tracking. In: Proc. of the 10th IEEE Int. Workshop on Performance Evaluation of Tracking and Surveillance (PETS), pp. 41–47 (2007)Google Scholar
  11. 11.
    Dietterich, T.G., Lathrop, R.H., Lozano-Pérez, T.: Solving the multiple instance problem with axis-parallel rectangles. Artif. Intell. 89, 31–71 (1997)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Riccardo Satta
    • 1
  • Giorgio Fumera
    • 1
  • Fabio Roli
    • 1
  1. 1.Dept. of Electrical and Electronic EngineeringUniversity of CagliariCagliariItaly

Personalised recommendations