Skip to main content
SpringerLink
Log in

Bag of soft biometrics for person identification

New trends and challenges

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this work we seek to provide insight on the general topic of soft biometrics. We firstly present a new refined definition of soft biometrics, emphasizing on the aspect of human compliance, and then proceed to identify candidate traits that accept this novel definition. We then address relations between traits and discuss associated benefits and limitations of these traits. We also consider two novel soft biometric traits, namely weight and color of clothes and we analyze their reliability. Related promising results on the performance are provided. Finally, we consider a new application, namely human identification solely carried out by a bag of facial, body and accessory soft biometric traits, and as an evidence of its practicality, we provide preliminary promising results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. OpenCV webpage on Source forge http://souceforge.net/projects/opencvlibrary/.

  2. Available for download at http://iris.di.ubi.pt/ubiris2.html.

  3. Available for download at http://www.itl.nist.gov/iad/humanid/feret.

  4. Available for download at http://www.itl.nist.gov/iad/humanid/feret.

  5. Available for download at http://iris.di.ubi.pt/ubiris2.html.

  6. Available for download at http://homepages.inf.ed.ac.uk/rbf/CAVIARDATA1/.

  7. Available for download at http://vision.soe.ucsc.edu.

  8. ActiBio homepage http://www.actibio.eu:8080/actibio.

References

  1. Adjeroh D, Cao D, Piccirilli M, Ross A (2010) Predictability and correlation in human metrology. In: Proceedings WIFS

  2. Ailisto H, Vildjiounaite E, Lindholm M, Makela SM, Peltola J (2006) Soft biometrics-combining body weight and fat measurements with fingerprint biometrics. Pattern Recogn Lett 27(5):325–334

    Article  Google Scholar 

  3. Baluja S, Rowley HA (2006) Boosting sex identification performance. Int J Comput Vis 71:111–119

    Article  Google Scholar 

  4. BenAbdelkader C, Davis L (2006) Estimation of anthropomeasures from a single calibrated camera. In: Proceedings of FG, pp 499–504

  5. Berlin B, Kay P (1993) Basic color terms; their universality and evolution. Van Nostrand Reinhold, London

    Google Scholar 

  6. Caifeng S, Shaogang G, McOwand PW (2007) Learning gender from human gaits and faces. In: Proceedings of AVSS, pp 505–510

  7. Carnicky J, Chorvat, JD (2006) Three-dimensional measurement of human face with structured-light illumination. Meas Sci Rev 6:1–4

    Google Scholar 

  8. Coe TR, Halkes M, Houghton K, Jefferson D (2002) The accuracy of visual estimation of weight and height in pre-operative supine patients. Anaesthesia 54(6):582–586

    Article  Google Scholar 

  9. Center for Disease Control and Prevention CDC. National health and nutrition examination survey, 1999–2005. http://www.cdc.gov/nchs/nhanes/nhanes_questionnaires.htm

  10. Chiraz BA, Cutler R, Davis L (2002) View-invariant estimation of height and stride for gait recognition. In: Proceedings of ICBA, vol 2359/2006, pp 155–167

  11. Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148

    Article  MATH  Google Scholar 

  12. Dantcheva A, Dugelay J-L, Elia P (2010) Person recognition using a bag of facial soft biometrics (BoFSB). In: Proceedings of MMSP

  13. Dantcheva A, Dugelay J-L, Elia P (2010) Soft biometrics systems: reliability and scaling laws. In: Proceedings of BTAS

  14. Dantcheva A, Erdogmus N, Dugelay J-L (2011) On the reliability of eye color classification as a soft biometrics trait. In: Proceedings of WACV (to appear)

  15. D’Angelo A, Dugelay J-L (2010) A statistical approach to culture colors distribution in video sensors. In: Proceedings of VPQM

  16. D’Angelo A, Dugelay J-L (2011) People re-identification in camera networks based on probabilistic color histograms. In: Proceedings of electronic imaging (to appear)

  17. De Mendonca MC (2000) Estimation of height from the length of long bones in a portuguese adult population. Am J Phys Anthropol 112(1):39–48

    Article  Google Scholar 

  18. Denman S, Fookes C, Bialkowski A, Sridharan S (2009) Soft-biometrics: unconstrained authentication in a surveillance environment. In: Proceedings of DICTA, pp 196–203

  19. Duyar I, Pelin C (2003) Body height estimation based on tibia length in different stature groups. Am J Phys Anthropol 122(1):23–27

    Article  Google Scholar 

  20. Givens G, Beveridge JR, Draper BA, Bolme D (2003) A statistical assessment of subject factors in the pca recognition of human faces. In: Proceedings of CVPR

  21. Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: Proceedings of PETS

  22. Gutta S, Wechsler H (1999) Gender and ethnic classification of human faces using hybrid classifiers. In: Proceedings of IJCNN, vol 6, pp 4084–4089

  23. Gutta S, Phillips J, Wechsler H (1998) Gender and ethnic classification of face images. In: Proceedings of FG, pp 194–199

  24. Gutta S, Huang JRJ, Jonathon P, Wechsler H (2000) Mixture of experts for classification of gender, ethnic origin, and pose of human faces. Trans Neural Netw 11:948–960

    Article  Google Scholar 

  25. Hadid A, Pietikaeinen M, Martinkauppi B (2002) Color-based face detection u sing skin locus model and hierarchical filtering. In: Proceedings of ICPR, pp 196–200

  26. Heo J, Kong SG, Abidi BR, Abidi MA (2004) Fusion of visual and thermal signatures with eyeglass removal for robust face recognition. In: Proceedings of CVPRW, p 122

  27. Hong L, Jain AK, Pankanti S (1999) Can multibiometrics improve performance? In: Proceedings of AutoID, vol 99, pp 59–64

  28. Hosoi S, Takikawa E, Kawade M (2004) Ethnicity estimations with facial images. In: Proceedings of FG, pp 195–200

  29. II H, William L, Larkin GL, Trujillo MJ, Hinds JL, Delaney KA (2004) Errors in weight estimation in the emergency department: comparing performance by providers and patients. J Emerg Med 27(3):219–224

    Article  Google Scholar 

  30. Indovina M, Uludag U, Snelick R, Mink A, Jain AK (2003) Multimodal biometric authentication methods: a COTS approach. In: Proceedings of MMUA, pp 99–106

  31. Jain AK, Dass SC, Nandakumar K (2004) Soft biometric traits for personal recognition systems. In: Proceedings of ICBA. Springer, pp 1–40

  32. Jain AK, Dass SC, Nandakumar K (2004) Can soft biometric traits assist user recognition? In: Proceedings of SPIE, vol 5404, pp 561–572

  33. Jeges E, Kispal I, Hornak Z (2008) Measuring human height using calibrated cameras. In: Proceedings of HSI, pp 755–760

  34. Jiang X, Binkert M, Achermann B, Bunke H (2000) Towards detection of glasses in facial images. PAA 3:9–18

    Google Scholar 

  35. Joachims T (1998) Text categorization with support vector machines: learning with many relevant features. In: Proceedings of ECML. Springer, pp 137–142

  36. Johansson G (1973) Visual perception of biological motion and a model for its analysis. Perceiving Events and Objects 3

  37. Kakumanua P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. In: Proceedings of ICPR, vol 40.

  38. Kaushik N, Mittal A (2006) A novel beard removal method based on structural similarity and coordinate transformations. In: Proceedings of INDICON, pp 270.1–270.6

  39. Keys A, Fidanza F, Karvonen MJ, Kimura N, Taylor HL (1972) Indices of relative weight and obesity. J Chronic Dis 25(6–7):329–343

    Article  Google Scholar 

  40. Keller JM, Gray MR, Givens JR (1985) A fuzzy k-nearest neighbor algorithm. Trans Syst Man Cybern 15(4):581

    Google Scholar 

  41. Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of ICPR, vol 2

  42. Lee J-E, Jain AK, Jin R (2008) Scars, marks and tattoos (SMT): soft biometric for suspect and victim identification. In: Proceedings of BCC

  43. Lin H, Lu H, Zhang L (2006) A new automatic recogntion system of gender, age and ethnicity. In: Proceedings of WCICA, vol 2, pp 9988–9991

  44. Lu X, Jain AK (2004) Ethnicity identification from face images. In: Proceedings of SPIE, vol 5404, pp 114–123

  45. Madden C, Piccardi M (2005) Height measurement as a session-based biometric for people matching across disjoint camera views. In: Proceedings of image and vision computing New Zealand

  46. Matta F, Saeed U, Mallauran C, Dugelay J-L (2008) Facial gender recognition using multiple sources of visual information. In: Proceedings of MMSP, pp 785–79

  47. Menon S, Kelly AM (2005) How accurate is weight estimation in the emergency department? Emergency Medicine Australasia 17(2):113–116

    Article  Google Scholar 

  48. Mikolajczyk K, Schmid C, Zisserman A (2004) Human detection based on a probabilistic assembly of robust part detectors. In: Proceedings of ECCV. Springer, pp 69–82

  49. Moustakas K, Tzovaras D, Stavropoulos G (2010) Gait recognition using geometric features and soft biometrics. Signal Process Lett 17:367–370

    Article  Google Scholar 

  50. Newham E (1995) The biometric report. SJB Services, New York

    Google Scholar 

  51. Nixon M (1985) Eye spacing measurement for facial recognition. In: Proceedings of SPIE, vol 575, pp 279–285

  52. Nkengne A, Bertin C, Stamatas GN, Giron A, Issachar A, Rossi N, Fertil B (2008) Influence of facial skin attributes on the perceived age of Caucasian women. J Eur Acad Dermatol Venereol 22:982–991

    Article  Google Scholar 

  53. O’Toole A, Peterson A, Deffenbacher K (1994) Structural aspects of face recognition and the other race effect. Mem Cogn 22:208–224

    Google Scholar 

  54. Patterson E, Sethuram A, Alber M, Ricanek K, King M (2007) Aspects of age variation in facial morphology affecting biometrics. In: Proceedings of BTAS

  55. Poh N, Bengio S (2006) Using chimeric users to construct fusion classifiers in biometric authentication tasks: an investigation. In: Proceedings of ICASSP, vol 5

  56. Puhan NB, Sudha N (2008) A novel iris database indexing method using the iris color. In: Proceedings of ICIEA, pp 1886–1891

  57. Rhodes HTF (1956) Alphonse Bertillon: father of scientific detection. Abelard-Schuman, New York: 27

  58. Saatci Y, Town C (2006) Cascaded classification of gender and facial expression. In: Proceedings of FG, pp 393–400

  59. Samangooei S, Nixon M, Guo B (2008) The use of semantic human description as a soft biometric. In: Proceedings of BTAS

  60. Sun Z, Bebis G, Yuan X, Louis SJ (2002) Genetic feature subset selection for gender classification: a comparison study. In: Proceedings of WACV, p 165

  61. Sun D, Zhao M, He H (2008) Hair-color modeling and head detection. In: Proceedings of WCICA, pp 7773–7776

  62. Vaquero D, Feris R, Tran D, Brown L, Hampapur A, Turk M (2009) Attribute-based people search in surveillance environments. In: Proceedings of WACV

  63. Velardo C, Dugelay J-L (2010) Weight estimation from visual body appearance. In: Proceedings of BTAS

  64. Violoa P, Jones M (2001) Robust real-time face detection. In: Proceedings of ICCV, p 747

  65. Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. Trans Pattern Anal Mach Intell 25(12):1505–1518

    Article  Google Scholar 

  66. Wayman JL (1997) Large-scale civilian biometric systems-issues and feasibility. In: Proceedings of card tech/secure tech ID, vol 732

  67. Weda H, Barbieri M (2007) Automatic children detection in digital images. In: Proceedings of ICME

  68. Wolf F, Poggio T, Sinha P (2006) Bags of words. Citeseer

  69. Wu H, Yoshikawa G, Shioyama T, Lao S, Kawade M (2002) Glasses frame detection with 3D Hough transform. In: Proceedings of ICPR, vol 16, pp 346–349

  70. Xiao Y, Yan H (2004) Extraction of glasses in human face images. Springer, pp 1–23

  71. Zewail R, Elsafi A, Saeb M, Hamdy N (2004) Soft and hard biometrics fusion for improved identity verification. In: Proceedings of MWSCAS

Download references

Author information

Authors and Affiliations

  1. EURECOM, Sophia Antipolis, France

    Antitza Dantcheva, Carmelo Velardo, Angela D’Angelo & Jean-Luc Dugelay

Authors
  1. Antitza Dantcheva
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carmelo Velardo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Angela D’Angelo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jean-Luc Dugelay
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Antitza Dantcheva.

Additional information

This work was partly funded by the European project ACTIBIO, and the French national projects VIDEOID and BIORAFALE. Part of this work is presented in [12, 63] and [16].

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dantcheva, A., Velardo, C., D’Angelo, A. et al. Bag of soft biometrics for person identification. Multimed Tools Appl 51, 739–777 (2011). https://doi.org/10.1007/s11042-010-0635-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0635-7

Keywords

Search

Navigation