Soft Computing

, Volume 23, Issue 19, pp 9121–9139 | Cite as

Bring your own hand: how a single sensor is bringing multiple biometrics together

  • Gaurav JaswalEmail author
  • Aditya Nigam
  • Amit Kaul
  • Ravinder Nath
  • Amit Kumar Singh


In spite of innumerable benefits of multi-biometry authentication, a couple of imaging sensors are required to capture multi-biometric samples, but that increase the overall cost as well as degree of user cooperation. This work presents a single sensor-based multimodal biometric identification system by fusing major finger knuckle, minor finger knuckle, palm print and handprint features of the human hand for enhancing the security and privacy of any consumer device. A virtual imaging device has been suggested to capture palmer and dorsal view of hand with single-shot multi-trait acquisition mechanism. The hand images captured from digital camera are first preprocessed to get the major knuckle, minor knuckle and palm ROI’s. The finger knuckles and palm print ROI’s are then enhanced and transformed to illumination invariant representation using robust encoding techniques, over which ray tracing features are emphasized predominantly. A non-rigid multi-scale approach, namely deep matching, has been employed to obtain the matching score between the corresponding correlation maps for finger knuckle or palm print recognition. Apart from that, we present a new scheme to extract shape, and geometrical features of handprint and employ metric learning-based L2-norm for feature matching in \(2D^{2}{} \textit{PCA}+2D^{2}{} \textit{LDA}\) space. Five publicly available databases are used to evaluate the effectiveness of proposed approach. Finally, the score-level weighted sum rule fusion has been adopted to combine matching scores of four traits which show that the proposed method outperforms other unimodal and state-of-the-art multimodal identification methods in terms of EER (0.01%), DI (3.64) and CRR (100%).


Hand biometrics Single-shot multi-trait acquisition Non-rigid matching and deep neural network 


Compliance with ethical standards

Conflict of interest

All authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.


  1. Almazán J, Fornés A, Valveny E (2013) Deformable hog-based shape descriptor. In: 2013 12th international conference on document analysis and recognition (ICDAR), IEEE, pp 1022–1026Google Scholar
  2. Bosphorus (2006) Bosphorus hand database. Accessed July 2016
  3. CASIA (2005) Casia palm print database. Accessed May 2014
  4. Corcoran P, Costache C (2016) Biometric technology and smartphones: a consideration of the practicalities of a broad adoption of biometrics and the likely impacts. IEEE Consum Electron Mag 5(2):70–78CrossRefGoogle Scholar
  5. Elhoseny M, Elkhateb A, Sahlol A, Hassanien AE (2018) Multimodal biometric personal identification and verification. In: Advances in soft computing and machine learning in image processing. Springer, Berlin, pp 249–276Google Scholar
  6. Fei L, Xu Y, Tang W, Zhang D (2016a) Double-orientation code and nonlinear matching scheme for palmprint recognition. Pattern Recogn 49:89–101CrossRefGoogle Scholar
  7. Fei L, Xu Y, Zhang D (2016b) Half-orientation extraction of palmprint features. Pattern Recogn Lett 69:35–41CrossRefGoogle Scholar
  8. Fei L, Lu G, Jia W, Wen J, Zhang D (2018) Complete binary representation for 3-D palmprint recognition. IEEE Trans Instrum Meas 41:1186Google Scholar
  9. IIT (2006–2007) IIT Delhi touchless palm print database. Accessed Apr 2015
  10. Jaswal G, Kaul A, Nath R (2016) Knuckle print biometrics and fusion schemes-overview, challenges, and solutions. ACM Comput Surv (CSUR) 49(2):34CrossRefGoogle Scholar
  11. Jaswal G, Nigam A, Nath R (2017) Deepknuckle: revealing the human identity. Multimed Tools Appl 76(18):18955–18984CrossRefGoogle Scholar
  12. Jaswal G, Kaul A, Nath R (2018) Multiple feature fusion for unconstrained palm print authentication. Comput Electr Eng 72:53–78CrossRefGoogle Scholar
  13. Jia W, Zhang B, Lu J, Zhu Y, Zhao Y, Zuo W, Ling H (2017) Palmprint recognition based on complete direction representation. IEEE Trans Image Process 26(9):4483–4498MathSciNetCrossRefzbMATHGoogle Scholar
  14. Kanhangad V, Kumar A, Zhang D (2011) A unified framework for contactless hand verification. IEEE Trans Inf Forensics Secur 6(3):1014–1027CrossRefGoogle Scholar
  15. Kumar A (2014) Importance of being unique from finger dorsal patterns: exploring minor finger knuckle patterns in verifying human identities. IEEE Trans Inf Forensics Secur 9(8):1288–1298CrossRefGoogle Scholar
  16. Kumar A, Xu Z (2016) Personal identification using minor knuckle patterns from palm dorsal surface. IEEE Trans Inf Forensics Secur 11(10):2338–2348CrossRefGoogle Scholar
  17. Liu Y, Ling J, Liu Z, Shen J, Gao C (2018) Finger vein secure biometric template generation based on deep learning. Soft Comput 22(7):2257–2265CrossRefGoogle Scholar
  18. Michael GKO, Connie T, Teoh ABJ (2012) A contactless biometric system using multiple hand features. J Vis Commun Image Represent 23(7):1068–1084CrossRefGoogle Scholar
  19. Morales A, Ferrer MA, Alonso JB, Travieso CM (2008) Comparing infrared and visible illumination for contactless hand based biometric scheme. In: 42nd annual IEEE international Carnahan conference on security technology, 2008. ICCST 2008, IEEE, pp 191–197Google Scholar
  20. Nigam A, Gupta P (2015) Designing an accurate hand biometric based authentication system fusing finger knuckleprint and palmprint. Neurocomputing 151:1120–1132CrossRefGoogle Scholar
  21. PolyU (2003) Polyu palm print database. Accessed May 2014
  22. PolyU FKI (2006–2013) Polyu contact-less finger knuckle image database. Accessed Mar 2016
  23. Ramalho M, Correia P, Soares L (2012) Hand-based multimodal identification system with secure biometric template storage. IET Comput Vis 6(3):165–173MathSciNetCrossRefGoogle Scholar
  24. Sharma S, Dubey SR, Singh SK, Saxena R, Singh RK (2015) Identity verification using shape and geometry of human hands. Expert Syst Appl 42(2):821–832CrossRefGoogle Scholar
  25. Shehab A, Elhoseny M, Muhammad K, Sangaiah AK, Yang P, Huang H, Hou G (2018) Secure and robust fragile watermarking scheme for medical images. IEEE Access 6:10269–10278CrossRefGoogle Scholar
  26. Sundararajan K, Woodard DL (2018) Deep learning for biometrics: a survey. ACM Comput Surv (CSUR) 51(3):65CrossRefGoogle Scholar
  27. Tabejamaat M, Mousavi A (2017) Concavity-orientation coding for palmprint recognition. Multimedia Tools Appl 76(7):9387–9403CrossRefGoogle Scholar
  28. Thakur S, Singh AK, Ghrera SP, Elhoseny M (2018) Multi-layer security of medical data through watermarking and chaotic encryption for tele-health applications. Multimed Tools Appl 1:1–14Google Scholar
  29. Umer S, Dhara BC, Chanda B (2016) Texture code matrix-based multi-instance iris recognition. Pattern Anal Appl 19(1):283–295MathSciNetCrossRefGoogle Scholar
  30. Zhang L, Cheng Z, Shen Y, Wang D (2018a) Palmprint and palmvein recognition based on DCNN and a new large-scale contactless palmvein dataset. Symmetry 10(4):78CrossRefGoogle Scholar
  31. Zhang S, Wang H, Huang W, Zhang C (2018b) Combining modified LBP and weighted SRC for palmprint recognition. Signal Image Video Process 1:1–8Google Scholar
  32. Zhu L, Zhang S (2010) Multimodal biometric identification system based on finger geometry, knuckle print and palm print. Pattern Recogn Lett 31(12):1641–1649CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.National Institute of Technology, HamirpurHamirpurIndia
  2. 2.Indian Institute of Technology, MandiMandiIndia
  3. 3.National Institute of Technology, PatnaPatnaIndia

Personalised recommendations