Skip to main content

Mobile User Re-authentication Using Clothing Information

  • Chapter
  • First Online:
Selfie Biometrics

Abstract

Biometric authentication has become a popular alternative to passwords on mobile devices. However, most implementations do not incorporate any mechanisms to ascertain whether the originally authenticated user is still in control of the mobile device. Thus, the user has to re-scan for any subsequent device access, which may lead to biometric scan fatigue. One solution to this problem is to re-authenticate the user via ancillary surrogates of identity that are likely to be stable and unique in the short term and easier to acquire compared to the primary biometric modality, such as opportunistically captured clothing information. The aim of this paper is to investigate such clothing informationĀ as a soft biometricsĀ for short-term mobile user re-authentication. To this aim, we propose a novel method for segmentation and matching of clothing ROI from images captured via front-facing camera of mobile devices, without explicitly requiring the face to be present. Experimental investigations on a large-scale mobile dataset show error rates as low as \(2.5\%\) using this method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.biometricupdate.com/201703/special-report-mobile-biometric-applications.

  2. 2.

    A selfie is a self-portrait image of a user captured using the ubiquitous front-facing cameras available in virtually all mobile devices.

References

  1. Bay H, Tuytelaars T, Van Gool L (2006) Surf: speeded up robust features. In: Leonardis A, Bischof H, Pinz A (eds) Computer Vision - ECCV 2006. Springer, Berlin Heidelberg, Berlin, Heidelberg, pp 404ā€“417

    ChapterĀ  Google ScholarĀ 

  2. Crouse D, Han H, Chandra D, Barbello B, Jain AK (2015) Continuous authentication of mobile user: fusion of face image and inertial measurement unit data. In: International conference on biometrics (ICB), pp 135ā€“142

    Google ScholarĀ 

  3. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPRā€™05), vol 1, pp 886ā€“893

    Google ScholarĀ 

  4. Gao M, Hu X, Cao B, Li D (2014) Fingerprint sensors in mobile devices. In: 2014 9th IEEE conference on industrial electronics and applications, pp 1437ā€“1440

    Google ScholarĀ 

  5. Hermans A, Beyer L, Leibe B (2017) In defense of the triplet loss for person re-identification. CoRR, abs/1703.07737

    Google ScholarĀ 

  6. Jaha ES, Nixon MS (2014) Soft biometrics for subject identification using clothing attributes. In: IEEE international joint conference on biometrics, pp 1ā€“6

    Google ScholarĀ 

  7. Jaha ES, Nixon MS (2016) From clothing to identity: Manual and automatic soft biometrics. IEEE Trans Inf Forensics Secur 11(10):2377ā€“2390

    ArticleĀ  Google ScholarĀ 

  8. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR), pp 3431ā€“3440

    Google ScholarĀ 

  9. Marsico MD, Galdi C, Nappi M, Riccio D (2014) Firme: face and iris recognition for mobile engagement. Image Vis Comput 32(12):1161ā€“1172

    ArticleĀ  Google ScholarĀ 

  10. Mohammad AS, Rattani A, Derakhshani R (2018) Short-term user authentication using eyebrows biometric for smartphone devices. In: IEEE computer science and electronic engineering conference

    Google ScholarĀ 

  11. Nguyen H, Sai R, Li Z, Derakhshani R (2018) User re-identification using clothing information for smartphones (accepted). In: IEEE International symposium on technologies for homeland security (HST), pp 1ā€“6

    Google ScholarĀ 

  12. Niinuma K, Park U, Jain AK (2010) Soft biometric traits for continuous user authentication [dec 10 771ā€“780]. IEEE Trans Inf Forensics Secur 6(4):771ā€“780

    ArticleĀ  Google ScholarĀ 

  13. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971ā€“987

    ArticleĀ  Google ScholarĀ 

  14. Rattani A, Derakhshani R (2017) On fine-tuning convolutional neural networks for smartphone based ocular recognition. In: 2017 IEEE international joint conference on biometrics (IJCB), pp 762ā€“767

    Google ScholarĀ 

  15. Rattani A, Derakhshani R (2017) Online co-training in mobile ocular biometric recognition. In: 2017 IEEE international symposium on technologies for homeland security (HST), pp 1ā€“5

    Google ScholarĀ 

  16. Rattani A, Derakhshani R (2018) A survey of mobile face biometrics. Comput Electr Eng 72:39ā€“52

    ArticleĀ  Google ScholarĀ 

  17. Rattani A, Derakhshani R, Saripalle SK, Gottemukkula V (2016) Icip 2016 competition on mobile ocular biometric recognition. In: 2016 IEEE international conference on image processing (ICIP), pp 320ā€“324

    Google ScholarĀ 

  18. Rattani A, Reddy N, Derakhshani R (2017) Convolutional neural network for age classification from smart-phone based ocular images. In: 2017 IEEE international joint conference on biometrics (IJCB), pp 756ā€“761

    Google ScholarĀ 

  19. Rattani A, Reddy N, Derakhshani R (2018) Convolutional neural networks for gender prediction from smartphone-based ocular images. IET Biom 7:423ā€“430(7)

    ArticleĀ  Google ScholarĀ 

  20. Reddy N, Rattani A, Derakhshani R (2018) Ocularnet: deep patch-based ocular biometric recognition. In: 2018 IEEE international symposium on technologies for homeland security (HST), pp 1ā€“6

    Google ScholarĀ 

  21. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. CoRR abs/1505.04597

    Google ScholarĀ 

  22. Saevanee H, Clarke N, Furnell S, Biscione V (2015) Continuous user authentication using multi-modal biometrics. Comput Secur 53:234ā€“246

    ArticleĀ  Google ScholarĀ 

  23. Samangouei P, Patel VM, Chellappa R (2015) Attribute-based continuous user authentication on mobile devices. In: 2015 IEEE 7th international conference on biometrics theory, applications and systems (BTAS), pp 1ā€“8

    Google ScholarĀ 

  24. Tao Q, Veldhuis R (2006) Biometric authentication for a mobile personal device. Third annual international conference on mobile and ubiquitous systems: networking services., San Jose CA, pp 1ā€“3

    Google ScholarĀ 

  25. Thavalengal S, Bigioi P, Corcoran P (2015) Iris authentication in handheld devices - considerations for constraint-free acquisition. IEEE Trans Consum Electron 61(2):245ā€“253

    ArticleĀ  Google ScholarĀ 

  26. Zhao X, Feng T, Shi W (2013) Continuous mobile authentication using a novel graphic touch gesture feature. In: 2013 IEEE sixth international conference on biometrics: theory, applications and systems (BTAS), pp 1ā€“6

    Google ScholarĀ 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hoang (Mark) Nguyen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

(Mark) Nguyen, H., Rattani, A., Derakhshani, R. (2019). Mobile User Re-authentication Using Clothing Information. In: Rattani, A., Derakhshani, R., Ross, A. (eds) Selfie Biometrics. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-030-26972-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-26972-2_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-26971-5

  • Online ISBN: 978-3-030-26972-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics