3D-DWT and CNN Based Face Recognition with Feature Extraction Using Depth Information and Contour Map

  • Chanchal Mahadev Patil
  • Sachin D. RuikarEmail author
Conference paper


This paper presents a method for face recognition with a combination of skin colour information and depth approach with high security and accuracy for authentication of users. It presents an algorithm for the detection and recognition of the face. For getting higher accuracy in face detection various methods are used, such as template matching method, haar cascade feature, AdaBoost algorithm. To identify real or fake (picture) face depth value determined from the depth map is used. 3D-DWT is used to extract features from the depthmap. Extracted features are used to train the convoluted neural network (CNN).


Adaboost algorithm Haar features Depth map 3D-DWT CNN 


  1. 1.
    Cokun M et al Face recognition based on convolutional neural network. 978-1-5386-1750-2/17/$31.00 ©2017 IEEEGoogle Scholar
  2. 2.
    Pan G, Shi H, Wu Z, Wang Y (2005) 3D face recognition using mapped depth images. In: Proceedings of the 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), IEEE, Page(s): 175–181Google Scholar
  3. 3.
    Kherchaoui S, Houacine A (2010) Face detection based on a model of the skin colour with constraints and template matching. 2010 International Conference on Machine and Web Intelligence (ICMWI), IEEE, pp 469–472Google Scholar
  4. 4.
    ErolSeke (2011) Determining illumination sources in frontal face images using salient samples from a face depth map. 2011 International symposium on Innovation in Intelligent System and Application (INISTA), IEEE, pp 173–176Google Scholar
  5. 5.
    Viola P, Jones M Fast and robust classification using asymmetric Adaboost and detector Cascade. and mjones@merl.comGoogle Scholar
  6. 6.
    Qian J, Ma S, Hao Z, Shen Y (2011) Face detection and recognition method based on skin colour and depth information. 2011 International conference on Consumer Electronics Communication and Networks (CECNet), IEEE, pp 345–348Google Scholar
  7. 7.
    Thethe SV, Narote SP (2012) Face detection using colour models. In: Proceedings of “Conference on Advances in Communication and Computing (NCACC’12). World Journal of Science and Technology , ISSN: 2231–2587, pp 182–185Google Scholar
  8. 8.
    Xu D, Chen YL, Wu X, Ou Y, Xu Y (2011) Integrated approach of skin-color detection and depth information for hand and face localization. In: Proceedings of the 2011 IEEE international conference on Robotics and Biometrics (ROBIO) December 7–11, IEEE, Page(s): 952–956Google Scholar
  9. 9.
    Li X, Li Y (2010) Study and realization of face detection based on skin segmentation and template matching. 2010 Fourth international conference on new trends in Information Science and Service Science (NISS), IEEE, pp 375–378Google Scholar
  10. 10.
    Erdem CE, Ulukaya S, Karaali A, Erdem AT (2011) Combining Haar feature and skin colour based classifiers for face detection. 2011 International Conference on Acoustic, Speech and Signal Processing (ICASSP), IEEE, pp 1497–1500Google Scholar
  11. 11.
    Jain A, Kutty K, Yerva S (2013) GMM based approach for human face verification using relative depth features. 2013 International Conference on Advances in Computing, Communicating and Informatics (ICACCI), IEEE, pp 675–680Google Scholar
  12. 12.
    Ghasemzadeh A, Demirel H (2018) 3D discrete wavelet transform-based feature extraction for hyper spectral face recognition. IET Biom 7(1):49–55. The Institution of Engineering and Technology 2017CrossRefGoogle Scholar
  13. 13.
    Sardar S, Babu KA (2014) Hardware implementation of real-time, high performance, RCE-NN based face recognition system. 2014 27th International conference on VLSI design and 2014 13th international conference on embedded systems, IEEE, pp 174–179Google Scholar
  14. 14.
    Luo L et al A modified Pca algorithm for face recognition. CCECE 2003-CCGEI 2003, Montreal, Mayhai, 2003 0-7803-7781- 8/03/$17.00 0 2003 IEEEGoogle Scholar
  15. 15.
    Dong UK Cho et al (2006) 2D direct LDA algorithm for face recognition. In: Proceedings of the fourth international conference on software engineering research, management and applications (SERA’06) 0-7695-2656-X/06 $20.00 ©Google Scholar
  16. 16.
    Shou-Jen Lin, Chao-Yang Lee, Mei-Hsuan Chao, Chi-Sen Chiou, Chu-Sing Yang (2010) The study and implementation of real-time face recognition and tracking system. In: Proceedings of the ninth International Conference on Machine Learning and Cybernetics (ICMLC), Qingdao, 11–14 July 2010, IEEE, pp 3050–3055Google Scholar
  17. 17.
    Meng R, Shengbing Z, Yi L, Meng Z (2014) CUDA-based real-time face recognition system. 2014 Fourth international conference on Digital Information and Communication Technology and It’s Application (DICTAP), IEEE, pp 237–241Google Scholar
  18. 18.
    Wang H, Hu J, Deng W Compressing fisher vector for robust face recognition. Digital Object Identifier Scholar
  19. 19.
    Jou Lin, Ching-Te Chiu (2017) Low-complexity face recognition using contour-based binary descriptor. IET image process 11(12):1179–1187. © The Institution of Engineering and Technology 2017Google Scholar
  20. 20.
    Deng D, Li X Face recognition based on improved projection dictionary pair learning algorithm. 978-1-5386-1107-4/17/$31.00 ©2017 IEEEGoogle Scholar
  21. 21.
    Chakraborty S, Singh SK, Chakraborty P (2018) Local gradient Hexa pattern: a descriptor for face recognition and retrieval. IEEE Trans Circuits Syst Video Technol 28(1):180CrossRefGoogle Scholar
  22. 22.
    Soltanpour S, Wu QJ (2017) Multimodal 2D–3D face recognition using local descriptors: pyramidal shape map and structural context. IET Biom 6(1):27–35. © The Institution of Engineering and Technology 2016CrossRefGoogle Scholar
  23. 23.
    Wang M, Wang Z, Li J Deep convolutional neural network applies to face recognition in small and medium databases. 978-1-5386-1107-4/17/$31.00©2017 IEEEGoogle Scholar
  24. 24.
    Jinna Sun, Mingting Yuan, Junhang Ding, Huasheng Xu Deng, Qingmei Sui Application of constrained local neural fields in face recognition. 978-1-5386-3524-7/17/$31.00 ©2017 IEEEGoogle Scholar
  25. 25.
    Yin X, Liu X (2018) Multi-task convolutional neural network for pose-invariant face recognition. IEEE Trans Image Process 27(2):964–975MathSciNetCrossRefGoogle Scholar
  26. 26.
    Sagheer A, Aly S (2012) An effective face detection algorithm based on skin colour information. 2012 Eighth international conference on Signal Image Technology and Internet Based Systems (SITIS), IEEE, pp 90–96Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Walchand College of EngineeringSangliIndia

Personalised recommendations