Interactive Face Liveness Detection Based on OpenVINO and Near Infrared Camera

  • Nana ZhangEmail author
  • Jun Huang
  • Hui Zhang
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1181)


For the security of face recognition, this paper proposes an interactive face liveness detection method based on OpenVINO and near infrared camera. Firstly, the face feature points are normalized and the faces are aligned in the environment of OpenVINO and near infrared camera. Secondly, the Euclidean Distance between the mouth feature vectors is calculated. When the distance is greater than a threshold, the system will judge it as a smile. Finally, the system will send random smile commands to the authenticated users to realize liveness detection. According to the results, the proposed method can effectively distinguish between real people and printed photos, and the running time of the liveness detection system based on OpenVINO can reach 14–30 ms, the recognition accuracy can reach 0.977, which has outstanding generalization ability in practical project applications.


Near infrared ray Smile detection OpenVINO Liveness detection Face fraud Feature point location 



This work was supported by the Shanghai Municipal Education Commission’s “Morning Plan” project (NO. AASH1702).


  1. 1.
    Chingovska, I., Anjos, A., Marcel, S.: On the effectiveness of local binary patterns in face anti-spoofing. In: Biometrics Special Interest Group, pp. 1–7. IEEE (2012)Google Scholar
  2. 2.
    Yang, J., Lei, Z., Li, S.Z.: Learn convolutional neural network for face anti-spoofing. Comput. Sci. 9218, 373–384 (2014)Google Scholar
  3. 3.
    Yeh, C.H., Chang, H.H.: Face liveness detection with feature discrimination between sharpness and blurriness. In: Fifteenth IAPR International Conference on Machine Vision Applications, pp. 398–401. IEEE (2017)Google Scholar
  4. 4.
    Singh, M., Arora, A.S.: A robust anti-spoofing technique for face liveness detection with morphological operations. Opt. Int. J. Light Electron Opt. 139(4), 347–354 (2017)CrossRefGoogle Scholar
  5. 5.
    Kollreider, K., Fronthaler, H., Bigun, J.: Evaluating liveness by face images and the structure tensor. In: IEEE Workshop on Automatic Identification Advanced Technologies, pp. 75–80 (2005)Google Scholar
  6. 6.
    Jee, H.K., Jung, S.U., Yoo, J.H.: Liveness detection for embedded face recognition system. Enformatika 1, 235–238 (2006)Google Scholar
  7. 7.
    Smiatacz, M.: Liveness measurements using optical flow for biometric person authentication. Metrol. Meas. Syst. 19(2), 257–268 (2012)CrossRefGoogle Scholar
  8. 8.
    Singh, A.K., Joshi, P., Nandi, G.C.: Face recognition with liveness detection using eye and mouth movement. In: International Conference on Signal Propagation and Computer Technology, pp. 592–597. IEEE (2014)Google Scholar
  9. 9.
    Zhang, G., Feng, R.: Liveness detection system based on human face. Comput. Syst. Appl. 26(12), 37–42 (2017). (in Chinese)Google Scholar
  10. 10.
    Howard, A.G., Zhu, M., Chen, B., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications (2017)Google Scholar
  11. 11.
    Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). Scholar
  12. 12.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition [EB/OL], 10 April 2015.
  13. 13.
    He, F., Zhao, Q.: Head pose estimation based on deep learning. Comput. Technol. Dev. 26(11), 1–4 (2016). (in Chinese)Google Scholar
  14. 14.
    Song, Z., Zhou, S., Guan, J.: A novel image registration algorithm for remote sensing under affine transformation. IEEE Trans. Geosci. Remote Sens. 52(8), 4895–4912 (2014)CrossRefGoogle Scholar
  15. 15.
    Kim, G., Eum, S., Suhr, J.K., et al.: Face liveness detection based on texture and frequency analyses. In: IAPR International Conference on Biometrics, pp. 67–72. IEEE (2012)Google Scholar
  16. 16.
    Qiu, C.: Research on human face detection based on binocular camera. Mod. Comput. 2018(35), 41–44 + 66 (2018). (in Chinese)Google Scholar
  17. 17.
    Ma, Y., Tan, L., Dong, X., Yu, C.-C.: Interactive liveness detection algorithm for VTM. Comput. Eng. 45(03), 256–261 (2019). (in Chinese)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Shanghai Jian Qiao UniversityShanghaiChina
  2. 2.Shanghai Ocean UniversityShanghaiChina

Personalised recommendations