Advertisement

Kinship Verification Based on Deep Learning

  • Xiaoting Wu
  • Xiaoyi FengEmail author
  • Lei Li
  • Elhocine Boutellaa
  • Abdenour Hadid
Chapter
  • 1.1k Downloads

Abstract

Automatic kinship verification using facial images is a relatively new and challenging research problem in computer vision. It consists in automatically predicting whether two persons have a biological kin relation by examining their facial attributes. While most of the existing works extract shallow handcrafted features from still face images, in this chapter, we approach this problem from deep learning point of view. Promising results, especially those of deep features, are obtained on the benchmark UvA-NEMO Smile database and KinFaceW-I and KinFaceW-II kinship face databases.

References

  1. 1.
    Ahonen, T., Hadid, A., Pietikainen, M.: Face description with local binary patterns: Application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefGoogle Scholar
  2. 2.
    Ahonen, T., Rahtu, E., Ojansivu, V., Heikkila, J.: Recognition of blurred faces using local phase quantization. In: Int. Conf. on Pattern Recognition, pp. 1–4 (2008)Google Scholar
  3. 3.
    Bordallo Lopez, M., Boutellaa, E., Hadid, A.: Comments on the “kinship face in the wild” data sets. IEEE Trans. Pattern Anal. Mach. Intell. (2016).  https://doi.org/10.1109/TPAMI.2016.2522416Google Scholar
  4. 4.
    Bottino, A.G., Ul Islam, I., Vieira, T.: A multi-perspective holistic approach to kinship verification in the wild (2015)Google Scholar
  5. 5.
    Chan, C.H., Tahir, M., Kittler, J., Pietikainen, M.: Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1164–1177 (2013)CrossRefGoogle Scholar
  6. 6.
    Chen, X., An, L., Yang, S., Wu, W.: Kinship verification in multi-linear coherent spaces. Multimedia Tools and Applications pp. 1–18 (2015)Google Scholar
  7. 7.
    Chopra, S., Hadsell, R., Lecun, Y.: Learning a similarity metric discriminatively, with application to face verification. In: Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, pp. 539–546 vol. 1 (2005)Google Scholar
  8. 8.
    DalMartello, M.F., Maloney, L.T.: Where are kin recognition signals in the human face? Journal of Vision 6(12), 2 (2006)CrossRefGoogle Scholar
  9. 9.
    DeBruine, L.M., Smith, F.G., Jones, B.C., Roberts, S.C., Petrie, M., Spector, T.D.: Kin recognition signals in adult faces. Vision Research 49(1), 38–43 (2009)CrossRefGoogle Scholar
  10. 10.
    Dibeklioğlu, H., Salah, A., Gevers, T.: Are you really smiling at me? spontaneous versus posed enjoyment smiles. In: Computer Vision-ACCV, pp. 525–538. Springer (2012)Google Scholar
  11. 11.
    Dibeklioğlu, H., Salah, A., Gevers, T.: Like father like son facial expression dynamics for kinship verification. In: IEEE Int. Conf. on Computer Vision, pp. 1497–1504 (2013)Google Scholar
  12. 12.
    Fang, R., Tang, K., Snavely, N., Chen, T.: Towards computational models of kinship verification. In: IEEE Int. Conf. on Image Processing, pp. 1577–1580 (2010).  https://doi.org/10.1109/ICIP.2010.5652590
  13. 13.
    Fang, R., Tang, K.D., Snavely, N., Chen, T.: Towards computational models of kinship verification. In: Proceedings / ICIP … International Conference on Image Processing, pp. 1577–1580 (2010)Google Scholar
  14. 14.
    Guo, G., Wang, X.: Kinship measurement on salient facial features. IEEE Instrum. Meas. Mag. 61(8), 2322–2325 (2012).  https://doi.org/10.1109/TIM.2012.2187468CrossRefGoogle Scholar
  15. 15.
    Hu, J., Lu, J., Yuan, J., Tan, Y.P.: Large margin multi-metric learning for face and kinship verification in the wild. In: Computer Vision–ACCV 2014, pp. 252–267. Springer (2015)Google Scholar
  16. 16.
    Huang, G., Lee, H., Learned-Miller, E.: Learning hierarchical representations for face verification with convolutional deep belief networks. In: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 2518–2525 (2012).  https://doi.org/10.1109/CVPR.2012.6247968
  17. 17.
    Kannala, J., Rahtu, E.: BSIF: Binarized statistical image features. In: Int. Conf. on Pattern Recognition (ICPR), pp. 1363–1366 (2012)Google Scholar
  18. 18.
    Kou, L., Zhou, X., Xu, M., Shang, Y.: Learning a genetic measure for kinship verification using facial images. Mathematical Problems in Engineering 2015 (2015)Google Scholar
  19. 19.
    Lu, J., Zhou, X., Tan, Y.P., Shang, Y., Zhou, J.: Neighborhood repulsed metric learning for kinship verification. In: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 2594–2601 (2012)Google Scholar
  20. 20.
    Lu, J., Zhou, X., Tan, Y.P., Shang, Y., Zhou, J.: Neighborhood repulsed metric learning for kinship verification. Pattern Analysis and Machine Intelligence, IEEE Transactions on 36(2), 331–345 (2014)CrossRefGoogle Scholar
  21. 21.
    Lu, J., et al.: Kinship verification in the wild: The first kinship verification competition. In: IEEE Int. Joint Conf. on Biometrics (IJCB), pp. 1–6 (2014)Google Scholar
  22. 22.
    Lu, J., Hu, J., Zhou, X., Zhou, J., Castrillón-Santana, M., Lorenzo-Navarro, J., Kou, L., Shang, Y., Bottino, A., Figuieiredo Vieira, T.: Kinship verification in the wild: The first kinship verification competition. In: Biometrics (IJCB), 2014 IEEE International Joint Conference on, pp. 1–6. IEEE (2014)Google Scholar
  23. 23.
    Lu, J., Hu, J., Liong, V.E., Zhou, X., Bottino, A., Islam, I.U., Vieira, T.F., Qin, X., Tan, X., Chen, S., et al.: The fg 2015 kinship verification in the wild evaluation. Proc. FG (2015)Google Scholar
  24. 24.
    Lu, J., et al.: The FG 2015 kinship verification in the wild evaluation. In: IEEE Int. Conf. on Automatic Face and Gesture Recognition (FG), vol. 1, pp. 1–7 (2015). https://doi.org/10.1109/FG.2015.7163159
  25. 25.
    Mignon, A.: Pcca: A new approach for distance learning from sparse pairwise constraints. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2666–2672 (2012)Google Scholar
  26. 26.
    Palm, R.B.: Prediction as a candidate for learning deep hierarchical models of data (2012). http://www.imm.dtu.dk/English.aspx. Supervised by Associate Professor Ole Winther, owi@imm.dtu.dk, DTU Informatics, and Morten Mørup, mm@imm.dtu.dk, DTU Informatics
  27. 27.
    Parkhi, O.M., Vedaldi, A., Zisserman, A.: Deep face recognition. In: British Machine Vision Conf. (2015)Google Scholar
  28. 28.
    Qin, X., Tan, X., Chen, S.: Tri-subject kinship verification: understanding the core of a family. Multimedia, IEEE Transactions on 17(10), 1855–1867 (2015)CrossRefGoogle Scholar
  29. 29.
    Somanath, G., Kambhamettu, C.: Can faces verify blood-relations? In: Biometrics: Theory, Applications and Systems (BTAS), 2012 IEEE Fifth International Conference on, pp. 105–112. IEEE (2012)Google Scholar
  30. 30.
    Wang, X., Kambhamettu, C.: Leveraging appearance and geometry for kinship verification. In: Image Processing (ICIP), 2014 IEEE International Conference on, pp. 5017–5021. IEEE (2014)Google Scholar
  31. 31.
    Xia, S., Shao, M., Fu, Y.: Kinship verification through transfer learning. In: IJCAI Proceedings-International Joint Conference on Artificial Intelligence, vol. 22, p. 2539 (2011)Google Scholar
  32. 32.
    Xia, S., Shao, M., Fu, Y.: Toward kinship verification using visual attributes. In: Pattern Recognition (ICPR), 2012 21st International Conference on, pp. 549–552. IEEE (2012)Google Scholar
  33. 33.
    Yan, H., Lu, J., Deng, W., Zhou, X.: Discriminative multimetric learning for kinship verification. Information Forensics and Security, IEEE Transactions on 9(7), 1169–1178 (2014)CrossRefGoogle Scholar
  34. 34.
    Yan, H.C., Lu, J., Zhou, X.: Prototype-based discriminative feature learning for kinship verification (2014)Google Scholar
  35. 35.
    Zhang, K., Huang, Y., Song, C., Wu, H., Wang, L.: Kinship verification with deep convolutional neural networks. In: British Machine Vision Conf. (BMVC) (2015)Google Scholar
  36. 36.
    Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 915–928 (2007)CrossRefGoogle Scholar
  37. 37.
    Zhou, X., Hu, J., Lu, J., Shang, Y., Guan, Y.: Kinship verification from facial images under uncontrolled conditions. In: ACM Int. Conf. on Multimedia, pp. 953–956 (2011)Google Scholar
  38. 38.
    Zhou, X., Lu, J., Hu, J., Shang, Y.: Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. In: Proceedings of the 20th ACM international conference on Multimedia, pp. 725–728. ACM (2012)Google Scholar
  39. 39.
    Zhou, X., Lu, J., Hu, J., Shang, Y.: Gabor-based gradient orientation pyramid for kinship verification under uncontrolled environments. In: ACM Int. Conf. on Multimedia, pp. 725–728 (2012). https://doi.org/10.1145/2393347.2396297.
  40. 40.
    Zhou, X., Shang, Y., Yan, H., Guo, G.: Ensemble similarity learning for kinship verification from facial images in the wild. Information Fusion (2015). https://doi.org/10.1016/j.inffus.2015.08.006. http://www.sciencedirect.com/science/article/pii/S1566253515000792

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Xiaoting Wu
    • 1
  • Xiaoyi Feng
    • 1
    Email author
  • Lei Li
    • 1
  • Elhocine Boutellaa
    • 2
  • Abdenour Hadid
    • 2
  1. 1.School of Electronics and InformationNorthwestern Polytechnical UniversityXi’anChina
  2. 2.Center for Machine Vision and Signal AnalysisUniversity of OuluOuluFinland

Personalised recommendations