Abstract
Face is the most considerable constituent that people use to recognize one another. Humans can quickly and easily identify each other by their faces and since facial features are unobtrusive to lighting condition and pose, face remains as a dynamic recognition approach to human. Kinship recognition refers to the task of training a machine to recognize the blood relation between a pair of kin and non-kin faces (verification) based on features extracted from facial images, and to determine the exact type or degree of that relation (identification). Automatic kinship verification and identification is an interesting areas for investigation, and it has a significant impact in many real world applications, for instance, forensic, finding missing family members, and historical and genealogical research. However, kinship recognition is still not largely explored due to insufficient database availability. In this paper we present a survey on issues and challenges in kinship verification and identification, related previous works, current trends and advancements in kinship recognition, and potential applications and research direction for the future. We also found that Deep Learning (DL) has mostly outperformed numerous methods using manually designed features by automatically learning and extracting important information from facial features, and enable significant visual recognition functions by improving accuracy in most applications.
Similar content being viewed by others
References
Amogh G Recognizing semantic features in faces using deep learning. Master’s thesis, University of Amsterdam, the Amsterdam, September
Biswas S, Bowyer KW, Flynn PJ (2011) A study of face recognition of identical twins by humans. In: 2011 IEEE international workshop on information forensics and security (WIFS). IEEE, pp 1–6
Blaustein AR, O’Hara RK (1981) Genetic control for sibling recognition? Nature 290(5803):246–248
Bottino AG, De Simone M, Laurentini A, Vieira T (2012) A new problem in face image analysis: finding kinship clues for siblings pairs
Dal Martello MF, Maloney LT (2006) Where are kin recognition signals in the human face? J Vis 6(12):2
Dantcheva A, Chen C, Ross A (2012) Can facial cosmetics affect the matching accuracy of face recognition systems?. In: 2012 IEEE Fifth international conference on biometrics: theory, applications and systems (BTAS). IEEE, pp 391–398
DeBruine LM, Smith FG, Jones BC, Craig Roberts S, Petrie M, Spector TD (2009) Kin recognition signals in adult faces. Vis Res 49(1):38–43
Dehghan A, Ortiz EG, Villegas R, Shah M (2014) Who do i look like? determining parent-offspring resemblance via gated autoencoders
De Marsico M, Nappi M, Riccio D, Wechsler H (2011) Robust face recognition after plastic surgery using local region analysis. Springer, pp 191–200
Dend L (2012) Three classes of deep learning architectures and their applications: a tutorial survey. APSIPA transactions on signal and information processing
Deng L (2014) A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Transactions on Signal and Information Processing 3:e2
Dibeklioglu H, Salah AAli, Gevers T (2013) Like father, like son: facial expression dynamics for kinship verification. In: 2013 IEEE international conference on computer vision (ICCV). IEEE, pp 1497–1504
Esme B, Sankur B (2010) Effects of aging over facial feature analysis and face recognition. Bogazici Un Electronics Eng Dept
Fan H, Cao Z, Jiang Y, Yin Q, Doudou C (2014) Learning deep face representation. arXiv:1403.2802
Fang R, Tang KD, Snavely N, Chen T (2010) Towards computational models of kinship verification. In: 2010 17th IEEE international conference on image processing (ICIP). IEEE, pp 1577–1580
Fang R, Gallagher AC, Chen T, Loui AC (2013) Kinship classification by modeling facial feature heredity. In: ICIP, pp 2983–2987
Froelich AG, Nettleton D (2013) Does my baby really look like me? using tests for resemblance between parent and child to teach topics in categorical data analysis. J Stat Educ 21(2)
Fu Y (2014) Human-Centered Social Media Analytics. Springer
Ghahramani M, Yau W-Y, Teoh EK (2014) Family verification based on similarity of individual family members facial segments. Mach Vis Appl 25(4):919–930
Gordon Marshall (1998) kinship
Guo G, Wang X (2012) Kinship measurement on salient facial features. IEEE Trans Instrum Meas 61(8):2322–2325
Guo Y, Dibeklioglu H, van der Maaten L (2014) Graph-based kinship recognition. In: 22nd international conference on pattern recognition (ICPR 2014)
Guosheng H, Yang Y, Yi D, Kittler J, Christmas W, Li SZ, Hospedales T (2015) When face recognition meets with deep learning: an evaluation of convolutional neural networks for face recognition. arXiv:1504.02351
International Encyclopedia of the Social Sciences (1968) Kinship
International Encyclopedia of the Social Sciences (2008) Kinship
Jafri R, Arabnia HR (2009) A survey of face recognition techniques. JIPS 5(2):41–68
Jha M (1994) Introduction to Indian Anthropology. Vikas Publishing House Pvt Ltd
Jiao F, Gao W, Chen X, Cui G, Shan S (2002) A face recognition method based on local feature analysis. In: Proceedings of the 5th Asian conference on computer vision, pp 188–192
Jiwen L, Junlin H, Zhou X, Shang Y, Tan Y-P, Wang G (2012) Neighborhood repulsed metric learning for kinship verification. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 2594–2601
John Scott and Gordon Marshall (2005) Oxford dictionary of sociology
Jung K, Zhang B-T, Mitra P (2015) Deep learning for the web. In: Proceedings of the 24th International Conference on World Wide Web Companion. International World Wide Web Conferences Steering Committee, pp 1525–1526
Kakarwal S, Deshmukh RR (2010) Wavelet transform based feature extraction for face recognition. IJCSA Issue-I June:0974–0767
Kaminski G, Dridi S, Graff C, Gentaz E (2009) Human ability to detect kinship in strangers’ faces: effects of the degree of relatedness. In: Proceedings of the Royal Society B: Biological Sciences
Kaplan S (2012) The effect of gender on recalling facial features: does our gender determine which features are encoded at first glance?
Kohli N, Singh R, Vatsa M (2012) Self-similarity representation of weber faces for kinship classification. In: 2012 IEEE Fifth international conference on biometrics: theory, applications and systems (BTAS). IEEE, pp 245–250
Lamba H, Sarkar A, Vatsa M, Singh R, Noore A (2011) Face recognition for look-alikes: a preliminary study. In: 2011 international joint conference on biometrics (IJCB). IEEE, pp 1–6
Levy C (2014) Researcher offers opportunity to face your age for science
Li D, Dong Y (2014) Deep learning: methods and applications. Foundations and Trends in Signal Processing 7(3–4):197–387
Lieberman D, Tooby J, Cosmides L (2007) The architecture of human kin detection. Nature 445(7129):727–731
Lin S-H (2000) An introduction to face recognition technology. Informing Science 3(1):1–8
Ling H, Soatto S, Ramanathan N, Jacobs DW (2010) Face verification across age progression using discriminative methods. IEEE Trans Inf Forensics Secur 5(1):82–91
Liu Z, Luo P, Wang X, Tang X (2014) Deep learning face attributes in the wild. arXiv:1411.7766
Lu J, Zhou X, Tan YP, Shang Y, Zhou J (2014) Neighborhood repulsed metric learning for kinship verification. IEEE Trans Pattern Anal Mach Intell 36(2):331
Maloney LT, Dal Martello MF (2006) Kin recognition and the perceived facial similarity of children. J Vis 6(10):4
Mo D (2012) A survey on deep learning: one small step toward ai. Dept. Computer Science, Univ. of New Mexico, USA
Mondal P Kinship: brief essay on kinship
Mozaffari S, Behravan H (2011) Twins facial similarity impact on conventional face recognition systems. In: 2011 19th Iranian conference on electrical engineering (ICEE). IEEE, pp 1–6
Mun M, Deorankar A, Chatur P (2014) A literature review: effect of plastic surgery on face recognition. In: International journal of engineering research and technology, vol 2. ESRSA Publications
Nadimpalli SK, Prasad SSV, Raghava PV (2014) Kinship terms in telugu and english. International Journal of Humanities and Social Science Invention 3(4):44–46
Najafabadi MM, Villanustre F, Khoshgoftaar TM, Seliya N, Wald R, Muharemagic E (2015) Deep learning applications and challenges in big data analytics. Journal of Big Data 2(1):1–21
Park JH, Schaller M, Van Vugt M (2008) Psychology of human kin recognition: heuristic cues, erroneous inferences, and their implications. Rev Gen Psychol 12(3):215
Plomin R, Daniels D (2011) Why are children in the same family so different from one another? Int J Epidemiol 40(3):563–582
Rahman MU (2012) A comparative study on face recognition techniques and neural network. arXiv:1210.1916
Reis HT, Sprecher S (2009) Encyclopedia of Human Relationships: vol 1. Sage
Sadrô J, Jarudi I, Sinhaô P (2003) The role of eyebrows in face recognition. Perception 32(3):285–293
Senior AW, Bolle RM (2002) Face recognition and its application. In: Biometric Solutions. Springer, pp 83–97
Shao M, Xia S, Yun F (2011) Genealogical face recognition based on ub kinface database. In: 2011 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW). IEEE, pp 60–65
Sinha P, Balas B, Ostrovsky Y, Richard Russell (2006) Face recognition by humans: nineteen results all computer vision researchers should know about. Proc IEEE 94(11):1948–1962
Somanath G, Kambhamettu C (2012) Can faces verify blood-relations?. In: 2012 IEEE Fifth international conference on biometrics: theory, applications and systems (BTAS). IEEE, pp 105–112
Somanath G, Rohith MV, Kambhamettu C (2011) Vadana: a dense dataset for facial image analysis. In: 2011 IEEE international conference on computer vision workshops (ICCV Workshops). IEEE, pp 2175–2182
Song Y, Leung T (2006) Context-aided human recognition–clustering. In: Computer Vision–ECCV 2006. Springer, pp 382–395
Sun Y, Chen Y, Wang X, Tang X (2014) Deep learning face representation by joint identification-verification. In: Advances in Neural Information Processing Systems, pp 1988–1996
Sun Y, Liang D, Wang X, Tang X (2015) Deepid3: face recognition with very deep neural networks. arXiv:1502.00873
Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1701–1708
Tan X, Chen S, Zhou Z-H, Zhang F (2006) Face recognition from a single image per person: a survey. Pattern Recogn 39(9):1725–1745
Tanaka JW, Farah MJ (1993) Parts and wholes in face recognition. Q J Exp Psychol 46(2):225–245
Tang Y (2013) Deep learning using linear support vector machines. arXiv:1306.0239
Vieira TF (2013) Identifying kinship cues from facial images
Vieira TF, Bottino A, Ul Islam I (2013) Automatic Verification of Parent-Child Pairs from Face Images, pp 326–333. Springer
Vieira TF, Bottino A, Laurentini A, De Simone M (2013) Detecting siblings in image pairs. Vis Comput:1–13
Wang Y, Li B, Luo R, Chen Y, Ningyi X, Yang H (2014) Energy efficient neural networks for big data analytics. In: Design, Automation and Test in Europe Conference and Exhibition (DATE), 2014. IEEE, pp 1–2
Wechsler H (2009) Reliable face recognition methods: system design, implementation and evaluation, vol 7. Springer Science & Business Media
Who do you look like? dna and family resemblance across generations (2013)
Xia S, Shao M, Yun F (2011) Kinship verification through transfer learning. In: IJCAI Proceedings-international joint conference on artificial intelligence, vol 22, p 2539
Xia S, Shao M, Luo J, Fu Y (2012) Understanding kin relationships in a photo. IEEE Trans Multimedia 14(4):1046–1056
Xia S, Shao M, Yun F (2012) Toward kinship verification using visual attributes. In: 2012 21st international conference on pattern recognition (ICPR). IEEE, pp 549–552
Yan H, Jiwen L, Deng W, Zhou X (2014) Discriminative multi-metric learning for kinship verification
Yao L, Miller J Tiny imagenet classification with convolutional neural networks
Young AW, Hay DC, McWeeny KH, Flude BM, Ellis AW (1985) Matching familiar and unfamiliar faces on internal and external features. Perception 14(6):737–746
Zhang L, Xia G-S, Wu T, Lin L, Tai XC (2015) Deep learning for remote sensing image understanding. Journal of Sensors 501:173691
Zhao W, Chellappa R (2011) Face Processing: Advanced Modeling and Methods: Advanced Modeling and Methods. Academic Press
Zhao W, Chellappa R, Phillips PJ, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv (CSUR) 35(4):399–458
Zhou X, Junlin H, Jiwen L, Shang Y, Guan Y (2011) Kinship verification from facial images under uncontrolled conditions. In: Proceedings of the 19th ACM international conference on multimedia. ACM, pp 953–956
Zhu Z, Luo P, Wang X, Tang X (2013) Deep learning identity-preserving face space. In: 2013 IEEE international conference on computer vision (ICCV). IEEE, pp 113–120
Zhu Z, Luo P, Wang X, Tang X (2014) Deep learning multi-view representation for face recognition. arXiv:1406.6947
Acknowledgments
I would like to express my special thanks of gratitude to the Saudi Ministry of Higher Education, Cultural Mission in Malaysia, UTM-Big Data Center as well as University Teknologi Malaysia (UTM) who gave me the golden opportunity to do this paper on the topic “Automated Kinship Verification and Identification Through Human Facial Images”, which also helped me in doing a lot of Research and I came to know about so many new things I am really thankful to them.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Almuashi, M., Mohd Hashim, S.Z., Mohamad, D. et al. Automated kinship verification and identification through human facial images: a survey. Multimed Tools Appl 76, 265–307 (2017). https://doi.org/10.1007/s11042-015-3007-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-3007-5