A Multi-Agent System for Face Detection and Annotation
The purpose of this chapter is to describe the application of the problem solving ontology component of HCVM in the area of face detection and annotation. computer-based aspects of an embedded feature-based multi-agent face detection and annotation system are described in this chapter. Unlike similar feature-based systems that start from searching for facial organs in the images and group them to find faces, the system solves the problem using the problem solving agents of the HCVM in a top-down fashion. The embedded mtilti-agent face detection system makes hypotheses of face locations and seeks evidences to verify them. The five problem solving agents follow a coarse grain to fine grain methodology and work on various features of color images. The coarse to fine top-down methodology is more akin to human perceptions than a bottom-up approach. The higher level problem solving agents like decomposition work as background knowledge for the control and decision agents resulting in improvement of the accuracy and speed of detection. It is also distinct from many other top-down systems in that no re-scaling of the images is needed in the searching process. To improve the detection rate, a unique iterative region-partitioning algorithm is developed in this multi-agent system. The problem solving agents model aspects related to skin-tone region segmentation, noise reduction, candidate face regions location and facial feature extraction/face detection, and annotation. The detection algorithm is invariant to scale and rotation to some degree. The performance of the multi-agent system has been tested with a large number of images and the results obtained thus far are very encouraging.
KeywordsFacial Feature Face Detection Annotation System Image Annotation Skin Region
Unable to display preview. Download preview PDF.
- Dai, Ying et al, (1998) “Study of facial expression recognition using the Hopfield model”, DSP 90–7, pp. 37–42 (in Japanese)Google Scholar
- Gonzalez, Rafael C., Woods, Richard E., (1992) Digital Image Processing,Addison-Wesley Publishing Company.Google Scholar
- Govindaraju, V., Sher, D. B., Srihari, R.K., and Srihari, S. N., (1989), “Locating human faces in newspaper photographs”, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, June.Google Scholar
- Kapfer, M. et al, (1997) “Detection of human faces in color image sequences with arbitrary motions for very low bit-rate videophone coding”, Pattern Recognition Letters 18, p1503–1518.Google Scholar
- Leung, T. K. et al, (1995) “Finding Faces in Cluttered Scenes using Random Labeled Graph Matching”, Fifth Intl. Conf. On Computer Vision, Cambridge, MA, June.Google Scholar
- Moghaddam, Baback et al, (1998)“A Subspace Method for Maximum Likelihood Target Detection”, IEEE International Conference on Image Processing,Washington DC, October. RowleyGoogle Scholar
- Henry A., et al, (1998), “Neural Network-Based Face Detection”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 20, No. 1, January, pp23–37Google Scholar
- Saber, Eli and Tekalp, A. Murat, (1998) “Frontal-view Face Detection and Facial Feature Extraction using Color, Shape and Symmetry Based Cost Functions”, Pattern Recognition Letters,V0019 N8, June, p669–680Google Scholar
- Sirohey, Saad Ahmed,(1993) “Human Face Segmentation and Identification”, Master’s Thesis,Center for Automation Research, University of Maryland, MD, Nov.Google Scholar
- Sung, Kah-Kay et al, (1998) “Example-Based Learning for View-Based Human Face Detection”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 20, No. 1, January Sung, Kah-Kay, “Learning and Example Selection for Object and Pattern Detection”, Ph.D. dissertation, Artificial Intelligence Lab., Massachusetts Institute of TechnologyGoogle Scholar
- Zhang, Y. J. et al, “Automatic Face Segmentation Using Color Cues for Coding Typical Videophone Scenes”, SPIE Vol. 3024 Google Scholar