V-Head: Face Detection and Alignment for Facial Augmented Reality Applications
Efficient and accurate face detection and alignment are key techniques for facial augmented reality (AR) applications. In this paper, we introduce V-Head, a facial AR system which consists of three major components: (1) joint face detection and shape initialization which can efficiently localize facial regions based on the proposed face probability map and a multipose classifier and meanwhile explicitly produces a roughly aligned initial shape, (2) cascade face alignment to locate 2D facial landmarks on the detected face, and (3) 3D head pose estimation based on the perspective-n-point (PnP) algorithm so as to overlay 3D virtual objects on the detected faces. The demonstration can be accessed from https://drive.google.com/open?id=0B-H2fYiPunUtRHBFTDRzRkZvVEE.
KeywordsFace detection Face initialization Face alignment AR
- 3.Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014Google Scholar
- 4.Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: the first facial landmark localization challenge. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 397–403 (2013)Google Scholar
- 5.Yang, H., Mou, W., Zhang, Y., Patras, I., Gunes, H., Robinson, P.: Face alignment assisted by head pose estimation. In: Proceedings of the British Machine Vision Conference (BMVC), pp. 130.1–130.13. BMVA Press, September 2015Google Scholar