Abstract
In this paper, we present an optimized implementation of automatic head direction extraction for a person placed in front of his webcam. The aim is to compute the different rotation angles of the head with a non-invasive and continuous tracking. Our method is based on 2D features tracking of the face with a low cost webcam. This information is associated to a set of points from a 3D head model by perspective-n-point solution to obtain pitch, roll and yaw. These results are then compared with a reference acquired with faceLAB, a robust markerless head tracker and eye tracking system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Persa, S.-F.: Sensor fusion in head pose tracking (2006)
Emotiv EPOC headset Features, http://emotiv.com/epoc/features.php
OptiTrack, Optical motion tracking solutions, http://www.naturalpoint.com/optitrack/
ZignTrack. facial motion capture solution, http://www.zigncreations.com/zigntrack.htm
faceLAB 5. Face and eye tracking application, http://www.seeingmachines.com/product/facelab/
faceAPI. Markerless face tracking application, http://www.seeingmachines.com/product/faceapi/
Saragih, J.M., Lucey, S., Cohn, J.F.: Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision 91(2), 200–215 (2011)
Microsoft Kinect sensor, http://www.xbox.com/kinect
Fanelli, G., Weise, T., Gall, J., Van Gool, L.: Real time head pose estimation from consumer depth cameras. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 101–110. Springer, Heidelberg (2011)
Fanelli, G., Dantone, M., Gall, J., Fossati, A., Van Gool, L.: Random forests for real time 3d face analysis. International Journal of Computer Vision 101(3), 437–458 (2013)
Leroy, J., Rocca, F., Mancaş, M., Gosselin, B.: 3D Head Pose Estimation for TV Setups. In: Mancas, M., d’ Alessandro, N., Siebert, X., Gosselin, B., Valderrama, C., Dutoit, T. (eds.) INTETAIN 2013. LNICST, vol. 124, pp. 55–64. Springer, Heidelberg (2013)
Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4), 77 (2011)
Viola, P., Jones, M.J.: Robust real-time face detection. International Journal of Computer Vision 57(2), 137–154 (2004)
OpenCV documentation, http://docs.opencv.org/modules/calib3d/doc/calib3d.html
Shil, R.: Head Pose Estimation with OpenCV & OpenGL Revisited, http://www.morethantechnical.com/2012/10/17/head-pose-estimation-with-opencv-opengl-revisited-w-code/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Rocca, F., Mancas, M., Gosselin, B. (2014). Head Pose Estimation by Perspective-n-Point Solution Based on 2D Markerless Face Tracking. In: Reidsma, D., Choi, I., Bargar, R. (eds) Intelligent Technologies for Interactive Entertainment. INTETAIN 2014. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 136. Springer, Cham. https://doi.org/10.1007/978-3-319-08189-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-08189-2_8
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08188-5
Online ISBN: 978-3-319-08189-2
eBook Packages: Computer ScienceComputer Science (R0)