TinyPoseNet: A Fast and Compact Deep Network for Robust Head Pose Estimation

  • Shanru Li
  • Liping Wang
  • Shuang Yang
  • Yuanquan Wang
  • Chongwen WangEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10635)


As an inherent attribute of human, head pose plays an important role in many tasks. In this paper, we formulate head pose estimation in different directions as a multi-task regression problem, and propose a fast, compact and robust head pose estimation model, named TinyPoseNet. Specifically, we combine the tasks of head pose estimation in different directions into one joint learning task and design the whole model based on the principle of “being deeper” and “being thinner” to obtain a tiny model with specially designed types and particular small numbers of filters. We perform thorough experiments on 3 types of test sets and compare our method with others from several different aspects, including the accuracy, the speed, the compactness and so on. In addition, we introduce large angle data in Multi-PIE to verify the ability of dealing with large-scale pose in practice. All the experiments demonstrate the advantages of the proposed model.


Head pose estimation Deep learning Data augmentation 


  1. 1.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
  2. 2.
    Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). doi: 10.1007/978-3-319-10590-1_53 Google Scholar
  3. 3.
    Kuchinsky, A., Pering, C., Creech, M.L., Freeze, D., Serra, B., Gwizdka, J.: Fotofile: a consumer multimedia organization and retrieval system. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pp. 496–503. ACM (1999)Google Scholar
  4. 4.
    Drouard, V., Ba, S., Evangelidis, G., Deleforge, A., Horaud, R.: Head pose estimation via probabilistic high-dimensional regression. In: IEEE International Conference on Image Processing (ICIP) 2015, pp. 4624–4628. IEEE (2015)Google Scholar
  5. 5.
    Wang, C., Song, X.: Robust head pose estimation via supervised manifold learning. Neural Networks 53, 15–25 (2014)CrossRefzbMATHGoogle Scholar
  6. 6.
    Krüger, N., Pötzsch, M., von der Malsburg, C.: Determination of face position and pose with a learned representation based on labelled graphs. Image Vis. Comput. 15(8), 665–673 (1997)CrossRefGoogle Scholar
  7. 7.
    Wu, J., Trivedi, M.M.: A two-stage head pose estimation framework and evaluation. Pattern Recogn. 41(3), 1138–1158 (2008)CrossRefzbMATHGoogle Scholar
  8. 8.
    Ahn, B., Park, J., Kweon, I.S.: Real-time head orientation from a monocular camera using deep neural network. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9005, pp. 82–96. Springer, Cham (2015). doi: 10.1007/978-3-319-16811-1_6 Google Scholar
  9. 9.
    Yan, Y., Ricci, E., Subramanian, R., Liu, G., Lanz, O., Sebe, N.: A multi-task learning framework for head pose estimation under target motion. IEEE Trans. Pattern Anal. Mach. Intell. 38(6), 1070–1083 (2016)CrossRefGoogle Scholar
  10. 10.
    Mukherjee, S.S., Robertson, N.M.: Deep head pose: gaze-direction estimation in multimodal video. IEEE Trans. Multimedia 17(11), 2094–2107 (2015)CrossRefGoogle Scholar
  11. 11.
    Liu, X., Kan, M., Wu, W., Shan, S., Chen, X.: Viplfacenet: an open source deep face recognition sdk. arXiv preprint arXiv:1609.03892 (2016)
  12. 12.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  13. 13.
    Han, S., Mao, H., Dally, W.J.: Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015)
  14. 14.
    Lin, M., Chen, Q., Yan, S.: Network in network. Computer Science (2014)Google Scholar
  15. 15.
    Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)Google Scholar
  16. 16.
    Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)zbMATHMathSciNetGoogle Scholar
  17. 17.
    Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: Multi-pie. Image Vis. Comput. 28(5), 807–813 (2010)CrossRefGoogle Scholar
  18. 18.
    Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., Zhao, D.: The cas-peal large-scale chinese face database and baseline evaluations. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 38(1), 149–161 (2008)CrossRefGoogle Scholar
  19. 19.
    Bansal, A., Nanduri, A., Castillo, C., Ranjan, R., Chellappa, R.: Umdfaces: An annotated face dataset for training deep networks. arXiv preprint arXiv:1611.01484 (2016)
  20. 20.
    Davis, L.S., Gonzalez, J., Haj, M.A.: On partial least squares in head pose estimation: How to simultaneously deal with misalignment. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2602–2609 (2012)Google Scholar
  21. 21.
    Heo, J., Savvides, M.: Face recognition across pose using view based active appearance models (vbaams) on cmu multi-pie dataset. In: International Conference on Computer Vision Systems, pp. 527–535 (2008)Google Scholar
  22. 22.
    Zhu, X., Lei, Z., Yan, J., Yi, D., Li, S.Z.: High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 787–796 (2015)Google Scholar
  23. 23.
    Yi, D., Lei, Z., Liao, S., Li, S.: Learning face representation from scratch. arXiv preprint arXiv:1411.7923 (2014)
  24. 24.
    Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. arXiv preprint arXiv:1409.4842 (2014)
  25. 25.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015)

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Shanru Li
    • 1
  • Liping Wang
    • 2
  • Shuang Yang
    • 3
    • 4
  • Yuanquan Wang
    • 5
  • Chongwen Wang
    • 1
    Email author
  1. 1.School of SoftwareBeijing Institute of TechnologyBeijingChina
  2. 2.Purple Bull FundsBeijingChina
  3. 3.Key Lab of Intelligent Information Processing of Chinese Academy of Sciences(CAS)Institute of Computing Technology, CASBeijingChina
  4. 4.University of Chinese Academy of SciencesBeijingChina
  5. 5.Hebei University of TechnologyTianjinChina

Personalised recommendations