Skip to main content

Online Audience Measurement System Based on Machine Learning Techniques

  • Conference paper
  • First Online:
Video Analytics for Audience Measurement (VAAM 2014)

Abstract

An application for video data analysis based on computer vision methods is presented. The proposed system consists of five consecutive stages: face detection, face tracking, gender recognition, age classification and statistics analysis. AdaBoost classifier is utilized for face detection. A modification of Lucas and Kanade algorithm is introduced on the stage of tracking. Novel gender and age classifiers based on adaptive features, local binary patterns and support vector machines are proposed. More than 92 % accuracy of viewer’s gender recognition is achieved. All the stages are united into a single system of audience analysis. The system allows to extract all the possible information about depicted people from the input video stream, to aggregate and analyze this information in order to measure different statistical parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alpaydin, E.: Introduction to Machine Learning. The MIT Press, Cambridge (2010)

    MATH  Google Scholar 

  2. Sammut, C., Webb, G.I.: Encyclopedia of Machine Learning. Springer, New York (2011)

    MATH  Google Scholar 

  3. Li, S.Z., Anil, K.J.: Handbook of Face Recognition. Springer, London (2005)

    MATH  Google Scholar 

  4. Kriegman, D., Yang, M.H., Ahuja, N.: Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24(1), 34–58 (2002)

    Article  Google Scholar 

  5. Hjelmas, E.: Face detection: a survey. Comput. Vis. Image Underst. 83(3), 236–274 (2001)

    Article  MATH  Google Scholar 

  6. Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. (CSUR) 35(4), 399–458 (2003)

    Article  Google Scholar 

  7. Szeliski, R.: Computer Vision: Algorithms and Applications. Springer, London (2010)

    Google Scholar 

  8. Makinen, E., Raisamo, R.: An experimental comparison of gender classification methods. Pattern Recogn. Lett. 29(10), 1544–1556 (2008)

    Article  Google Scholar 

  9. Tamura, S., Kawai, H., Mitsumoto, H.: Male/female identification from 8 to 6 very low resolution face images by neural network. Pattern Recogn. Lett. 29(2), 331–335 (1996)

    Article  Google Scholar 

  10. Khryashchev, V., Priorov, A., Shmaglit, A.L., Golubev, M.: Gender recognition via face area analysis. In: Proceedings of the World Congress on Engineering and Computer Science, Berkeley, USA, pp. 645–649 (2012)

    Google Scholar 

  11. Fu, Y., Huang, T.S.: Age synthesis and estimation via faces: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 1955–1976 (2010)

    Article  Google Scholar 

  12. Sung, K.K., Poggio, T.: Example-based learning for view-based human face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20, 39–51 (1998)

    Article  Google Scholar 

  13. Maydt, J., Lienhart, R.: Face detection with support vector machines and a very large set of linear features. In: IEEE ICME 2002, Lousanne, Switzerland (2002)

    Google Scholar 

  14. Roth, D., Yang, M.-H., Ahuja, N.: A SNoW-based face detector. In: Solla, S.A., Leen, T.K., Müller, K.-R. (eds.) Advances in Neural Information Processing Systems 12 (NIPS 12), pp. 855–861. MIT Press, Cambridge (2000)

    Google Scholar 

  15. Juell, P., Marsh, R.: A hierarchical neural network for human face detection. Pattern Recogn. 29, 781–787 (1996)

    Article  Google Scholar 

  16. Rowley, H.A., Baluja, S., Kanade, T.: Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20, 23–38 (1998)

    Article  Google Scholar 

  17. Lin, S.H., Kung, S.Y., Lin, L.J.: Face recognition/detection by probabilistic decision-based neural network. IEEE Trans. Neural Netw. 8, 114–132 (1997)

    Article  Google Scholar 

  18. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of International Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 511–518 (2001)

    Google Scholar 

  19. Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. 38, 13 (2006)

    Article  Google Scholar 

  20. Comaniciu, D., Ramesh, V., Andmeer, P.: Kernel-based object tracking. IEEE Trans. Patt. Analy. Mach. Intell. 25, 564–575 (2003)

    Article  Google Scholar 

  21. Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 593–600 (1994)

    Google Scholar 

  22. Tao, H., Sawhney, H., Kumar, R.: Object tracking with bayesian estimation of dynamic layer representations. IEEE Trans. Pattern Anal. Mach. Intell. 24, 75–89 (2002)

    Article  Google Scholar 

  23. Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of Imaging Understanding Workshop, pp. 121–130 (1981)

    Google Scholar 

  24. Da, B., Sang, N.: Local binary pattern based face recognition by estimation of facial distinctive information distribution. Opt. Eng. 48(11), 117203-1–117203-7 (2009)

    Article  Google Scholar 

  25. Phillips, P.J.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1090–1104 (2000)

    Article  Google Scholar 

  26. Burges, C.: A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 2, 121–167 (1998)

    Article  Google Scholar 

  27. Sung, E.C., Youn, J.L., Sung, J.L., Kang, R.P., Jaihie, K.: A comparative study of local feature extraction for age estimation. In: IEEE International Conference on Control Automation Robotics & Vision (ICARCV), pp. 1280–1284 (2010)

    Google Scholar 

  28. Thukral, P., Mitra, K., Chellappa, R.: A hierarchical approach for human age estimation. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1529–1532 (2012)

    Google Scholar 

  29. Guodong, G., Guowang M.: Human age estimation: What is the influence across race and gender. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 71–78 (2010)

    Google Scholar 

  30. Zhen, L., Yun, F., Huang, T.S.: A robust framework for multiview age estimation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 9–16 (2010)

    Google Scholar 

  31. Guodong, G., Xiaolong, W.: A study on human age estimation under facial expression changes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2547–2553 (2012)

    Google Scholar 

  32. Hee, L.W., Jian-Gang, W., Wei-Yun, Y., Xing, L.C., Yap, P.T.: Effects of facial alignment for age estimation. In: IEEE International Conference on Control Automation Robotics & Vision (ICARCV), pp. 644–647 (2010)

    Google Scholar 

  33. Ricanek, K., Tesafaye, T.: MORPH: a longitudinal image database of normal adult age-progression. In: IEEE 7th International Conference on Automatic Face and Gesture Recognition, pp. 341–345 (2006)

    Google Scholar 

  34. The FG-NET Aging Database. http://www.fgnet.rsunit.com/, http://wwwprima.inrialpes.fr/FGnet/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vladimir Khryashchev .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Khryashchev, V., Priorov, A., Ganin, A. (2014). Online Audience Measurement System Based on Machine Learning Techniques. In: Distante, C., Battiato, S., Cavallaro, A. (eds) Video Analytics for Audience Measurement. VAAM 2014. Lecture Notes in Computer Science(), vol 8811. Springer, Cham. https://doi.org/10.1007/978-3-319-12811-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12811-5_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12810-8

  • Online ISBN: 978-3-319-12811-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics