Advertisement

Haar Cascade Classifier and Lucas–Kanade Optical Flow Based Realtime Object Tracker with Custom Masking Technique

  • Karishma MohiuddinEmail author
  • Mirza Mohtashim Alam
  • Amit Kishor Das
  • Md. Tahsir Ahmed Munna
  • Shaikh Muhammad Allayear
  • Md. Haider Ali
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 887)

Abstract

Computer vision has been proven a remarkable entity in modern computer science. Different applications of this field have been used on a regular basis. In this paper, we propose a new model for tracking real time object (i.e., car, human face, interior objects, arms, etc.) from video feed by providing training with HAAR features and also with the implementation of Lucas Kanade Optical Flow including Custom Masking technique. Object tracking has been considered to be very much useful in augmented reality, security, virtual reality, training with simulation, etc. In this research, we have trained our classifier of a specific object for detection purpose. Upon successful training of the classifier, a video footage has been passed into the classifier. Firstly, it detects region of interest (ROI) consisting of the object(s). Secondly, with necessary preprocessing techniques we have detected the contour area enclosing the object. Finding out the contour within the detected object(s) enabled us to create green color within the contour enclosing area. We only kept green contours and subtracted everything from the frames of the scene by Custom Masking technique. Finally, we tracked the object by trailing the green contours of the detected object(s) by Lucas Kanade Optical Flow. Our developed system is able to detect and track different object(s) from a video feed with the settings of less than or equal to 30 frames per second (FPS).

Keywords

HAAR Object tracking Contour Lucas Kanade Optical Flow Custom masking 

References

  1. 1.
    Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. (CSUR) 38(4), 13 (2006)CrossRefGoogle Scholar
  2. 2.
    Chau, D.P., Bremond, F., Thonnat, M.: Object tracking in videos: approaches and issues. arXiv preprint arXiv:1304.5212 (2013)
  3. 3.
    Krause, J., Stark, M., Deng, J., Fei-Fei, L.: 3D object representations for fine-grained categorization. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 554–561 (2013)Google Scholar
  4. 4.
    Tamgade, S.N., Bora, V.R.: Motion vector estimation of video image by Pyramidal implementation of Lucas Kanade Optical flow. In: 2009 2nd International Conference on Emerging Trends in Engineering and Technology (ICETET). IEEE, pp. 914–917 (2009)Google Scholar
  5. 5.
    Rezaei, M.: Creating a Cascade of Haar-Like Classifiers: Step by Step. Obtenido de University of Auckland (2014). https://www.cs.auckland.ac.nz/~m.rezaei/Tutorials/Creating_a_Cascade_of_HaarLike_Classifiers_Step_by_Step.pdf
  6. 6.
    Soo, S.: Object detection using Haar-cascade Classifier. Institute of Computer Science, University of Tartu (2014)Google Scholar
  7. 7.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, p. I. IEEE (2001)Google Scholar
  8. 8.
    Ranftl, A., Alonso-Fernandez, F., Karlsson, S.: Face tracking using optical flow. In: 2015 International Conference of the Biometrics Special Interest Group (BIOSIG), pp. 1–5. IEEE (2015)Google Scholar
  9. 9.
    Abdat, F., Maaoui, C., Pruski, A.: Real time facial feature points tracking with Pyramidal Lucas–Kanade algorithm. In: The 17th IEEE International Symposium on Robot and Human Interactive Communication, 2008. RO-MAN 2008. IEEE. pp. 71–76 (2008)Google Scholar
  10. 10.
    Abisheva, B.B., Baisakov, B.M., Maratov, M.M.: Real-time facial feature point detection and tracking in a video sequence. Comput. Model. New Technol. 17(2), 48–52 (2013). http://www.cmnt.lv/en/on-line-journal/2013/2013-volume-17-2
  11. 11.
    Reinius, S.: Object recognition using the OpenCV Haar cascade-classifier on the iOS platform (Dissertation) (2013). http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-193282
  12. 12.
    Kanan, C., Cottrell, G.W.: Color-to-grayscale: does the method matter in image recognition? PLoS ONE 7(1), e29740 (2012)CrossRefGoogle Scholar
  13. 13.
    Green, B.: Canny edge detection tutorial (2002). http://www.scribd.com/doc/40036113/Canny-Edge-Detection-Tutorial
  14. 14.
    Patel, D., Upadhyay, S.: Optical flow measurement using Lucas Kanade method. Int. J. Comput. Appl. 61(10), 6–10 (2013)Google Scholar
  15. 15.

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Karishma Mohiuddin
    • 1
    Email author
  • Mirza Mohtashim Alam
    • 1
    • 2
  • Amit Kishor Das
    • 1
  • Md. Tahsir Ahmed Munna
    • 3
  • Shaikh Muhammad Allayear
    • 2
    • 3
  • Md. Haider Ali
    • 4
  1. 1.Department of Computer Science and EngineeringBRAC UniversityDhakaBangladesh
  2. 2.Department of Multimedia and Creative TechnologyDaffodil International UniversityDhakaBangladesh
  3. 3.Department of Software EngineeringDaffodil International UniversityDhakaBangladesh
  4. 4.Department of Computer Science and EngineeringUniversity of DhakaDhakaBangladesh

Personalised recommendations