Optical Flow for Detection of Transitions in Video, Face and Facial Expression

  • Jharna MajumdarEmail author
  • M. Aniketh
  • N. R. Giridhar
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 858)


Optical Flow is the apparent motion of pixels that is generated when there is relative motion between an observer and a scene. Optical flow is used in many areas of research for object detection, motion estimation, navigation and tracking applications. In this paper, we have proposed two novel applications where Optical Flow has been used for Determining Shot Transitions in a video sequence and Human-Face Expression Detection in a video. For Video Shot Detection, local invariant feature points using SIFT (Scale Invariant Feature Transform) corner detectors is calculated and Optical Flow is computed with the detected feature points to determine shot changes in the video. Quality Parameters like Recall, Precision and F-measure is used to determine the quality of the algorithm. Whereas for detecting of human faces, we begin by first performing skin segmentation to obtain probable regions where human face is present. Within the probable region Optical Flow is used to eliminate the background and other objects having human skin color. From the isolated face, Optical Flow is used for identifying expressions.


Scale Invariant Feature Transform (SIFT) Shot transition in a video Optical flow Skin segmentation Expression detection 



The authors express their sincere gratitude to Prof. N.R. Shetty, Advisor and Dr. H.C. Nagaraj, Principal, Nitte Meenakshi Institute of Technology for giving constant encouragement and support to carry out research at NMIT. The authors extend their thanks and gratitude to the Vision Group on Science and Technology (VGST), Government of Karnataka to acknowledge their research and providing financial support to setup the infrastructure required to carry out the research.


  1. 1.
    Mohammed, A.D., Morris, T.: Optical Flow Estimation using Local FeaturesGoogle Scholar
  2. 2.
    Nourani-Vatani, N., Borges, P.V.K., Roberts, J.M., Srinivasan, M.V.: On the use of Optical Flow for Scene Change Detection and DescriptionGoogle Scholar
  3. 3.
    Liu, M., Wu, C., Zhang, Y.: Multi-resolution Optical Flow tracking algorithm based on Multi-scale Harris Corner points featureGoogle Scholar
  4. 4.
    Majumdar, J., Venkatesh, G.M., Kamath, A.: Video Shot Detection using Corner Detectors and Optical LowGoogle Scholar
  5. 5.
    Lowe, D.G.: Distinctive Image Features from Scale-Invariant KeypointsGoogle Scholar
  6. 6.
    Copyright 10718/2017-CO/ SW, SIFT corner detector and descriptorGoogle Scholar
  7. 7.
    Jacobs, L., Weiss, J., Dolan, D.: Object Tracking in Noisy Radar Data: Comparison of Hough Transform and RANSACGoogle Scholar
  8. 8.
    Kroger, M., Sauer-Greff, W., Urbansky, R., Lorang, M., Seigrist, M.: Performance evaluation on contour extraction using Hough Transform and RANSAC for multi-sensor data fusion applications in industrial food inspectionGoogle Scholar
  9. 9.
    Beckouche, S., Leprince, S., Ayoub, S.F.: Robust Outliers Detection in Image Point MatchingGoogle Scholar
  10. 10.
    Viola, P., Robust, M.J.: Real-Time Object DetectionGoogle Scholar
  11. 11.
    Dhavalikar, A.S., Kulkarni, R.K.: Face Detection and Facial Expression Recognition SystemGoogle Scholar
  12. 12.
    Ketki, R., Sahebrao, K., Bagal, B.: Facial Expression RecognitionGoogle Scholar
  13. 13.
    Happy, S.L., Routray, A.: Automatic Facial Expression Recognition using Features of Salient Facial Patches. IEEEGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringHead Center for Robotics ResearchBangaloreIndia
  2. 2.Department of Computer Science and EngineeringNitte Meenakshi Institute of TechnologyBangaloreIndia

Personalised recommendations