3D Trajectory Reconstruction Using Color-Based Optical Flow and Stereo Vision

  • Rachna VermaEmail author
  • Arvind Kumar Verma
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 985)


Automatic trajectory estimation of a moving object in a video is one of the most active research areas of computer vision, which finds many practical applications, such as development of sport playing robots, predicting trajectory for avoiding obstacle collision, automatic navigation of driverless vehicles, monitoring target hitting, etc. However, most of the work reported in literature only considers monocular videos. Due to the availability of low price stereo cameras, many applications take their advantages by incorporating depth information. In this paper, the 3D trajectory of a primary-color (red or green or blue) object is estimated using color-based optical flow and stereo vision. The purpose of using stereo vision is to gain depth information for generating 3D trajectory. The system has been tested on many stereo videos and experimental results are quite accurate. Besides, the low computation time required for finding depth of the tracked path makes it suitable for real time applications.


Object detection Object tracking Optical flow 3D trajectory Stereo vision 


  1. 1.
    Heath, K., Guibas, L.: Multi-person tracking from sparse 3D trajectories in a camera sensor network. In: Second ACM/IEEE International Conference on Distributed Smart Cameras, ICDSC (2008)Google Scholar
  2. 2.
    Kale, K., Pawar, S., Dhulekar, P.: Moving object tracking using optical flow and motion vector estimation. In: 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (2015)Google Scholar
  3. 3.
    Verma, R.: Detecting and tracking a moving object in a dynamic background using color-based optical flow. Int. J. Adv. Res. Comput. Eng. Technol. 6(11), 1758–1763 (2017)Google Scholar
  4. 4.
    Pan, Z., Liu, S., Fu, W.: A review of visual moving target tracking. Multimedia Tools Appl. 76(16), 16989–17018 (2017)CrossRefGoogle Scholar
  5. 5.
    Verma, R.: A review of object detection and tracking methods. Int. J. Adv. Eng. Res. Dev. 4(10), 569–578 (2017)Google Scholar
  6. 6.
    Fiaz, M., Mahmoody, A., Jungz, S.K.: Tracking Noisy Targets: A Review of Recent Object Tracking Approaches”, arXiv:1802.03098v2 [cs.CV] (2018)
  7. 7.
    Aslani, S., Mahdavi-Nasab, H.: Optical flow based moving object detection and tracking for traffic surveillance. Int. J. Electr. Comput. Energe. Electron. Commun. Eng. 7(9), 789–793 (2013)Google Scholar
  8. 8.
    Choi, J.W., Whangbo, T.K., Kim, C.G.: A contour tracking method of large motion object using optical flow and active contour model. Multimedia Tools Appl. 74(1), 199–210 (2015)CrossRefGoogle Scholar
  9. 9.
    Xiang, Y., Alahi, A., Savarese, S.: Learning to track: online multi-object tracking by decision making. In: ICCV (2015)Google Scholar
  10. 10.
    Beaupre, D., Bilodeau, G., Saunier, N.: Improving Multiple Object Tracking With Optical Flow And Edge Preprocessing, arXiv:1801.09646v1 [cs.CV] (2018)
  11. 11.
    Tsutsui, H., Miura, J., Shirai, J.: Optical flow-based person tracking by multiple cameras. In: International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 91–96 (2001)Google Scholar
  12. 12.
    Zhou, Z., Xu, M., Fu, W., Zhao, J.: Object tracking and positioning based on stereo vision. Appl. Mech. Mater. 303–306, 313–317 (2013)CrossRefGoogle Scholar
  13. 13.
    Park, H.S., Shiratori, T., Matthews, I., Sheikh, Y.: 3D trajectory reconstruction under perspective projection. Int. J. Comput. Vis. 115(2), 115–135 (2015)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Verma, R.: An efficient color-based object detection and tracking in videos. Int. J. Comput. Eng. Appl. XI(XI), 172–178 (2017)Google Scholar
  15. 15.
    Aires, K.R.T., Santana, A.M., Medeiros, A.A.D.: Optical flow using color information: preliminary results. ACM, New York (2008). ISBN 978-1-59593-753-7Google Scholar
  16. 16.
    Jain, R., Kasturi, R., Schunck, B.G.: Machine Vision. McGraw Hill International Edition (1995)Google Scholar
  17. 17.
    Forsyth, D.A., Ponce, J.: Computer vision: A Modern Approach, 2nd edn. Pearson, London (2012)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Department of CSE, Faculty of EngineeringJ.N.V. UniversityJodhpurIndia
  2. 2.Department of PI, Faculty of EngineeringJ.N.V. UniversityJodhpurIndia

Personalised recommendations