Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 6, pp 6827–6846 | Cite as

Vehicle counting based on a stereo vision depth maps for parking management

  • Meng-Rong Lee
  • Daw-Tung LinEmail author
Article
  • 121 Downloads

Abstract

Automated parking management systems provide convenience and efficiency, and such systems are increasingly being deployed in modern urban areas. To facilitate the crucial function of vehicle counting in several applications, we developed a novel mechanism for counting vehicles based on stereoscopic computer vision with depth perception. In this study, we first established depth maps of pairs of images captured using stereo cameras through a scene flow-based approach. Next, we designed a modified sigmoid function to change the histogram distribution in the obtained depth maps by using the disparity threshold estimated from a disparity calibration board. Then, we proposed a vehicle counting mechanism using the modified disparity histogram; this mechanism can be used to easily determine the presence of a vehicle. Consequently, we applied the proposed vehicle detection and counting method to a surveillance camera and used it to determine whether vehicles were approaching an entrance; this camera captured a clear photograph of each license plate, which was then used for automatic recognition. The proposed system was evaluated using nine sets of video data recorded in an indoor parking garage and an outdoor parking lot. The experimental results quantified our method’s high performance and robustness in vehicle counting. For the indoor parking garage, the precision and recall were 99.56% and 98.29%, respectively. For the outdoor parking lot environment, the vehicle counting precision and recall were 98.85% and 98.85%, respectively. Our method was able to avoid counting errors when distinguishing between closely spaced adjacent vehicles.

Keywords

Intelligent parking lot Vehicle counting Stereo computer vision Depth maps Modified sigmoid function 

Notes

References

  1. 1.
    Bouguet J (2004) Camera calibration toolbox for MATLAB, Example 5: Stereo rectification algorithm. http://www.vision.caltech.edu/bouguetj/calib_doc//htmls/example5.html
  2. 2.
    Bouguet JY (2001) Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation 5(1-10):4Google Scholar
  3. 3.
    Čech J, Sara R (2007) Efficient sampling of disparity space for fast and accurate matching. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp 1–8. IEEEGoogle Scholar
  4. 4.
    Čech J, Sanchez-Riera J, Horaud R (2011) Scene flow estimation by growing correspondence seeds. In: IEEE conference on computer vision and pattern recognition CVPR, pp 3129–3136. IEEEGoogle Scholar
  5. 5.
    Chintalacheruvu N, Muthukumar V (2012) Video based vehicle detection and its application in intelligent transportation systems. J Transp Technol 2(04):305CrossRefGoogle Scholar
  6. 6.
    Choudhury S, Chattopadhyay SP, Hazra TK (2017) Vehicle detection and counting using haar feature-based classifier. In: 2017 8th annual industrial automation and electromechanical engineering conference (IEMECON), pp 106–109Google Scholar
  7. 7.
    Dong H, Wang T, Yu X, Ren P (2018) Stereo matching via dual fusion. IEEE Signal Process Lett 25(5):615–619CrossRefGoogle Scholar
  8. 8.
    Harris C, Stephens M (1988) A combined corner and edge detector. In: Alvey vision conference, vol 15, pp 10–5244. Manchester, UKGoogle Scholar
  9. 9.
    Hertz JA (2018) Introduction to the theory of neural computation. CRC PressGoogle Scholar
  10. 10.
    Hung CH, Xu L, Jia J (2013) Consistent binocular depth and scene flow with chained temporal profiles. Int J Comput Vis 102(1-3):271–292MathSciNetCrossRefGoogle Scholar
  11. 11.
    Idris M, Leng Y, Tamil E, Noor N, Razak Z (2009) Park system: a review of smart parking system and its technology. Inf Technol J 8(2):101–113CrossRefGoogle Scholar
  12. 12.
    Liu F, Philomin V (2009) Disparity estimation in stereo sequences using scene flow. In: BMVC, vol 1, p 2Google Scholar
  13. 13.
    Lucas BD, Kanade T, et al. (1981) An iterative image registration technique with an application to stereo vision. In: The 7th international joint conference on artificial intelligent, pp 674–679. Vancouver, BC, CanadaGoogle Scholar
  14. 14.
    Marr D, Poggio T (1979) A computational theory of human stereo vision. Proc R Soc Lond B Biol Sci 204(1156):301–328CrossRefGoogle Scholar
  15. 15.
    Meany S, Eskew E, Martinez-Castro R, Jang S (2017) Automated vehicle counting using image processing and machine learning. In: Proceedings of SPIE, vol 10170Google Scholar
  16. 16.
    Mimbela LEY, Klein LA (2000) Summary of vehicle detection and surveillance technologies used in intelligent transportation systems. Tech. rep., Federal Highway Administration s (FHWA) Intelligent Transportation Systems Joint Program OfficeGoogle Scholar
  17. 17.
    Moravec HP (1981) Rover visual obstacle avoidance. In: International joint conference on artificial intelligence, pp 785–790Google Scholar
  18. 18.
    OpenCV Library. https://opencv.org/
  19. 19.
    Rashidi A, Fathi H, Brilakis I (2011) Innovative stereo vision-based approach to generate dense depth map of transportation infrastructure. Transp Res Record: J Transp Res Board 2215:93–99CrossRefGoogle Scholar
  20. 20.
    Song J, Song H, Wang W (2014) An accurate vehicle counting approach based on block background modeling and updating. In: Proceedings of international conference of image and signal processing (CISP), pp 16–21Google Scholar
  21. 21.
    Swathy M, Nirmala P, Geethu P (2017) Survey on vehicle detection and tracking techniques in video surveillance. International Journal of Computer Applications 160(7)Google Scholar
  22. 22.
    Tourani A, Shahbahrami A (2015) Vehicle counting method based on digital image processing algorithms. In: Proceedings of international conference pattern of recognition and image analysis (IPRIA), pp 1–6Google Scholar
  23. 23.
    Wen X, Shao L, Xue Y, Fang W (2015) A rapid learning algorithm for vehicle classification. Inform Sci 295:395–406CrossRefGoogle Scholar
  24. 24.
    Xia Y, Shi X, Song G, Geng Q, Liu Y (2016) Towards improving quality of video-based vehicle counting method for traffic flow estimation. Signal Process 120:672–681CrossRefGoogle Scholar
  25. 25.
    Yan Z, Xiang X (2016) Scene flow estimation: a survey. arXiv:1612.02590
  26. 26.
    Yuan Y, Zhao Y, Wang X (2013) Day and night vehicle detection and counting in complex environment. In: Proceedings of international conference of image and vision computing New Zealand (IVCNZ), pp 453–458Google Scholar
  27. 27.
    Zhan W, Ji X (2011) Algorithm research on moving vehicles detection. Proc Eng 15:5483–5487CrossRefGoogle Scholar
  28. 28.
    Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRefGoogle Scholar
  29. 29.
    Zheng J, Wang Y, Zeng W (2015) CNN based vehicle counting with virtual coil in traffic surveillance video. In: Proceeding of international conferences of multimedia big data (BigMM), pp 280–281Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Computer Science and Information EngineeringNational Taipei UniversityNew TaipeiTaiwan

Personalised recommendations