Content-Based Driving Scene Retrieval Using Driving Behavior and Environmental Driving Signals

  • Yiyang LiEmail author
  • Ryo Nakagawa
  • Chiyomi Miyajima
  • Norihide Kitaoka
  • Kazuya Takeda


With the increasing presence of drive recorders and advances in their technology, a large variety of driving data, including video images and sensor signals such as vehicle velocity and acceleration, can be continuously recorded and stored. Although these advances may contribute to traffic safety, the increasing amount of driving data complicates retrieval of desired information from large databases. One of our previous research projects focused on a browsing and retrieval system for driving scenes using driving behavior signals. In order to further its development, in this chapter we propose two driving scene retrieval systems. The first system also measures similarities between driving behavior signals. Experimental results show that a retrieval accuracy of more than 95 % is achieved for driving scenes involving stops, starts, and right and left turns. However, the accuracy is relatively lower for driving scenes of right and left lane changes and going up and down hills. The second system measures similarities between environmental driving signals, focusing on surrounding vehicles and driving road configuration. A subjective score from 1 to 5 is used to indicate retrieval performance, where a score of 1 means that the retrieved scene is completely dissimilar from the query scene and a score of 5 means that they are exactly the same. In a driving scene retrieval experiment, an average score of more than 3.21 is achieved for queries of driving scenes categorized as straight, curve, lane change, and traffic jam, when data from both road configuration and surroundings are employed.


Content-based retrieval Driving data Drive recorder Similarity measure Surrounding environment 



This work was partially supported by the Strategic Information and Communications R & D Promotion Programme (SCOPE) of the Ministry of Internal Affairs and Communications of Japan under No. 082006002, by Grant-in-Aid for Scientific Research (C) from the Japan Society for the Promotion of Science (JSPS) under No. 24500200, and by the Core Research of Evolutional Science and Technology (CREST) of the Japan Science and Technology Agency (JST).


  1. 1.
    S.Y. Cheng, S. Park, M.M. Trivedi, Multispectral and multi-perspective video arrays for driver body tracking and activity analysis. Comput. Vis. Image Understand. 106, 245–247 (2007)CrossRefGoogle Scholar
  2. 2.
    D. Mitrovic, Reliable method for driving events recognition. IEEE Trans. Intell. Transp. Syst. 6(2), 198–205 (2005)CrossRefGoogle Scholar
  3. 3.
    N. Oliver, A. Pentland, Graphical models for driver behavior recognition in a SmartCar, in Proceedings of the IEEE Intelligent Vehicles Symposium, pp. 7–12, 2000Google Scholar
  4. 4.
    M. Naito, A. Ozaki, C. Miyajima, N. Kitaoka, R. Terashima, K. Takeda, A browsing and retrieval system for driving data, in Proceedings of the IEEE Intelligent Vehicles Symposium, pp. 1159–1165, June 2010Google Scholar
  5. 5.
    J.Z. Wang, J. Li, G. Wiederhold, SIMPLIcity: semantics-sensitive integrated matching for picture libraries. IEEE Trans. Pattern Anal. Mach. Intell. 23(9), 947–963 (2001)CrossRefGoogle Scholar
  6. 6.
    N. Kaempchen, Feature-level fusion of laser scanner and video data scanner and video for advanced driver assistance systems, Ph.D. dissertation, University of Ulm, Germany, 2007Google Scholar
  7. 7.
    H. Rakha, B. Crowther, Comparison of Greenshields, pipes, and Van aerde car-following and traffic stream models. J. Transp. Res. Board 1802, 248–262 (2007)CrossRefGoogle Scholar
  8. 8.
    K. Takeda, J. Hansen, P. Boyraz, L. Malta, C. Miyajima, H. Abut, International large-scale vehicle corpora for research on driver behavior on the road. IEEE Trans. Intell. Transp. Syst. 12, 1609–1623 (2011)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Yiyang Li
    • 1
    Email author
  • Ryo Nakagawa
    • 1
  • Chiyomi Miyajima
    • 1
  • Norihide Kitaoka
    • 1
  • Kazuya Takeda
    • 1
  1. 1.Graduate School of Information ScienceNagoya UniversityNagoyaJapan

Personalised recommendations