Skip to main content

Machine Learning-Assisted Cognition of Driving Context and Avoidance of Road Obstacles

  • Conference paper
  • First Online:
Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018)

Abstract

In the vehicle of the future, an intelligent vehicle should be able to recognize the driving context so as it would be able to perform the necessary actions to continue the trip up to its intended destination. Moreover, such intelligent vehicle should also be able to detect and recognize road obstacles, as it is the failure to recognize an obstacle and avoid it that often lead to road accident, normally causing human fatalities. In this paper, knowledge engineering related to the cognitive processes of driving context detection, perception, decision and optimal action related to the driving context and avoiding road obstacles. Ontology and formal specifications are used to describe such mechanism. Different supervised learning algorithms are used for cognition of driving context and in recognizing and classifying obstacles. The avoidance of obstacles is implemented using reinforcement learning. The work is validated using driving simulator in the laboratory. This work is a contribution to the ongoing research in safe driving, and the application of machine learning leading to prevention of road accidents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. SafeStart. Top 10 Causes of Distracted Driving—and What They All Have in Common, 10 January 2019. https://safestart.com/news/top-10-causes-distracted-driving-and-what-they-all-have-common/

  2. WHO (World Health Organization). 10 Facts on Global Road Safety (2015). http://www.who.int/features/factfiles/roadsafety/en/

  3. European_Commission. SMARTCARS: Low cost Advanced Driver Assistance Systems (ADAS): A cost affordable solution for improved road safety, 12 July 2018. https://trimis.ec.europa.eu/project/low-cost-advanced-driver-assistance-systems-adas-cost-affordable-solution-improved-road

  4. Li, L., Wen, D., Zheng, N.-N., et al.: Cognitive cars: a new frontier for ADAS research. IEEE Trans. Intell. Transp. Syst. 13, 395–407 (2012)

    Article  Google Scholar 

  5. García, F., de la Escalera, A., Armingol, J.M.: Enhanced obstacle detection based on Data Fusion for ADAS applications. In: 16th IEEE International Conference on Intelligent Transportation Systems (ITSC) (2013)

    Google Scholar 

  6. Ithape, A.A.: Artificial intelligence and machine learning in ADAS. Presented at the Vector India Conference 2017, Pune, India (2017)

    Google Scholar 

  7. Saxena, A.: Machine Learning Algorithms in Autonomous Cars, 27 September 2017. http://visteon.bg/2017/03/02/machine-learning-algorithms-autonomous-cars/

  8. Hina, M.D., Guan, H., Deng, N., Ramdane-Cherif, A.: CASA: safe and green driving assistance system for real-time driving events. In: Bi, Y., Kapoor, S., Bhatia, R. (eds.) IntelliSys 2016. LNNS, vol. 15, pp. 987–1002. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-56994-9_67

    Chapter  Google Scholar 

  9. Hina, M.D., Guan, H., Deng, N., et al.: Secured data processing, notification and transmission for a human-vehicle interaction system. In: ITSC 2016, IEEE Intelligent Transportation Systems Conference, Rio de Janiero, Brazil (2016)

    Google Scholar 

  10. Hina, M.D., Thierry, C., Soukane, A., et al.: Ontological and machine learning approaches for managing driving context in intelligent transportation. In: KEOD 2017, 9th International Conference on Knowledge Engineering and Ontology Development Madeira, Portugal (2017)

    Google Scholar 

  11. Ortalda, A., Moujahid, A., Hina, M.D., et al.: Safe driving mechanism: detection, recognition and avoidance of road obstacles. In: KEOD 2018, 10th International Conference on Knowledge Engineering and Ontology Development, Seville, Spain (2018)

    Google Scholar 

  12. Game_Engine. Unity 3D (2016). https://unity3d.com/

  13. Protégé. Protégé: Open-source ontology editor (2016). http://protege.stanford.edu

  14. Louridas, P., Ebert, C.: Machine learning. IEEE Softw. 33, 110–115 (2016)

    Article  Google Scholar 

  15. Mitchell, T.: Machine Learning. McGraw Hill, New York (1997)

    MATH  Google Scholar 

  16. Tchankue, P., Wesson, J., Vogts, D.: Using machine learning to predict driving context whilst driving. Presented at the SAICSIT 2013, South African Institute for Computer Scientists and Information Technologists, East London, South Africa (2013)

    Google Scholar 

  17. Lv, Y., Duan, Y., Kang, W., et al.: Traffic flow prediction with big data: a deep learning approach. IEEE Trans. Intell. Transp. Syst. 16, 865–873 (2015)

    Google Scholar 

  18. Bengio, Y.: Learning Deep Architectures for AI. Université de Montréal, Montreal (2009)

    Book  Google Scholar 

  19. Witten, I., Frank, E., Hall, M., Mining, D.: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, Burlington (2011)

    Google Scholar 

  20. Niklas Donges: The Random Forest Algorithm (2018). https://towardsdatascience.com/the-random-forest-algorithm-d457d499ffcd

  21. Technopedia. Multilayer Perceptron (MLP) (2018). https://www.techopedia.com/definition/20879/multilayer-perceptron-mlp

  22. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction, 2nd edn. MIT Press, Cambridge (2017)

    MATH  Google Scholar 

  23. Pyo, J., Bang, J., Jeong, Y.: Front collision warning based on vehicle detection using CNN. In: 2016 International SoC Design Conference (ISOCC), Jeju, South Korea, pp. 163–164 (2016)

    Google Scholar 

  24. Coelingh, E., Eidehall, A., Bengtsson, M.: Collision warning with full auto brake and pedestrian detection-a practical example of automatic emergency braking. Presented at the 13th IEEE International Conference on Intelligent Transportation Systems (ITSC) (2010)

    Google Scholar 

  25. ResearchNews. Key Technologies for Preventing Crashes, vol. 2. Thatcham, Berkshire (2013)

    Google Scholar 

  26. Bevilacqua, A., Vaccari, S.: Real time detection of stopped vehicles in traffic scenes. In: IEEE International Conference on Advanced Video Signal Based Surveillance, London, UK, pp. 266–270 (2007)

    Google Scholar 

  27. Zeng, D., Xu, J., Xu, G.: Data fusion for traffic incident detection using D-S evidence theory with probabilistic SVMs. J. Comput. 3, 36–43 (2008)

    Article  Google Scholar 

  28. Wolcott, R.W., Eustice, R.: Probabilistic obstacle partitioning of monocular video for autonomous vehicles. Presented at the British Machine Vision Conference 2016 (2016)

    Google Scholar 

  29. Levi, D., Garnett, N., Fetaya, E., et al.: StixelNet: a deep convolutional network for obstacle detection and road segmentation. In: British Machine Vision Conference (2015)

    Google Scholar 

  30. Bertozzi, M., Bombini, L., Cerri, P., et al.: Obstacle detection and classification fusing radar and visio. Presented at the 2008 IEEE Intelligent Vehicles Symposium (2008)

    Google Scholar 

  31. Shinzato, P.Y., Wolf, D.F., Stiller, C.: Road terrain detection: avoiding common obstacle detection assumptions using sensor fusion. In: IEEE Intelligent Vehicles Symposium Proceedings, pp. 687–692 (2014)

    Google Scholar 

  32. Linzmeier, D., Skutek, M., Mekhaiel, M., et al.: A pedestrian detection system based on thermopile and radar sensor data fusion. In: 8th International Conference on Information Fusion (2005)

    Google Scholar 

  33. Wang, X., Xu, L., Sun, H., et al.: Bionic vision inspired on-road obstacle detection and tracking using radar and visual information. In: 17th IEEE International Conference on Intelligent Transportation Systems (ITSC) (2014)

    Google Scholar 

  34. Bazilinskyy, P., Heisterkamp, N., Luik, P., et al.: Eye movements while cycling in GTA V. In: Tools and Methods of Competitive Engineering (TMCE 2018), Las Palmas de Gran Canaria, Spain (2018)

    Google Scholar 

  35. Lan, J., Jiang, Y., Fan, G., et al.: Real-time automatic obstacle detection method for traffic surveillance in urban traffic. J. Sig. Process. Syst. 82, 357–371 (2016)

    Article  Google Scholar 

  36. Rummelhard, L., Nègre, A., Perrollaz, M., Laugier, C.: Probabilistic grid-based collision risk prediction for driving application. In: Hsieh, M.A., Khatib, O., Kumar, V. (eds.) Experimental Robotics. STAR, vol. 109, pp. 821–834. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-23778-7_54

    Chapter  Google Scholar 

  37. Lee, D., Yeo, H.: Real-time rear-end collision-warning system using a multilayer perceptron neural network. IEEE Trans. Intell. Transp. Syst. 17, 3087–3097 (2016)

    Article  Google Scholar 

  38. Iqbal, A., Busso, C., Gans, N.R.: Adjacent vehicle collision warning system using image sensor and inertial measurement unit. In: 2015 ACM Proceedings on International Conference on Multimodal Interaction, pp. 291–298 (2015)

    Google Scholar 

  39. Miorandi, D., Sicari, S., De Pellegrini, F., et al.: Internet of things: vision, applications and research challenges. Ad Hoc Netw. 10, 1497–1516 (2012)

    Article  Google Scholar 

  40. Tsai, C.-W., Lai, C.-F., Chiang, M.-C., et al.: Data mining for internet of things: a survey. IEEE Commun. Surv. Tutor. 16, 77–97 (2014)

    Article  Google Scholar 

  41. Brioschi, G., Hina, M.D., Soukane, A., et al.: Techniques for cognition of driving context for safe driving application. In: ICCI*CC 2016, 15th IEEE International Conference on Cognitive Informatics and Cognitive Computing Stanford, CA, USA (2016)

    Google Scholar 

  42. Bin, S., Yuan, L., Xiaoyi, W.: Research on data mining models for the internet of things. Presented at the International Conference on Image Analysis and Signal Processing (2010)

    Google Scholar 

  43. Kelly III, J.E.: Computing, cognition and the future of knowing: how humans and machines are forging a new age of understanding (2015)

    Google Scholar 

  44. Haas, S., Weisner, K., Stone, T.C.: Car ride classification for drive context recognition. Presented at the Mobility 2014, 4th International Conference on Mobile Services, Resources and Users, Paris, France (2014)

    Google Scholar 

  45. Mitrovic, D.: Reliable method for driving events recognition. IEEE Trans. Intell. Transp. Syst. 6, 198–205 (2005)

    Article  Google Scholar 

  46. Costa, D., Duarte, C.: Adapting multimodal fission to user’s abilities. In: Stephanidis, C. (ed.) UAHCI 2011. LNCS, vol. 6765, pp. 347–356. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21672-5_38

    Chapter  Google Scholar 

  47. Frédéric, L.: Physical, semantic and pragmatics levels for multimodal fusion and fission. In: 7th International Workshop on Computational Semantics, Tilburg, Netherlands (2007)

    Google Scholar 

  48. Adjali, O., Hina, M.D., Dourlens, S., et al.: Multimodal fusion, fission and virtual reality simulation for an ambient robotic intelligence. In: 6th International Conference on Ambient Systems, Networks and Technologies (ANT-2015), London, UK (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Manolo Dulva Hina .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hina, M.D., Ortalda, A., Soukane, A., Ramdane-Cherif, A. (2020). Machine Learning-Assisted Cognition of Driving Context and Avoidance of Road Obstacles. In: Fred, A., Salgado, A., Aveiro, D., Dietz, J., Bernardino, J., Filipe, J. (eds) Knowledge Discovery, Knowledge Engineering and Knowledge Management. IC3K 2018. Communications in Computer and Information Science, vol 1222. Springer, Cham. https://doi.org/10.1007/978-3-030-49559-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49559-6_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49558-9

  • Online ISBN: 978-3-030-49559-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics