Mobile Robot Path Planning Based on Optimized Fuzzy Logic Controllers

  • L. CherrounEmail author
  • M. Boumehraz
  • A. Kouzou
Part of the Studies in Systems, Decision and Control book series (SSDC, volume 175)


The path planning task is defined as the process to compute the motion sequence allowing the robot to move from the start position to the final destination autonomously without human actions. The path planning is one of the popular tasks encountered by imprecision and uncertainties and it has been studied using fuzzy logic systems (FLS). The construction of a well performing fuzzy controller is not always easy. The problem of finding appropriate membership functions and fuzzy rules is a difficult task. However, the design of fuzzy rules is often reliant on heuristic experience and it lacks systematic methodology, therefore these rules might not be correct and consistent. The design can prove to be long and delicate due to the important number of parameters to determine, and can lead then to a solution with poor performance. To cope with this difficulty, many researchers have been working to find and apply learning algorithms for fuzzy controller design. These automatic methods enable to extract information when the knowledge is not available. The most popular approach to optimize fuzzy logic controllers may be a kind of supervised learning where the training data is available. However, in real applications, extraction of training data is not always easy and become impossible when the cost to obtain training data is expensive. For these problems, reinforcement learning (RL) is more suitable than supervised learning. A control strategy with a learning capacity can be carried out by using Q-learning for tuning fuzzy logic controllers; which the robot receives only a scalar signal likes a feedback. This information makes to adjust the robot behavior in order to improve their performances. The basic idea in Q-learning algorithm of RL is to maximize the received rewards after each interaction with the environment. In this chapter, Q-learning algorithm is used to optimize Takagi-Sugeno fuzzy logic controllers for autonomous path planning of a mobile robot. These optimized fuzzy controllers are used for the different robot tasks: goal seeking, obstacle avoidance and wall-following. The obtained results of this optimization method present significant improvements of the robot behaviors.


Mobile robot Behavior Fuzzy controller Optimization Q-learning Fuzzy Q-learning 


  1. Abadi, N. M., & Khooban, M. H. (2015). Design of optimal Mamdani-type fuzzy controller for nonholonomic wheeled mobile robots. Journal of King Saud University-Engineering Sciences, 27, 92–100.CrossRefGoogle Scholar
  2. Algabri, M., Mathkour, H., & Ramdane H. (2014a). Mobile robot navigation and obstacle-avoidance using ANFIS in unknown environment. International Journal of Computer Applications, 91, 36–41.CrossRefGoogle Scholar
  3. Algabri, M., Ramdane, H., Mathkour, H., Al-Mutib, K., & Alsulaiman, M. (2014b). Optimization of fuzzy logic controller using PSO for mobile robot navigation in an unknown environment. Applied Mechanics and Materials, 541, 1053–1061.CrossRefGoogle Scholar
  4. Algabri, M., Mathkour, H., Ramdane, H., & Alsulaiman, M. (2015). Comparative study of soft computing techniques for mobile robot navigation in an unknown environment. Computers in Human Behavior, 50, 42–56.CrossRefGoogle Scholar
  5. Al Yahmedi, A. S., & Fatmi, A. (2011). Fuzzy logic based navigation of mobile robots. In A. V. Topalov (Ed.), Recent advances in mobile robotics (pp. 287–310). Croatia: InTech. ISBN:978-953-307-909-7.Google Scholar
  6. Antonelli, G. C., & Fusco, S. G. (2007). A fuzzy logic based approach for mobile robot path tracking. IEEE Transactions on Systems, Man and Cybernetics: Systems and Humans, 15, 211–221.Google Scholar
  7. Bakdi, A., Hentouta, A., Boutamiab, H., Maoudja, A., Hachourb, O., & Bouzouiaa, B. (2016). Optimal path planning and execution for mobile robots using genetic algorithm and adaptive fuzzy-logic control. Robotics and Autonomous Systems, 73, 95–109.Google Scholar
  8. Begum, M., Mann, G. K., & Gosine, R. G. (2008). Integrated fuzzy logic and genetic algorithmic approach for simultaneous localization and mapping of mobile robots. Applied Soft Computing, 8, 150–165.CrossRefGoogle Scholar
  9. Berenji, H. R., & Khedkar, P. (1992). Learning and tuning fuzzy logic controllers through reinforcements. IEEE Transactions on Neural Network, 3, 724–740.CrossRefGoogle Scholar
  10. Borestein, J., & Koren, Y. (1989). Real-time obstacle avoidance for fast mobile robot. IEEE Transactions on Systems, Man, and Cybernetics, 19, 1179–1186.CrossRefGoogle Scholar
  11. Cherroun, L., & Boumehraz, M. (2013a). Fuzzy behavior based navigation approach for mobile robot in unknown environment. Journal of Electrical Engineering, 13, 284–291.Google Scholar
  12. Cherroun, L., & Boumehraz, M. (2013b). Fuzzy Logic and reinforcement learning based approaches for mobile robot navigation in unknown environment. Mediterranean Journal of Measurement and Control, 9, 109–117.Google Scholar
  13. Cuesta, F., & Ollero, A. (2005). Intelligent mobile robot navigation. Heidelberg: Springer.CrossRefGoogle Scholar
  14. Glorennec. P. Y., & Jouffle. L. (1997). Fuzzy Q-learning. In 6th IEEE International Conference on Fuzzy Systems, Barcelona (pp. 659–662).Google Scholar
  15. Hsu, C. C., Hou, R. Y., & Wang, W. Y. (2013). Path planning for mobile robots based on improved Ant Colony optimization. In IEEE International Conference on Systems, Man, and Cybernetics (SMC), Manchester (pp. 2777–2782).Google Scholar
  16. Jallouli, M., Rekik. C., Chtourou. M., & Derbel. N. (2010). Optimised fuzzy Logic controller for a mobile robot navigation. International Journal of Modelling, Identification and Control, 9, 400–408.CrossRefGoogle Scholar
  17. Joo, M., & Deng, C. (2005). Obstacle avoidance of a mobile robot using hybrid learning approach. IEEE Transactions on Industrial Electronics, 52, 898–905.CrossRefGoogle Scholar
  18. Jouffle, L. (1998). Fuzzy inference system learning by reinforcement methods. IEEE Transactions on Systems, Man, and Cybernetics-Part C, 28, 338–355.CrossRefGoogle Scholar
  19. Juang, C. F., & Hsu, C. H. (2009). Reinforcement ant optimized fuzzy controller for mobile-robot wall-following control. IEEE Transactions on Industrial Electronics, 56, 3931–3940.CrossRefGoogle Scholar
  20. Kaelbling, L. P., Littman, M. L., & Moore. A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237–285.CrossRefGoogle Scholar
  21. Khatib, O. (1986). Real-time obstacle avoidance for manipulators and mobile robots. International Journal of Robotics Research, 5, 90–98.CrossRefGoogle Scholar
  22. Latombe, J. C. (1991). Robot motion planning. Norwell: Kluwer.CrossRefGoogle Scholar
  23. Mihai, D., & Gheorghe, M. (2016). Neural networks based reinforcement learning for mobile robots obstacle avoidance. Expert Systems with Applications, 62, 104–115.CrossRefGoogle Scholar
  24. Nemra, A., & Rezine, H. (2008). Genetic reinforcement learning algorithms for on-line fuzzy inference system tuning, application to mobile robotic. In P. Pecherková, M. Flídr, & J. Duník (Eds.), Robotics, automation and control (pp. 228–256). Vienna: InTech. ISBN:978-953-7619-18-3.Google Scholar
  25. Passino, K. M., & Yurkovich, S. (1998). Fuzzy control. Menlo Park: Addison Wesley.zbMATHGoogle Scholar
  26. Pothal, J. K., & Parhi, D. R. (2015). Navigation of multiple mobile robots in a highly clutter terrains using adaptive neuro-fuzzy inference system. Robotics and Autonomous Systems, 72, 48–58.CrossRefGoogle Scholar
  27. Seraji, H., & Howard, A. (2002). Behavior-based robot navigation on challenging terrain: A fuzzy Logic approach. IEEE Transactions on Robotics and Automation, 18, 308–321.CrossRefGoogle Scholar
  28. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge: The MIT Press.Google Scholar
  29. Timothy, J. R. (2004). Fuzzy logic with engineering applications (2nd ed.). Hoboken: Wiley.zbMATHGoogle Scholar
  30. Vadakkepa, P., Miin, O. C., Peng, X., & Lee, T. H. (2004). Fuzzy behavior-based control of mobile robots. IEEE Transactions on Fuzzy Systems, 12, 559–564.CrossRefGoogle Scholar
  31. Wang, M., & Liu, J. N. K. (2008). Fuzzy logic based real-time robot navigation in unknown environment with dead ends. Robotics and Autonomous Systems, 56, 625–643.CrossRefGoogle Scholar
  32. Watkins, C., & Dayan, P. (1992). Q-Learning. Machine Learning, 8, 279–292.zbMATHGoogle Scholar
  33. Yang, S. X., Moallem, M., & Patel, R. V. (2005). A layered goal-oriented fuzzy motion planning strategy for mobile robot navigation. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 35, 1214–1224.CrossRefGoogle Scholar
  34. Zhao, R., Lee, D. H., & Hong, K. L. (2015). Mobile robot navigation using optimized fuzzy controller by genetic algorithm. International Journal of Fuzzy Logic and Intelligent Systems, 15, 12–19.CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Laboratory of Applied Automatic and Industrial Diagnostics (LAADI)University of DjelfaDjelfaAlgeria
  2. 2.LMSE LaboratoryUniversity of BiskraBiskraAlgeria

Personalised recommendations