Abstract
The path planning task is defined as the process to compute the motion sequence allowing the robot to move from the start position to the final destination autonomously without human actions. The path planning is one of the popular tasks encountered by imprecision and uncertainties and it has been studied using fuzzy logic systems (FLS). The construction of a well performing fuzzy controller is not always easy. The problem of finding appropriate membership functions and fuzzy rules is a difficult task. However, the design of fuzzy rules is often reliant on heuristic experience and it lacks systematic methodology, therefore these rules might not be correct and consistent. The design can prove to be long and delicate due to the important number of parameters to determine, and can lead then to a solution with poor performance. To cope with this difficulty, many researchers have been working to find and apply learning algorithms for fuzzy controller design. These automatic methods enable to extract information when the knowledge is not available. The most popular approach to optimize fuzzy logic controllers may be a kind of supervised learning where the training data is available. However, in real applications, extraction of training data is not always easy and become impossible when the cost to obtain training data is expensive. For these problems, reinforcement learning (RL) is more suitable than supervised learning. A control strategy with a learning capacity can be carried out by using Q-learning for tuning fuzzy logic controllers; which the robot receives only a scalar signal likes a feedback. This information makes to adjust the robot behavior in order to improve their performances. The basic idea in Q-learning algorithm of RL is to maximize the received rewards after each interaction with the environment. In this chapter, Q-learning algorithm is used to optimize Takagi-Sugeno fuzzy logic controllers for autonomous path planning of a mobile robot. These optimized fuzzy controllers are used for the different robot tasks: goal seeking, obstacle avoidance and wall-following. The obtained results of this optimization method present significant improvements of the robot behaviors.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abadi, N. M., & Khooban, M. H. (2015). Design of optimal Mamdani-type fuzzy controller for nonholonomic wheeled mobile robots. Journal of King Saud University-Engineering Sciences, 27, 92–100.
Algabri, M., Mathkour, H., & Ramdane H. (2014a). Mobile robot navigation and obstacle-avoidance using ANFIS in unknown environment. International Journal of Computer Applications, 91, 36–41.
Algabri, M., Ramdane, H., Mathkour, H., Al-Mutib, K., & Alsulaiman, M. (2014b). Optimization of fuzzy logic controller using PSO for mobile robot navigation in an unknown environment. Applied Mechanics and Materials, 541, 1053–1061.
Algabri, M., Mathkour, H., Ramdane, H., & Alsulaiman, M. (2015). Comparative study of soft computing techniques for mobile robot navigation in an unknown environment. Computers in Human Behavior, 50, 42–56.
Al Yahmedi, A. S., & Fatmi, A. (2011). Fuzzy logic based navigation of mobile robots. In A. V. Topalov (Ed.), Recent advances in mobile robotics (pp. 287–310). Croatia: InTech. ISBN:978-953-307-909-7.
Antonelli, G. C., & Fusco, S. G. (2007). A fuzzy logic based approach for mobile robot path tracking. IEEE Transactions on Systems, Man and Cybernetics: Systems and Humans, 15, 211–221.
Bakdi, A., Hentouta, A., Boutamiab, H., Maoudja, A., Hachourb, O., & Bouzouiaa, B. (2016). Optimal path planning and execution for mobile robots using genetic algorithm and adaptive fuzzy-logic control. Robotics and Autonomous Systems, 73, 95–109.
Begum, M., Mann, G. K., & Gosine, R. G. (2008). Integrated fuzzy logic and genetic algorithmic approach for simultaneous localization and mapping of mobile robots. Applied Soft Computing, 8, 150–165.
Berenji, H. R., & Khedkar, P. (1992). Learning and tuning fuzzy logic controllers through reinforcements. IEEE Transactions on Neural Network, 3, 724–740.
Borestein, J., & Koren, Y. (1989). Real-time obstacle avoidance for fast mobile robot. IEEE Transactions on Systems, Man, and Cybernetics, 19, 1179–1186.
Cherroun, L., & Boumehraz, M. (2013a). Fuzzy behavior based navigation approach for mobile robot in unknown environment. Journal of Electrical Engineering, 13, 284–291.
Cherroun, L., & Boumehraz, M. (2013b). Fuzzy Logic and reinforcement learning based approaches for mobile robot navigation in unknown environment. Mediterranean Journal of Measurement and Control, 9, 109–117.
Cuesta, F., & Ollero, A. (2005). Intelligent mobile robot navigation. Heidelberg: Springer.
Glorennec. P. Y., & Jouffle. L. (1997). Fuzzy Q-learning. In 6th IEEE International Conference on Fuzzy Systems, Barcelona (pp. 659–662).
Hsu, C. C., Hou, R. Y., & Wang, W. Y. (2013). Path planning for mobile robots based on improved Ant Colony optimization. In IEEE International Conference on Systems, Man, and Cybernetics (SMC), Manchester (pp. 2777–2782).
Jallouli, M., Rekik. C., Chtourou. M., & Derbel. N. (2010). Optimised fuzzy Logic controller for a mobile robot navigation. International Journal of Modelling, Identification and Control, 9, 400–408.
Joo, M., & Deng, C. (2005). Obstacle avoidance of a mobile robot using hybrid learning approach. IEEE Transactions on Industrial Electronics, 52, 898–905.
Jouffle, L. (1998). Fuzzy inference system learning by reinforcement methods. IEEE Transactions on Systems, Man, and Cybernetics-Part C, 28, 338–355.
Juang, C. F., & Hsu, C. H. (2009). Reinforcement ant optimized fuzzy controller for mobile-robot wall-following control. IEEE Transactions on Industrial Electronics, 56, 3931–3940.
Kaelbling, L. P., Littman, M. L., & Moore. A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237–285.
Khatib, O. (1986). Real-time obstacle avoidance for manipulators and mobile robots. International Journal of Robotics Research, 5, 90–98.
Latombe, J. C. (1991). Robot motion planning. Norwell: Kluwer.
Mihai, D., & Gheorghe, M. (2016). Neural networks based reinforcement learning for mobile robots obstacle avoidance. Expert Systems with Applications, 62, 104–115.
Nemra, A., & Rezine, H. (2008). Genetic reinforcement learning algorithms for on-line fuzzy inference system tuning, application to mobile robotic. In P. Pecherková, M. FlÃdr, & J. DunÃk (Eds.), Robotics, automation and control (pp. 228–256). Vienna: InTech. ISBN:978-953-7619-18-3.
Passino, K. M., & Yurkovich, S. (1998). Fuzzy control. Menlo Park: Addison Wesley.
Pothal, J. K., & Parhi, D. R. (2015). Navigation of multiple mobile robots in a highly clutter terrains using adaptive neuro-fuzzy inference system. Robotics and Autonomous Systems, 72, 48–58.
Seraji, H., & Howard, A. (2002). Behavior-based robot navigation on challenging terrain: A fuzzy Logic approach. IEEE Transactions on Robotics and Automation, 18, 308–321.
Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge: The MIT Press.
Timothy, J. R. (2004). Fuzzy logic with engineering applications (2nd ed.). Hoboken: Wiley.
Vadakkepa, P., Miin, O. C., Peng, X., & Lee, T. H. (2004). Fuzzy behavior-based control of mobile robots. IEEE Transactions on Fuzzy Systems, 12, 559–564.
Wang, M., & Liu, J. N. K. (2008). Fuzzy logic based real-time robot navigation in unknown environment with dead ends. Robotics and Autonomous Systems, 56, 625–643.
Watkins, C., & Dayan, P. (1992). Q-Learning. Machine Learning, 8, 279–292.
Yang, S. X., Moallem, M., & Patel, R. V. (2005). A layered goal-oriented fuzzy motion planning strategy for mobile robot navigation. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 35, 1214–1224.
Zhao, R., Lee, D. H., & Hong, K. L. (2015). Mobile robot navigation using optimized fuzzy controller by genetic algorithm. International Journal of Fuzzy Logic and Intelligent Systems, 15, 12–19.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Cherroun, L., Boumehraz, M., Kouzou, A. (2019). Mobile Robot Path Planning Based on Optimized Fuzzy Logic Controllers. In: Derbel, N., Ghommam, J., Zhu, Q. (eds) New Developments and Advances in Robot Control. Studies in Systems, Decision and Control, vol 175. Springer, Singapore. https://doi.org/10.1007/978-981-13-2212-9_12
Download citation
DOI: https://doi.org/10.1007/978-981-13-2212-9_12
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2211-2
Online ISBN: 978-981-13-2212-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)