Exploration of an unknown environment by a mobile robot

  • Rui Araújo
  • A. T. de Almeida
Part of the IFIP — The International Federation for Information Processing book series (IFIPAICT)


Mobile robots can make important contributions to the integration of industrial operations. The improvement of mobile robot autonomy will lead to many benefits which include a decrease in programming effort, simplifications on shop floor design, and the lowering of costs and time to market. Additionally this will free human resources which may be applied to the areas of product development. All those factors will ultimately contribute for enabling more agile and sustainable industrial production. In this article we demonstrate the validity of the parti-game self-learning approach for navigating a mobile robot, by finding a path to a goal region of an unknown environment. Initially, the robot has no map of the world, and has only the abilities of sensor-based obstacle detection and straight-line movement. Simulation results concerning the application of the learning approach to a mobile robot are presented.


Learning control path finding mobile robot 


  1. Arkin, R. C. (1990), Integrating Behavioral, Perceptual, and World Knowledge in Reactive Navigation, in P. Maes, ed., `Designing Autonomous Agents: Theory and Practice from Biology to Engineering and Back’, MIT Press, Cambridge, MA, pp. 105–122.Google Scholar
  2. Bellman, R. (1957), Dynamic Programming, Princeton University Press, Princeton, New Jersey.Google Scholar
  3. Beom, H. R. & Cho, H. S. (1995), `A Sensor-Based Navigation for a Mobile Robot Using Fuzzy Logic and Reinforcement Learning’, IEEE Trans. Sÿst. Man Cybern. 25(3), 464477.Google Scholar
  4. Brooks, R. A. (1986), `A Robust Layered Control System For a Mobile Robot’, IEEE Journal of Robotics and Automation 2 (1), 14–23.CrossRefGoogle Scholar
  5. Horowitz, E. & Sahni, S. (1978), Fundamentals of Computer Algorithms, Computer Science Press, Inc, Potomac, Maryland.Google Scholar
  6. Koenig, S. & Simmons, R. G. (1996), Unsupervised Learning of Probabilistic Models for Robot Navigation, in Proc. IEEE Int. Conf. on Robotics and Automation’, pp. 23012308.Google Scholar
  7. Michel, 0. (1996), Khepera Simulator Version 2.0 User Manual. Freeware Mobile Robot Simulator Written at the University of Nice - Sophia Antipolis by Olivier Michel. Downloadable from the World Wide Web at http: //wwwi3s.unice.fri-om/khep-sim.html.Google Scholar
  8. Mondada, F., Franzi, E. & Ienne, P. (1993), Mobile Robot Miniaturisation: A Tool for Investigation in Control Algorithms, in `Experimental Robotics III, Proc. 3rd Int. Symp. on Experimental Robotics, Kyoto, Japan’, Springer Verlag, London, 1994, pp. 501–513.CrossRefGoogle Scholar
  9. Moore, A. W. & Atkeson, C. G. (1995), `The Parti-game Algorithm for Variable Resolution Reinforcement Learning in Multidimensional State-spaces’, Machine Learning 21 (3), 199–233.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 1997

Authors and Affiliations

  • Rui Araújo
    • 1
  • A. T. de Almeida
    • 1
  1. 1.Institute for Systems and Robotics (ISR), and Electrical Engineering DepartmentUniversity of CoimbraCoimbraPortugal

Personalised recommendations