Skip to main content

Modeling structured environments using robot vision

  • Structure from Motion
  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1035))

Abstract

In this paper, we review the various methods for robust autonomous mobile robot navigation and scene modeling in structured environments. The techniques vary with availibility of a priori knowledge of the environment and the number of sensors with which the robot is equipped. The methods may be broadly classified into three categories: model based approaches, landmark based methods, and methods using information provided by the robot trajectory and its integration with sensor information for navigation and estimation of three dimensional (3D) position in the environment. Also, we describe the mobile robot ROBO-TEX, an autonomous mobile robot constructed in our laboratory. A successful implementation for constructing computer aided design (CAD) models of a structured scene as imaged by a single wide angle lens CCD camera while navigating is considered and evaluated. Finally, we discuss another navigation system that uses a stereo pair of fish-eye lenses, and discuss the merits of such a system over some of the other implementations for navigation and modeling of the scene.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. T. Dean and R. P. Bonasso, “1992 AAAI robot exhibition and competition,” AI Magazine, vol. 14, pp. 35–48, Spring 1993.

    Google Scholar 

  2. I. J. Cox and G. T. Wilfong, Autonomous Robot Vehicles. New York: Springer-Verlag, 1990.

    Google Scholar 

  3. S. S. Iyengar and A. Elfes, Autonomous Mobile Robots. Los Alamitos, CA: IEEE Computer Society Press, 1991.

    Google Scholar 

  4. R. Chatila and J.-P. Laumond, “Position referencing and consistent world modeling for mobile robots,” in Proc. IEEE Int. Conf. Robotics and Automation, (St.Louis), pp. 138–145, March 1985.

    Google Scholar 

  5. J. L. Crowley, “Dynamic world modeling for an intelligent mobile robot using a rotating ultra-sonic ranging sensor,” in Proc. IEEE Int. Conf. Robotics and Automation, (St.Louis), pp. 128–135, 1985.

    Google Scholar 

  6. O. D. Faugeras and N. Ayache, “Building, registering and fusing noisy visual maps,” in Proc. First Int. Conf. Computer Vision, (London, UK), pp. 73–82, June 1987.

    Google Scholar 

  7. L. Matthies and S. A. Shafer, “Error modeling in stereo navigation,” IEEE Journal of Robotics and Automation, vol. RA-3, pp. 234–248, June 1987.

    Google Scholar 

  8. H. P. Moravec, Robot Rover Visual Navigation. Ann Arbor, MI: UMI Research Press, 1981.

    Google Scholar 

  9. T. Tsubouchi and S. Yuta, “Map assisted vision system of mobile robots for reckoning in a building environment,” in Proc. IEEE Int. Conf. Robotics and Automation, (Raleigh), pp. 1978–1984, March 1987.

    Google Scholar 

  10. H. P. Moravec, “The Stanford cart and cmu rover,” Proceedings of IEEE, vol. 71, no. 7, pp. 872–884, 1983.

    Google Scholar 

  11. H. P. Moravec, “Sensor fusion in certainty grids for mobile robots,” AI magazine, vol. 9, pp. 61–74, Summer 1988.

    Google Scholar 

  12. H. P. Moravec and D. W. Cho, “A bayesian method for certain grids,” in Proc. of AAAI Spring Symposium Series on Mobile Robot Navigation, (Satnford), April 1989.

    Google Scholar 

  13. R. Talluri and J. K. Aggarwal, “Autonomous navigation in cluttered outdoor environments using goemetric visibility constraints,” Proc. of the Intl. Conf. on Intelligent Autonomous Systems, vol. IAS-3, February 1993.

    Google Scholar 

  14. C. Thorpe, S. Shafer, and T. Kanade, “Vision and navigation for the Carnegie Mellon Navlab,” in Proc. Image Understanding Workshop, DARPA, (Palo Alto), pp. 143–152, February 1987.

    Google Scholar 

  15. C. Thorpe and T. Kanade, “Carnegie Mellon Navlab vision,” in Proc. Image Understanding Workshop, DARPA, (Palo Alto), pp. 273–282, May 1989.

    Google Scholar 

  16. L. Davis and T. R. Kunsher, “Vision-based navigation: A status report,” Proceedings of Image Understanding Workshop, pp. 153–169, February 1987.

    Google Scholar 

  17. D. M. Keirsey, D. W. Payton, and J. K. Rosenblatt, “Autonomous navigation in cross country terrain,” in Proc. Image Understanding Workshop, DARPA, (Cambridge), pp. 411–416, April 1988.

    Google Scholar 

  18. C. Fennema and A. R. Hanson, “Experiments in autonomous navigation,” in Proc. Tenth Int. Conf. on Pattern Recognition, (Atlantic City, New Jersey), pp. 24–31, June 1990.

    Google Scholar 

  19. E. Gat, M. G. Slack, R. J. Firby, and D. P. Miller, “Planning for execution monitoring on a planetory rover,” in Proc. IEEE International Conference on Robotics and Automation, pp. 20–25, 1990.

    Google Scholar 

  20. J. Y. Zheng, M. Barth, and S. Tsuji, “Autonomous landmark selection for route recognition by a mobile robot,” in Proc. IEEE International Conference on Robotics and Automation, pp. 2004–2009, 1991.

    Google Scholar 

  21. G. Giralt, R. Sobek, and R. Chatila, “A multi-level planning and navigation system for a mobile robot; a first approach to hilare,” in Proc. Sixth International Joint Conference on Artificial Intelligence, pp. 335–337, 1979.

    Google Scholar 

  22. J. Crowley, “Navigation of an intelligent mobile robot,” IEEE Journal of Robotics and Automation, vol. 31, no. 1, 1985.

    Google Scholar 

  23. A. Parodi, “Multi-goal real-time global path planning for an autonomous land vehicle using a high speed graph search processortion,” in Proc. of the IEEE Int. Conf. on Robotics and Automation, (St. Louis, Missouri), pp. 161–167, 1985.

    Google Scholar 

  24. A. Chattergy, “Some heuristics for the navigation of a robot,” Robotics Research, vol. 4, pp. 59–66, Spring 1985.

    Google Scholar 

  25. P. Belluta, G. Collini, A. Verri, and V. Torre, “3D visual information from vanishing points,” in Proc. IEEE Workshop on Interpretation of 3D Scenes, (Austin, Texas), pp. 41–49, November 1989.

    Google Scholar 

  26. P. Belluta, G. Collini, A. Verri, and V. Torre, “Navigation by tracking vanishing points,” in Working Notes of AAAI Robot Navigation Symposium, (Stanford University), pp. 6–10, March 1989.

    Google Scholar 

  27. P. Olivieri, M. Gatti, M. Straforini, and V. Torre, “A method for the 3D reconstruction of indoor scenes from monocular images,” in Proc. Second European Conf. on Computer Vision, (Santa Margherita Ligure, Italy), pp. 696–700, Springer-Verlag, May 1992.

    Google Scholar 

  28. M. Straforini, C. Coelho, M. Campani, and V. Torre, “The recovery and understanding of a line drawing from indoor scenes,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 14, pp. 298–303, February 1992.

    Google Scholar 

  29. J. L. Crowley, “World modeling and position estimation for a mobile robot using ultra-sonic ranging,” in Proc. of the IEEE Int. Conf. Robotics and Automation, (Scotsdale, Arizona), pp. 674–680, May 1989.

    Google Scholar 

  30. H. Ishiguro, M. Yamamoto, and S. Tsuji, “Omni-directional stereo,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 14, pp. 257–262, February 1992.

    Google Scholar 

  31. D. Kim and R. Nevatia, “Indoor navigation without a specific map,” in Proc. Int. Conf. Intelligent Autonomous Systems, (Pittsburgh, PA), pp. 268–277, February 1993.

    Google Scholar 

  32. A. R. de Saint Vincent, “A 3D perception system for the mobile robot hilare,” in Proc. of the IEEE Int. Conf. Robotics and Automation, (San Francisco), pp. 1105–1111, 1986.

    Google Scholar 

  33. N. Ayache and O. D. Faugeras, “Building a consistent 3D representation of a mobile robot environment by combining multiple stereo views,” in Proc. 10th International Joint Conference on Artificial Intelligence, IJCAI '87, pp. 808–810, 1987.

    Google Scholar 

  34. N. Ayache and O. D. Faugeras, “Maintaining representations of the environment of a mobile robot,” IEEE Trans. on Robotics and Automation, vol. 5, pp. 804–819, December 1989.

    Google Scholar 

  35. O. D. Faugeras, N. Ayache, and B. Faverjon, “Building visual maps by combining noisy stereo measurements,” in Proc. of the IEEE Int. Conf. Robotics and Automation, (San Francisco), pp. 1433–1438, 1986.

    Google Scholar 

  36. A. Kak, K. Andress, and C. Lopez-Abadia, “Mobile robot self-location with the PSEIKI system,” in Working Notes, AAAI Spring Symposium on Robot Navigation, (Cambridge), pp. 33–37, March 1989.

    Google Scholar 

  37. R. C. Smith and P. Cheeseman, “On the representation and estimation of spatial uncertainty,” Int. Journal of Rob. Res., vol. 5, no. 4, pp. 56–58, 1987.

    Google Scholar 

  38. A. Kosaka and A. C. Kak, “Fast vision-guided mobile robot navigation using model-based reasoning and prediction of uncertainties,” Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 56, pp. 271–329, November 1992.

    Google Scholar 

  39. T. Tsubouchi and S. Yuta, “Map assisted vision system of mobile robots for reckoning in a building environment,” in Proc. IEEE Int. Conf. Robotics and Automation, (Raleigh, North Carolina), pp. 1978–1984, March 1987.

    Google Scholar 

  40. C. Fennema, A. R. Hanson, and E. Riseman, “Towards autonomous mobile robot navigation,” in Proc. of the SPIE — International Society for Photographic and Industrial Engineering, pp. 219–231, 1990.

    Google Scholar 

  41. C. Connolly, “Geometer: Solid modelling and algebraic manipulation,” in Technical Report, (University of Massachusetts, Amherst), 1989.

    Google Scholar 

  42. C. Connolly and R. Weiss, “Geometer: Solid modelling and algebraic manipulation,” in Proc. of the Image Understanding Workshop, DARPA, (Palo Alto, CA), 1989.

    Google Scholar 

  43. H. Nasr and B. Bhanu, “Landmark recognition for autonomous mobile robots,” in Proc. IEEE Int. Conf. Robotics and Automation, pp. 1218–1223, 1988.

    Google Scholar 

  44. F. P. Angerson and L. S. Davis, “Visual position determination for autonomous vehicle navigation,” in Center for Automation Research, Tech Report, CAR-TR-100, November 1984.

    Google Scholar 

  45. B. C. Bloom, “Use of landmarks for mobile robot navigation,” in Proc. SPIE Vol. 579 Intelligent Robots and Computer Vision, pp. 351–355, 1985.

    Google Scholar 

  46. K. Sugihara, “Some location problems for robot navigation using a single camera,” Computer Vision, Graphics and Image Processing, vol. 42, pp. 112–129, April 1988.

    Google Scholar 

  47. J.-Y. Bouguet and P. Perona, “Visual navigation using a single camera,” in Proc. International Conference on Computer Vision, pp. 645–652, June 1995.

    Google Scholar 

  48. L. Matthies and A. Elfes, “Integration of sonar and stereo range data using a grid based representation,” in Proc. of the IEEE Int. Conf. Robotics and Automation, (Philadelphia), pp. 727–733, April 1988.

    Google Scholar 

  49. A. Elfes, “Sonar based real-world mapping and navigation,” IEEE Jour. of Robotics and Automation, vol. RA-3, pp. 249–265, June 1987.

    Google Scholar 

  50. X. Lebègue and J. K. Aggarwal, “A mobile robot for visual measurements in architectural applications,” in Proc. IAPR Workshop on Machine Vision Applications, (Tokyo, Japan), pp. 195–198, December 1992.

    Google Scholar 

  51. X. Lebègue and J. K. Aggarwal, “Robotex: An autonomous mobile robot for precise surveying,” in Proc. Int. Conf. Intelligent Autonomous Systems, (Pittsburgh, PA), pp. 460–469, February 1993.

    Google Scholar 

  52. X. Lebègue and J. K. Aggarwal, “Automatic creation of architectural CAD models,” in Proc. 2nd CAD-Based Vision Workshop, (Seven Springs, PA), February 1994.

    Google Scholar 

  53. X. Lebègue and J. K. Aggarwal, “Architectural CAD modeling using a mobile robot.” Submitted to IEEE Transactions on Robotics and Automation.

    Google Scholar 

  54. S. Shah and J. K. Aggarwal, “Autonomous mobile robot navigation using fish-eye lenses.” Submitted to Proc. Third International Computer Science Conference, December 1995.

    Google Scholar 

  55. S. Shah and J. K. Aggarwal, “A simple calibration procedure for fish-eye (high distortion) lens camera,” in Proc. of Int. Conf. on Robotics and Automation, (San Diego, California), pp. 3422–3427, 1994.

    Google Scholar 

  56. X. Lebègue and J. K. Aggarwal, “Detecting 3-D parallel lines for perceptual organization,” in Proc. Second European Conf. on Computer Vision, (Santa Margherita Ligure, Italy), pp. 720–724, Springer-Verlag, May 1992.

    Google Scholar 

  57. S. Shah and J. K. Aggarwal, “Depth estimation using stereo fish-eye lenses,” in Proc. of Int. Conf. on Image Processing, (Austin, Texas), pp. 740–744, 1995.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Stan Z. Li Dinesh P. Mital Eam Khwang Teoh Han Wang

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shah, S., Aggarwal, J.K. (1996). Modeling structured environments using robot vision. In: Li, S.Z., Mital, D.P., Teoh, E.K., Wang, H. (eds) Recent Developments in Computer Vision. ACCV 1995. Lecture Notes in Computer Science, vol 1035. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-60793-5_67

Download citation

  • DOI: https://doi.org/10.1007/3-540-60793-5_67

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-60793-9

  • Online ISBN: 978-3-540-49448-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics