Abstract
This paper describes ongoing work into a portable mobility aid, worn by the visually impaired. The system uses stereo vision and sonar sensors for obstacle avoidance and recognition of kerbs. Because the device is carried, the user is given freedom of movement over kerbs, stairs and rough ground, not traversable with a wheeled aid. Motion of the sensor due to the walking action is measured using a digital compass and inclinometer. This motion has been modelled and is tracked to allow compensation of sensor measurements. The vision obstacle detection method uses comparison of image feature disparity with a ground feature disparity function. The disparity function is continually updated by the walk-motion model and by scene ground-plane fitting. Kerb detection is achieved by identifying clusters of parallel lines using the Hough transform. Experimental results are presented from the vision and sonar parts of the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Y. Bar-Shalom and T.E. Fortmann. Tracking and data association. Academic Press, Boston, London, 1988.
C.C. Collins. On mobility aids for the blind. In D.H. Warren and E.R. Strelow, editors, Electronic Spatial Sensing for the Blind, pages 35–64. Martinus Nijhoff Publishers, 1985.
I.J. Cox. A review of statistical data association techniques for motion correspondence. International Journal of Computer Vision, 10(1):53–66, February 1993.
G. Dagnelie and R.W. Massof. Toward an artificial eye. IEEE Spectrum, pages 22–29, May 1996.
F. Ferrari, E. Grosso, G. Sandini, and M. Magrassi. A stereo vision system for real time obstacle avoidance in unknown environment. In Proceedings of IEEE International Workshop on Intelligent Robots and Systems IROS ’90, pages 703–708, 1990.
M.A. Fischler and R.C. Bolles. Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Commun. Assoc. Comp. Mach., 24:381–395, 1981.
L. Kay. An ultrasonic sensing probe as a mobility aid for the blind. Ultrasonics, 2:53–59, 1964.
P. Kovesi. Invariant measures of image features from phase information. PhD thesis, Dept of Psychology, University of Western Australia, 1996.
D. Lee. The movement of sensors carried on the trunk of a walking person. Oxford University, January 1996.
F. Li, J.M. Brady, I. Reid, and H. Hu. Parallel image processing for object tracking using disparity information. In Second Asian Conference on Computer Vision ACCV ’95, pages 762–766, Singapore, December 1995.
F. Li. Visual control of AGV obstacle avoidance. DPhil First Year Report, Department of Engineering Science, University of Oxford, 1994.
J.E.W. Mayhew, Y. Zheng, and S. Cornell. The adaptive control of a four-degrees-of-freedom stereo camera head. In H.B. Barlow, J.P. Frisby, A. Horridge, and M.A. Jeeves, editors, Natural and Artificial Low-level Seeing Systems, pages 63–74. The Royal Society, London, 1992.
N. Molton, S. Se, J.M. Brady, D. Lee, and P. Probert. A stereo vision-based aid for the visually impaired. Image and Vision Computing, 1997. to appear.
N. Molton. Egomotion recovery from stereo. DPhil First Year Report, Department of Engineering Science, University of Oxford, 1996.
H. Mori, S. Kotani, and N. Kiyohiro. A robotic travel aid ‘hitomi’. In Proceedings of IEEE International Workshop on Intelligent Robots and Systems IROS ’94, 1994.
S.B. Pollard, J.E.W. Mayhew, and J.P. Frisby. Implementation details of the pmf stereo algorithm. In J.E.W. Mayhew and J.P. Frisby, editors, 3D Model Recognition From Stereoscopic Cues, pages 33–39. MIT, 1991.
S.B. Pollard, J. Porrill, J.E.W. Mayhew, and J.P. Frisby. Disparity gradient, lips-chitz continuity, and computing binocular correspondences. In J.E.W. Mayhew and J.P. Frisby, editors, 3D Model Recognition From Stereoscopic Cues, pages 25–32. MIT, 1991.
N. Pressey. Mowat sensor. Focus, 3:35–39, 1977.
L. Russell. Travel path sounder. In Proceedings of the Rotterdam Mobility Research Conference, New York, 1965. American Foundation for the Blind.
S. Se and M. Brady. Vision-based detection of kerbs and steps. In Eighth British Machine Vision Conference BMVC ’97, pages 410–419, September 1997.
S. Se and M. Brady. Stereo vision-based obstacle detection for partially sighted people. In Third Asian Conference on Computer Vision ACCV ’98, January 1998. to appear.
S. Se. Visual aids for the blind. DPhil First Year Report, Department of Engineering Science, University of Oxford, 1996.
M. Sonka, V. Hlavac, and R. Boyle. Image Processing, Analysis and Machine Vision. Chapman and Hall Computing, 1993.
P.H.S. Torr. Motion Segmentation and Outlier Detection. PhD thesis, Dept of Engineering Science, University of Oxford, 1995.
Z. Zhang and O. Faugeras. 3D Dynamic Scene Analysis .Springer-Verlag, 1992.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag London Limited
About this paper
Cite this paper
Molton, N., Se, S., Lee, D., Probert, P., Brady, M. (1998). Robotic Sensing for the Guidance of the Visually Impaired. In: Zelinsky, A. (eds) Field and Service Robotics. Springer, London. https://doi.org/10.1007/978-1-4471-1273-0_35
Download citation
DOI: https://doi.org/10.1007/978-1-4471-1273-0_35
Publisher Name: Springer, London
Print ISBN: 978-1-4471-1275-4
Online ISBN: 978-1-4471-1273-0
eBook Packages: Springer Book Archive