Abstract
This chapter proposes a method for the integration of acoustic and optical data to enhance the perception of an underwater environment in teleoperation tasks. Off-shore applications are addressed, in which an underwater remotely operated vehicle is approaching an oil rig for inspection, maintenance and repairing tasks. A technique is presented which takes advantage of optical features to segment an acoustic three-dimensional (3-D) image. Cylindrical surfaces are than extracted from 3-D points, and complete cylinders are reconstructed. The final step is to present useful information to the human operator, by displaying the superposition of measured acoustic data and geometric primitives fitted to parts of it, i.e., an augmented reality view. Experimental results with real data are reported showing the effectiveness of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. H. Ballard and Brown C. M. Computer Vision. Prentice-Hall Inc., 1982.
P. Besl and N. McKay. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239–256, February 1992.
R. R. Brooks and S.S. Iyengar. Multi-Sensor Fusion. Prentice Hall, Upper Saddle River, USA, 1998.
J. B. Burns, A. R. Hanson, and E. M. Riseman. Extracting straight lines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(4):425–456, 1986.
J. F. Canny. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6):679–698, November 1986.
A. Fusiello, R. Giannitrapani, V. Isaia, and V. Murino. Virtual environment modeling by integrated optical and acoustic sensing. In Second International Conference on 3-D Digital Imaging and Modeling (3DIM99), pages 437–446, Ottawa, Canada, 4–8 October 1999. IEEE Computer Society Press.
A. Fusiello and V. Murino. Calibration of an optical/acoustic sensor. In 6th International Conference on Computer Graphics and Image Processing (GKPO2000), 2000. To appear.
R. Giannitrapani, A. Trucco, and V. Murino. Segmentation of underwater 3-D acoustical images for augmented and virtual reality applications. In Proceedings of the OCEANS’99 Conference, pages 459–465, Seattle (USA), September 1999. MTS/IEEE.
F. Goulette. Automatic CAD modeling of industrial pipes from range images. In International Conference on Recent Advances in 3-D Digital Imaging and Modeling, pages 229–233, May 1997.
B. Gunsel, A. K. Jain, and E. Panayirci. Reconstruction and boundary detection of range and intensity images using multiscale MRF representations. CVGIP: Image Understanding, 63(2):353–366, March 1996.
R. K. Hansen and P. A. Andersen. A 3-D underwater acoustic camera—properties and applications. In P. Tortoli and L. Masotti, editors, Acoustical Imaging, pages 607–611. Plenum Press, 1996.
M. Hebert, R. Hoffman, A. Johnson, and J. Osborn. Sensor based interior modeling. In American Nuclear Society 6th Topical Meeting on Robotics and Remote Systems (ANS ’95), pages 731–737, February 1995.
A. Johnson, P. Leger, R. Hoffman, M. Hebert, and J. Osborn. 3-D object modeling and recognition for telerobotic manipulation. In Proc. IEEE Intelligent Robots and Systems, volume 1, pages 103–110, August 1995.
D. Dion Jr. and D. Laurendeau. Generalized cylinders extraction in a range image. In International Conference on Recent Advances in 3-D Digital Imaging and Modeling, pages 141–147, May 1997.
D. G. Lowe. Fitting parameterized three-dimensional models to images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(5):441–450, May 1991.
R. C. Luo and M. G. Kay. Multisensor integration and fusion in intelligent systems. IEEE Transactions on Systems, Man and Cybernetics, 19(5):901–931, September-October 1989.
M. Maimone, L. Matthies, J. Osborn, E. Rollins, J. Teza, and S. Thayer. A photo-realistic 3-D mapping system for extreme nuclear environments: Chornobyl. In Proceedings of the 1998 IEEE/RS J International Conference on Intelligent Robotic Systems (IROS ’98). IEEE, 1998.
V. Murino, A. Trucco, and C. Regazzoni. A probabilistic approach to the coupled reconstruction and restoration of underwater acoustic images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(l):9–22, January 1998.
P. Perona and J. Malik. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(7):629–639, 1990.
L. Robert. Camera calibration without feature extraction. Computer Vision, Graphics, and Image Processing, 63(2):314–325, March 1996.
P. J. Rousseeuw and A. M. Leroy. Robust regression & outlier detection. Wiley, 1987.
G. Scott and H. Longuet-Higgins. An algorithm for associating the features of two images. In Proceedings of the Royal Society of London B, volume 244, pages 21–26, 1991.
C. Yu W. Lie and Y. Chen. Model-based recognition and positioning of polyhedra using intensity-guided range sensing and interpretation in 3-D space. Pattern Recognition, 23:983–997, 1990.
G. H. Zhang and A. Wallace. Physical modeling and combination of range and intensity edge data. CVGIP: Image Understanding, 58(2):191–220, September 1993.
Z. Zhang, R. Deriche, O. Faugeras, and Q.-T. Luong. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence, 78(l-2):87–119, 1995.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Murino, V., Fusiello, A. (2000). Augmented Reality by Integrating Multiple Sensory Modalities for Underwater Scene Understanding. In: Leonardis, A., Solina, F., Bajcsy, R. (eds) Confluence of Computer Vision and Computer Graphics. NATO Science Series, vol 84. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-4321-9_18
Download citation
DOI: https://doi.org/10.1007/978-94-011-4321-9_18
Publisher Name: Springer, Dordrecht
Print ISBN: 978-0-7923-6612-6
Online ISBN: 978-94-011-4321-9
eBook Packages: Springer Book Archive