Journal of Mechanical Science and Technology

, Volume 32, Issue 11, pp 5541–5550 | Cite as

3D reconstruction of underwater scene for marine bioprospecting using remotely operated underwater vehicle (ROV)

  • Youngeun Song
  • Suengjoon Choi
  • Changjoo Shin
  • Youngil Shin
  • Kiyong Cho
  • Hoeryong JungEmail author


Marine bioprospecting is the procedure of identifying the characteristics of marine organisms to develop them into commercial products. This paper proposes a 3D reconstruction algorithm to facilitate 3D visualization of underwater scene for the marine bioprospecting using remotely operated underwater vehicle (ROV). It allows to provide an operator with intuitive user interface and accordingly contribute to enhance the operability of the ROV in the bioprospecting operation. The reconstruction algorithm transforms 2D pixel coordinates of the sonar image into the corresponding 3D spatial coordinates of the scene surface by restoring the surface elevation missing in the sonar image. First, the algorithm segments the objects and shadows in the image by classifying the pixels based on the intensity value of the seafloor. Second, it computes the surface elevation on the object pixels based on their intensity values. Third, the elevation correction factor, which is derived by the ratio between height of the object and the length of the shadow, is multiplied to the surface elevation value. Finally, the 3D coordinates of the scene surfaces are reconstructed using the coordinate transformation from the image plane to the seafloor with the restored surface elevation values. The experimental results show the algorithm successfully reconstructs the surface of the reference object within an error range less than 10 % of the object dimension, and practical applicability to the marine bioprospecting operation.


Marine bioprospecting Multi-beam imaging sonar Remotely operated underwater vehicle Underwater scene reconstruction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    P. Bhatia and A. Chugh, Role of marine bioprospecting contracts in developing access and benefit sharing mechanism for marine traditional knowledge holders in the pharmaceutical industry, Global Ecology and Conservation, 3 (2015) 176–187.CrossRefGoogle Scholar
  2. [2]
    D. K. Leary, Bioprospecting and the genetic resources of hydrothermal vents on the high seas: what is the existing legal position, where are we heading and what are our options?, Journal of International and Comparative Environmental Law, 1 (2) (2004) 137–141.Google Scholar
  3. [3]
    R. J. Smolowitz, S. H. Patel, H. L. Haas and S. A. Miller, Using a remotely operated vehicle (ROV) to observe loggerhead sea turtle (Caretta caretta) behavior on foraging grounds off the mid–Atlantic United States, Journal of Experimental Marine Biology and Ecology, 471 (2015) 84–91.CrossRefGoogle Scholar
  4. [4]
    E. Spanier, J. S. Cobb and M. Clancy, Impacts of remotely operated vehicles (ROVs) on the behavior of marine animals: an example using American lobsters, Marine Ecology Progress Series, 104 (3) (1994) 257–266.CrossRefGoogle Scholar
  5. [5]
    C. Katlein, M. Nicolaus, M. Hoppmann, F. Wenzhofer and B. Rabe, Advancing interdisciplinary sea ice research with a new under–ice remotely operated vehicle and autonomous observatories, Proc. of Cordon Conference on Polar Marine Science, Ventura, CA, USA (2017).Google Scholar
  6. [6]
    D. Khojastech and R. Kamali, Design and dynamic study of a ROV with application to oil and gas industries of Persian Gulf, Ocean Engineering, 136 (2017) 18–30.CrossRefGoogle Scholar
  7. [7]
    J. Teague, M. J. Allen and T. B. Scott, The potential of lowcost ROV for use in deep–sea mineral, ore prospecting and monitoring, Ocean Engineering, 147 (2018) 333–339.CrossRefGoogle Scholar
  8. [8]
    T. Parenteau, P. Espinasse, A. Benbia and B. Ngim, Subsea mining field development concept using a subsea crushing and feeding unit, Proc. of Offshore Technology Conference, Huston, Texas, USA (2013) OTC–23953–MS.Google Scholar
  9. [9]
    C. Beall, B. J. Lawrence, V. Ila and F. Dellaert, 3D reconstruction of underwater structures, Proc. of International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan (2010) 4418–4423.Google Scholar
  10. [10]
    V. Brandou, A. G. Allais, M. Perrier, E. Malis, P. Rives, J. Sarrazin and P. M. Sarradin, 3D reconstruction of natural underwater scenes using the stereovision system IRIS, Proc. of OCEANS’07–Europe, Aberdeen, UK (2007) 1–6.Google Scholar
  11. [11]
    O. Pizarro, R. Eustice and H. Singh, Large area 3D recon–structions from underwater surveys, Proc. of OCEANS'04, Kobe, Japan (2004) 678–687.Google Scholar
  12. [12]
    S. Negahdaripour and A. Sarafraz, Improved stereo matching in scattering media by incorporating a backscatter cue, IEEE Transactions on Image Processing, 23 (12) (2014) 5743–5755.MathSciNetCrossRefzbMATHGoogle Scholar
  13. [13]
    M. M. Campos and G. O. Codina, Underwater laser–based structured light system for one–shot 3D reconstruction, Proc. of IEEE SENSORS, Valencia, Spain (2014) 1138–1141.Google Scholar
  14. [14]
    E. Coiras, Y. Petillot and D. M. Lane, Multiresolution 3D reconstruction from side–scan sonar images, IEEE Transactions on Image Processing, 16 (2) (2007) 382–390.MathSciNetCrossRefGoogle Scholar
  15. [15]
    R. K. Hansen and P. A. Andersen, A 3D underwater acoustic camera properties and applications, Acoustical Imaging, 22 (1996) 607–611.CrossRefGoogle Scholar
  16. [16]
    R. K. Hansen and P. A. Andersen, 3D acoustic camera for underwater imaging, Acoustical Imaging, 20 (1993) 723–727.CrossRefGoogle Scholar
  17. [17]
    M. D. Aykin and S. Negahdaripour, Forward–look 2D sonar image formation and 3D reconstruction, Proc. of 2013 Oceans–San Diego, San Diego, CA, USA (2013) 1–10.Google Scholar
  18. [18]
    J. B. Hsieh, J. I. Olsonbaker and W. L. Fox, A screening application for image data collected by an acoustic lens sonar, Tech report, DTIC Document (2005).Google Scholar
  19. [19]
    K. Bikonis, A. Stepnowski and M. Moszynski, Computer vision techniques applied for reconstruction of seafloor 3D images from side scan and synthetic aperture sonars data, The Journal of the Acoustical Society of America, 123 (5) (2008) 3748.CrossRefGoogle Scholar
  20. [20]
    W. S. Burdic, Underwater acoustic system analysis, Second Ed., Prentice Hall, New Jersey, USA (1991).Google Scholar

Copyright information

© The Korean Society of Mechanical Engineers and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  • Youngeun Song
    • 1
  • Suengjoon Choi
    • 2
  • Changjoo Shin
    • 3
  • Youngil Shin
    • 2
  • Kiyong Cho
    • 2
  • Hoeryong Jung
    • 4
    Email author
  1. 1.Department of Mechanical EngineeringHoseo UniversityCheonanKorea
  2. 2.Korea Construction Equipment Technology InstituteGunsanKorea
  3. 3.Korea Institute of Ocean Science and TechnologyBusanKorea
  4. 4.Department of Mechanical EngineeringKonkuk UniversitySeoulKorea

Personalised recommendations