Photo-model-based stereo-vision 3D perception for marine creatures catching by ROV

Hongzhi Tian, Yejun Kou, Takuro Kawakami, Renya Takahashi, Mamoru Minami

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)


By incorporating visual information obtained from the installed vision sensor into the feedback loop, visual servoing enables the robot to be able to operate in a changing environment or an unknown environment. In the past, the authors have proposed a real-time monocular fish-catching robot. However, it is insufficient for new demands, especially fish-catching in 3D space. To overcome these problems, a binocular stereo-vision system with photo-model-based recognition method has been proposed for picking and placing clothes. Then, this previous research has been the base for extending the stereo-vision pick-and-place system to a three-dimensional (3D) object visual servoing system, which used the genetic algorithm (GA) of the fishing-catching robot. This paper verifies the visual servoing ability of the system for a moving 3D object through visual servoing experiment. In the experiment, marine creature toy floated on the water in the pool without pose constraints. It is confirmed from the experimental results that the proposed system can be used to capture a moving marine creature target and is not susceptible to partial occlusion conditions.

Original languageEnglish
Title of host publicationOCEANS 2019 MTS/IEEE Seattle, OCEANS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9780578576183
Publication statusPublished - Oct 2019
Event2019 OCEANS MTS/IEEE Seattle, OCEANS 2019 - Seattle, United States
Duration: Oct 27 2019Oct 31 2019

Publication series

NameOCEANS 2019 MTS/IEEE Seattle, OCEANS 2019


Conference2019 OCEANS MTS/IEEE Seattle, OCEANS 2019
Country/TerritoryUnited States


  • Photo-model-based recognition method
  • Pose estimation
  • Stereovision
  • Visual servoing

ASJC Scopus subject areas

  • Automotive Engineering
  • Ocean Engineering
  • Acoustics and Ultrasonics
  • Fluid Flow and Transfer Processes
  • Oceanography


Dive into the research topics of 'Photo-model-based stereo-vision 3D perception for marine creatures catching by ROV'. Together they form a unique fingerprint.

Cite this