An Optical Image Transmission System for Deep Sea Creature Sampling Missions Using Autonomous Underwater Vehicle

The exploration of oceans using autonomous underwater vehicles (AUVs) is necessary for activities, such as the sustainable management of fishery resources, extraction of seafloor minerals and energy resources, and inspection of underwater infrastructure. As the next step in ocean exploration, AUVs are expected to employ end-effectors to make physical contact with seafloor creatures and materials. We propose a scenario for realizing a sampling mission using an AUV that is equipped to sample marine life. In this scenario, the sampling AUV observes the seafloor while concurrently transmitting the observed images to a surface vessel for inspection by the AUV operators. If the received images show an object of interest, the object is selected as a candidate of sampling target by the operators, who send a sampling command to the AUV. After receiving the command, the AUV returns to the target area and attempts to sample it. In this paper, we propose a system for transmitting images of the seafloor as part of the sampling-mission scenario. The proposed image transmission system includes a process for enhancing images of the deep seafloor, a process for selecting interesting images, and processes for compressing and reconstructing images. The image enhancement process resolves imaging problems resulting from light attenuation, such as color attenuation and uneven illumination. The process for selecting interesting images selects those that contain interesting objects, such as marine life. The selection process prevents the transmission of meaningless images that contain only flat sand on the seafloor. The proposed image compression method, which is based on color depth compression, reduces the amount of data. The combined process of selecting an interesting image and compressing it reduces various problems in acoustic communication, such as low information density and data loss. Instead of an overall image, part of an overall image is transmitted by a set of data packet, and each received data packet is reconstructed onboard the vessel. Because of image compression, the colors of a reconstructed image differ from those of an enhanced image. However, the reconstructed image contains similar colors, and the structural similarity index was found to be 91.4% by evaluating images that were subjected to a 4-b color compression. The proposed image transmission system was tested in the Sea of Okhotsk, and these tests were performed four times in different sea areas (minimum depth 380 m, maximum depth 590 m). The results show that the size of the data for a single image was reduced by a factor of 18 using the proposed image compression process, with each image taking 3.7 s to be transmitted via an acoustic modem (20 kb/s). Of the automatically selected images, 63% contained marine life, and the total transmission success rate was 22%.