Learning to Estimate Distortion Information and Restore Underwater Image with a Two-Stage Framework Method Icon

Jianming Liu1,2,3, Congzheng Wang1,2,3,*, Chuncheng Feng1,2, Lei Liu1,2, Wanqi Gong1,2,
Zhibo Chen1,2, Libin Liao1,2,3, Chang Feng1,2,3,*
1National Key Laboratory of Optical Field Manipulation Science and Technology, Chinese Academy of Sciences, 2Institute of Optics and Electronics, Chinese Academy of Sciences, 3University of Chinese Academy of Sciences
Before Image
After Image
Before
After
Before Image 2
After Image 2
Before
After
Before Image 2
After Image 2
Before
After
The processing results of our mehtod (DR-Net) in Underwater Imaging.
The results of distortion information estimation of DE-Net, comparing with input images.

Abstract

This paper introduces a two-stage framework, the Distorted Underwater Image Restoration Network (DR-Net), to address the complex degradation of underwater images caused by turbulence, fluctuations, and optical properties of water. The first stage employs the Distortion Estimation Network (DE-Net), leveraging a fusion of Transformer and U-Net architectures, to estimate distortion information from degraded images and focuses on image distortion recovery. Subsequently, the Image Restoration Generative Adversarial Network (IR-GAN) in the second stage utilizes this estimated distortion information to deblur images and regenerate lost details. Qualitative and quantitative evaluations on both synthetic and real image datasets demonstrate the superior performance of DR-Net over traditional methods, showcasing its broader applicability and robustness. Our approach restores underwater images from a single frame, improving the retrieval of marine resources and enhancing seabed exploration capabilities.

Method

DR-Net Architecture

The two-stage architecture of our DR-Net: 1) distorted information estimation network (DE-Net): estimation of distortion/perturbation information from the degraded underwater images, and 2) underwater image restoration network based-GAN (IR-GAN): restoration of image details and reconstruction of potentially lost information.

Results

(a) Visual comparison with learning based method and our DR-Net on LiSet for underwater distorted image restoration.
(b) Visual comparison with the state-of-the-arts on synthetic and real captured datasets.

Downloads