Feedback Network for Image Super-Resolution

Recent advances in image super-resolution (SR) explored the power of deep learning to achieve a better reconstruction performance. However, the feedback mechanism, which commonly exists in human visual system, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution feedback network (SRFBN) to refine low-level representations with high-level information. Specifically, we use hidden states in an RNN with constraints to achieve such feedback manner. A feedback block is designed to handle the feedback connections and to generate powerful high-level representations. The proposed SRFBN comes with a strong early reconstruction ability and can create the final high-resolution image step by step. In addition, we introduce a curriculum learning strategy to make the network well suitable for more complicated tasks, where the low-resolution images are corrupted by multiple types of degradation. Extensive experimental results demonstrate the superiority of the proposed SRFBN in comparison with the state-of-the-art methods. Code is avaliable at https://github.com/Paper99/SRFBN_CVPR19.

PDF Abstract CVPR 2019 PDF CVPR 2019 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Super-Resolution BSD100 - 2x upscaling SRFBN PSNR 32.29 # 13
Image Super-Resolution BSD100 - 3x upscaling SRFBN PSNR 29.24 # 10
Image Super-Resolution BSD100 - 4x upscaling SRFBN PSNR 27.72 # 19
SSIM 0.7409 # 24
Image Super-Resolution FFHQ 1024 x 1024 - 4x upscaling SRFBN FID 17.14 # 4
MS-SSIM 0.931 # 6
PSNR 27.90 # 5
SSIM 0.822 # 5
Image Super-Resolution FFHQ 256 x 256 - 4x upscaling SRFBN FID 132.59 # 5
MS-SSIM 0.895 # 7
PSNR 21.96 # 8
SSIM 0.693 # 7
Image Super-Resolution FFHQ 512 x 512 - 4x upscaling SRFBN PSNR 29.577 # 4
SSIM 0.827 # 3
MS-SSIM 0.953 # 4
LLE 2.066 # 2
FED 0.0984 # 4
FID 20.032 # 6
LPIPS 0.2406 # 5
NIQE 13.901 # 7
Image Super-Resolution Manga109 - 2x upscaling SRFBN PSNR 39.08 # 11
Image Super-Resolution Manga109 - 3x upscaling SRFBN PSNR 34.18 # 8
Image Super-Resolution Manga109 - 4x upscaling SRFBN PSNR 31.15 # 25
SSIM 0.9160 # 24
Image Super-Resolution Set14 - 2x upscaling SRFBN PSNR 33.82 # 12
Image Super-Resolution Set14 - 3x upscaling SRFBN PSNR 30.1 # 13
Image Super-Resolution Set14 - 4x upscaling SRFBN PSNR 28.81 # 29
SSIM 0.7868 # 32
Image Super-Resolution Set5 - 2x upscaling SRFBN PSNR 38.11 # 14
Image Super-Resolution Set5 - 3x upscaling SRFBN PSNR 34.70 # 11
Image Super-Resolution Urban100 - 2x upscaling SRFBN PSNR 32.62 # 14
Image Super-Resolution Urban100 - 3x upscaling SRFBN PSNR 28.73 # 12
Image Super-Resolution Urban100 - 4x upscaling SRFBN PSNR 26.6 # 25
SSIM 0.8015 # 22

Methods


No methods listed for this paper. Add relevant methods here