NAFSSR: Stereo Image Super-Resolution Using NAFNet

19 Apr 2022  ยท  Xiaojie Chu, Liangyu Chen, Wenqing Yu ยท

Stereo image super-resolution aims at enhancing the quality of super-resolution results by utilizing the complementary information provided by binocular systems. To obtain reasonable performance, most methods focus on finely designing modules, loss functions, and etc. to exploit information from another viewpoint. This has the side effect of increasing system complexity, making it difficult for researchers to evaluate new ideas and compare methods. This paper inherits a strong and simple image restoration model, NAFNet, for single-view feature extraction and extends it by adding cross attention modules to fuse features between views to adapt to binocular scenarios. The proposed baseline for stereo image super-resolution is noted as NAFSSR. Furthermore, training/testing strategies are proposed to fully exploit the performance of NAFSSR. Extensive experiments demonstrate the effectiveness of our method. In particular, NAFSSR outperforms the state-of-the-art methods on the KITTI 2012, KITTI 2015, Middlebury, and Flickr1024 datasets. With NAFSSR, we won 1st place in the NTIRE 2022 Stereo Image Super-resolution Challenge. Codes and models will be released at https://github.com/megvii-research/NAFNet.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Stereo Image Super-Resolution Flickr1024 - 2x upscaling NAFSSR-B PSNR 29.54 # 3
Stereo Image Super-Resolution Flickr1024 - 2x upscaling NAFSSR-L PSNR 29.68 # 2
Stereo Image Super-Resolution Flickr1024 - 4x upscaling NAFSSR-B PSNR 24.07 # 3
Stereo Image Super-Resolution Flickr1024 - 4x upscaling NAFSSR-L PSNR 24.17 # 2
Stereo Image Super-Resolution KITTI2012 - 2x upscaling NAFSSR-B PSNR 31.55 # 3
Stereo Image Super-Resolution KITTI2012 - 2x upscaling NAFSSR-L PSNR 31.60 # 2
Stereo Image Super-Resolution KITTI2012 - 4x upscaling NAFSSR-L PSNR 27.12 # 2
Stereo Image Super-Resolution KITTI2012 - 4x upscaling NAFSSR-B PSNR 27.08 # 3
Stereo Image Super-Resolution KITTI2015 - 2x upscaling NAFSSR-L PSNR 31.25 # 2
Stereo Image Super-Resolution KITTI2015 - 2x upscaling NAFSSR-B PSNR 31.22 # 3
Stereo Image Super-Resolution KITTI2015 - 4x upscaling NAFSSR-L PSNR 26.96 # 1
Stereo Image Super-Resolution KITTI2015 - 4x upscaling NAFSSR-B PSNR 26.91 # 2
Stereo Image Super-Resolution Middlebury - 2x upscaling NAFSSR-B PSNR 35.68 # 3
Stereo Image Super-Resolution Middlebury - 2x upscaling NAFSSR-L PSNR 35.88 # 2
Stereo Image Super-Resolution Middlebury - 4x upscaling NAFSSR-L PSNR 30.20 # 2
Stereo Image Super-Resolution Middlebury - 4x upscaling NAFSSR-B PSNR 30.04 # 3

Methods