Symmetric Parallax Attention for Stereo Image Super-Resolution

7 Nov 2020  ·  Yingqian Wang, Xinyi Ying, Longguang Wang, Jungang Yang, Wei An, Yulan Guo ·

Although recent years have witnessed the great advances in stereo image super-resolution (SR), the beneficial information provided by binocular systems has not been fully used. Since stereo images are highly symmetric under epipolar constraint, in this paper, we improve the performance of stereo image SR by exploiting symmetry cues in stereo image pairs. Specifically, we propose a symmetric bi-directional parallax attention module (biPAM) and an inline occlusion handling scheme to effectively interact cross-view information. Then, we design a Siamese network equipped with a biPAM to super-resolve both sides of views in a highly symmetric manner. Finally, we design several illuminance-robust losses to enhance stereo consistency. Experiments on four public datasets demonstrate the superior performance of our method. Source code is available at https://github.com/YingqianWang/iPASSR.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Stereo Image Super-Resolution Flickr1024 - 2x upscaling iPASSR PSNR 28.60 # 5
Stereo Image Super-Resolution Flickr1024 - 4x upscaling iPASSR PSNR 23.44 # 5
Stereo Image Super-Resolution KITTI2012 - 2x upscaling iPASSR PSNR 31.11 # 2
Stereo Image Super-Resolution KITTI2012 - 4x upscaling iPASSR PSNR 26.56 # 5
Stereo Image Super-Resolution KITTI2015 - 2x upscaling iPASSR PSNR 30.81 # 5
Stereo Image Super-Resolution KITTI2015 - 4x upscaling iPASSR PSNR 26.32 # 5
Stereo Image Super-Resolution Middlebury - 2x upscaling iPASSR PSNR 34.51 # 6
Stereo Image Super-Resolution Middlebury - 4x upscaling iPASSR PSNR 29.16 # 5

Methods