HST: Hierarchical Swin Transformer for Compressed Image Super-resolution

21 Aug 2022  ·  Bingchen Li, Xin Li, Yiting Lu, Sen Liu, Ruoyu Feng, Zhibo Chen ·

Compressed Image Super-resolution has achieved great attention in recent years, where images are degraded with compression artifacts and low-resolution artifacts. Since the complex hybrid distortions, it is hard to restore the distorted image with the simple cooperation of super-resolution and compression artifacts removing. In this paper, we take a step forward to propose the Hierarchical Swin Transformer (HST) network to restore the low-resolution compressed image, which jointly captures the hierarchical feature representations and enhances each-scale representation with Swin transformer, respectively. Moreover, we find that the pretraining with Super-resolution (SR) task is vital in compressed image super-resolution. To explore the effects of different SR pretraining, we take the commonly-used SR tasks (e.g., bicubic and different real super-resolution simulations) as our pretraining tasks, and reveal that SR plays an irreplaceable role in the compressed image super-resolution. With the cooperation of HST and pre-training, our HST achieves the fifth place in AIM 2022 challenge on the low-quality compressed image super-resolution track, with the PSNR of 23.51dB. Extensive experiments and ablation studies have validated the effectiveness of our proposed methods. The code and models are available at https://github.com/USTC-IMCL/HST-for-Compressed-Image-SR.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Compressed Image Super-resolution BSD100-q10-x4 HST* PSNR 22.2 # 1
Compressed Image Super-resolution BSD100-q20-x4 HST* PSNR 23.13 # 1
Compressed Image Super-resolution BSD100-q30-x4 HST* PSNR 23.59 # 1
Compressed Image Super-resolution BSD100-q40-x4 HST* PSNR 23.89 # 1
Compressed Image Super-resolution DIV2K-q10-x4 HST* PSNR 23.65 # 1
Compressed Image Super-resolution DIV2K-q20-x4 HST* PSNR 24.8 # 1
Compressed Image Super-resolution DIV2K-q30-x4 HST* PSNR 25.41 # 1
Compressed Image Super-resolution DIV2K-q40-x4 HST* PSNR 25.78 # 1
Compressed Image Super-resolution Manga109-q10-x4 HST* PSNR 20.94 # 1
Compressed Image Super-resolution Manga109-q20-x4 HST* PSNR 22.48 # 1
Compressed Image Super-resolution Manga109-q30-x4 HST* PSNR 23.39 # 1
Compressed Image Super-resolution Manga-q40-x4 HST* PSNR 23.94 # 1
Compressed Image Super-resolution Set14-q10-x4 HST* PSNR 21.86 # 1
Compressed Image Super-resolution Set14-q20-x4 HST* PSNR 22.95 # 1
Compressed Image Super-resolution Set14-q30-x4 HST* PSNR 23.52 # 1
Compressed Image Super-resolution Set14-q40-x4 HST* PSNR 23.87 # 1
Compressed Image Super-resolution Set5-q10-x4 HST* PSNR 22.51 # 1
Compressed Image Super-resolution Set5-q20-x4 HST* PSNR 23.96 # 1
Compressed Image Super-resolution Set5-q30-x4 HST* PSNR 24.94 # 1
Compressed Image Super-resolution Set5-q40-x4 HST* PSNR 25.43 # 1
Compressed Image Super-resolution Urban100-q10-x4 HST* PSNR 20.43 # 1
Compressed Image Super-resolution Urban100-q20-x4 HST* PSNR 21.38 # 1
Compressed Image Super-resolution Urban100-q30-x4 HST* PSNR 21.96 # 1
Compressed Image Super-resolution Urban100-q40-x4 HST* PSNR 22.29 # 1

Methods