PQDynamicISP: Dynamically Controlled Image Signal Processor for Any Image Sensors Pursuing Perceptual Quality

15 Mar 2024  ·  Masakazu Yoshimura, Junji Otsuka, Takeshi Ohashi ·

Full DNN-based image signal processors (ISPs) have been actively studied and have achieved superior image quality compared to conventional ISPs. In contrast to this trend, we propose a lightweight ISP that consists of simple conventional ISP functions but achieves high image quality by increasing expressiveness. Specifically, instead of tuning the parameters of the ISP, we propose to control them dynamically for each environment and even locally. As a result, state-of-the-art accuracy is achieved on various datasets, including other tasks like tone mapping and image enhancement, even though ours is lighter than DNN-based ISPs. Additionally, our method can process different image sensors with a single ISP through dynamic control, whereas conventional methods require training for each sensor.

PDF Abstract

Datasets


Results from the Paper


Ranked #2 on Image Enhancement on MIT-Adobe 5k (PSNR on proRGB metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Image Enhancement MIT-Adobe 5k PQDynamicISP PSNR on proRGB 25.53 # 2
SSIM on proRGB 0.928 # 2

Methods


No methods listed for this paper. Add relevant methods here