Image Manipulation Detection by Multi-View Multi-Scale Supervision

ICCV 2021  ·  Xinru Chen, Chengbo Dong, Jiaqi Ji, Juan Cao, Xirong Li ·

The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the sensitivity, with the specificity overlooked. In this paper we address both aspects by multi-view feature learning and multi-scale supervision. By exploiting noise distribution and boundary artifact surrounding tampered regions, the former aims to learn semantic-agnostic and thus more generalizable features. The latter allows us to learn from authentic images which are nontrivial to be taken into account by current semantic segmentation network based methods. Our thoughts are realized by a new network which we term MVSS-Net. Extensive experiments on five benchmark sets justify the viability of MVSS-Net for both pixel-level and image-level manipulation detection.

PDF Abstract ICCV 2021 PDF ICCV 2021 Abstract

Datasets


Introduced in the Paper:

Casia V1+

Used in the Paper:

MS COCO COVERAGE
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Manipulation Localization Casia V1+ MVSS-Net Average Pixel F1(Fixed threshold) .528 # 5
Image Manipulation Detection Casia V1+ MVSS-Net AUC .932 # 2
Balanced Accuracy .528 # 5
Image Manipulation Detection CocoGlide MVSS-Net AUC .654 # 6
Balanced Accuracy .117 # 8
Image Manipulation Localization CocoGlide MVSS-Net Average Pixel F1(Fixed threshold) .486 # 5
Image Manipulation Localization Columbia MVSS-Net Average Pixel F1(Fixed threshold) .729 # 6
Image Manipulation Detection Columbia MVSS-Net AUC .984 # 3
Balanced Accuracy .729 # 5
Image Manipulation Detection COVERAGE MVSS-Net AUC .733 # 5
Balanced Accuracy .514 # 5
Image Manipulation Localization COVERAGE MVSS-Net Average Pixel F1(Fixed threshold) .514 # 4
Image Manipulation Detection DSO-1 MVSS-Net AUC .552 # 8
Balanced Accuracy .358 # 6
Image Manipulation Localization DSO-1 MVSS-Net Average Pixel F1(Fixed threshold) .358 # 6

Methods


No methods listed for this paper. Add relevant methods here