HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Image Manipulation Detection by Multi-View Multi-Scale Supervision

Chen Xinru ; Dong Chengbo ; Ji Jiaqi ; Cao Juan ; Li Xirong

Image Manipulation Detection by Multi-View Multi-Scale Supervision

Abstract

The key challenge of image manipulation detection is how to learngeneralizable features that are sensitive to manipulations in novel data,whilst specific to prevent false alarms on authentic images. Current researchemphasizes the sensitivity, with the specificity overlooked. In this paper weaddress both aspects by multi-view feature learning and multi-scalesupervision. By exploiting noise distribution and boundary artifact surroundingtampered regions, the former aims to learn semantic-agnostic and thus moregeneralizable features. The latter allows us to learn from authentic imageswhich are nontrivial to be taken into account by current semantic segmentationnetwork based methods. Our thoughts are realized by a new network which we termMVSS-Net. Extensive experiments on five benchmark sets justify the viability ofMVSS-Net for both pixel-level and image-level manipulation detection.

Code Repositories

dong03/MVSS-Net
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
image-manipulation-detection-on-casia-v1MVSS-Net
AUC: .932
Balanced Accuracy: .528
image-manipulation-detection-on-cocoglideMVSS-Net
AUC: .654
Balanced Accuracy: .117
image-manipulation-detection-on-columbiaMVSS-Net
AUC: .984
Balanced Accuracy: .729
image-manipulation-detection-on-coverageMVSS-Net
AUC: .733
Balanced Accuracy: .514
image-manipulation-detection-on-dso-1MVSS-Net
AUC: .552
Balanced Accuracy: .358
image-manipulation-localization-on-casia-v1MVSS-Net
Average Pixel F1(Fixed threshold): .528
image-manipulation-localization-on-cocoglideMVSS-Net
Average Pixel F1(Fixed threshold): .486
image-manipulation-localization-on-columbiaMVSS-Net
Average Pixel F1(Fixed threshold): .729
image-manipulation-localization-on-coverageMVSS-Net
Average Pixel F1(Fixed threshold): .514
image-manipulation-localization-on-dso-1MVSS-Net
Average Pixel F1(Fixed threshold): .358

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp