HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Robust Image Forgery Detection Over Online Social Network Shared Images

{Jun Liu Jinyu Tian Jiantao Zhou Haiwei Wu}

Robust Image Forgery Detection Over Online Social Network Shared Images

Abstract

The increasing abuse of image editing softwares, such as Photoshop and Meitu, causes the authenticity of digital images questionable. Meanwhile, the widespread availability of online social networks (OSNs) makes them the dominant channels for transmitting forged images to report fake news, propagate rumors, etc. Unfortunately, various lossy operations adopted by OSNs, e.g., compression and resizing, impose great challenges for implementing the robust image forgery detection. To fight against the OSN-shared forgeries, in this work, a novel robust training scheme is proposed. We first conduct a thorough analysis of the noise introduced by OSNs, and decouple it into two parts, i.e., predictable noise and unseen noise, which are modelled separately. The former simulates the noise introduced by the disclosed (known) operations of OSNs, while the latter is designed to not only complete the previous one, but also take into account the defects of the detector itself. We then incorporate the modelled noise into a robust training framework, significantly improving the robustness of the image forgery detector. Extensive experimental results are presented to validate the superiority of the proposed scheme compared with several state-of-the-art competitors. Finally, to promote the future development of the image forgery detection, we build a public forgeries dataset based on four existing datasets and three most popular OSNs. The designed detector recently won the top ranking in a certificate forgery detection competition. The source code and dataset are available at https://github.com/HighwayWu/ImageForensicsOSN.

Benchmarks

BenchmarkMethodologyMetrics
image-manipulation-detection-on-casia-osnWu22
AUC: 0.862
F-score: 0.462
Intersection over Union: 0.417
image-manipulation-detection-on-casia-osn-1Wu22
AUC: 0.833
Intersection over Union: 0.405
f-Score: 0.358
image-manipulation-detection-on-casia-osn-2Wu22
AUC: 0.866
Intersection over Union: 0.431
f-Score: 0.478
image-manipulation-detection-on-casia-osn-3Wu22
AUC: 0.858
Intersection over Union: 0.421
f-Score: 0.466
image-manipulation-detection-on-columbia-osnWu22
AUC: 0.883
Intersection over Union: 0.611
f-Score: 0.714
image-manipulation-detection-on-columbia-osn-1Wu22
AUC: 0.883
Intersection over Union: 0.631
f-Score: 0.727
image-manipulation-detection-on-columbia-osn-2Wu22
AUC: 0.889
Intersection over Union: 0.628
f-Score: 0.727
image-manipulation-detection-on-columbia-osn-3Wu22
AUC: 0.883
Intersection over Union: 0.626
f-Score: 0.724
image-manipulation-detection-on-dso-osnWu22
AUC: 0.859
Intersection over Union: 0.320
f-Score: 0.447
image-manipulation-detection-on-dso-osn-1Wu22
AUC: 0.823
Intersection over Union: 0.252
f-Score: 0.366
image-manipulation-detection-on-dso-osn-2Wu22
AUC: 0.839
Intersection over Union: 0.233
f-Score: 0.341
image-manipulation-detection-on-dso-osn-3Wu22
AUC: 0.808
Intersection over Union: 0.253
f-Score: 0.370
image-manipulation-detection-on-nist-osnWu22
AUC: 0.783
Intersection over Union: 0.253
f-Score: 0.329
image-manipulation-detection-on-nist-osn-1Wu22
AUC: 0.764
Intersection over Union: 0.214
f-Score: 0.286
image-manipulation-detection-on-nist-osn-2Wu22
AUC: 0.785
Intersection over Union: 0.239
f-Score: 0.313
image-manipulation-detection-on-nist-osn-3Wu22
AUC: 0.780
Intersection over Union: 0.219
f-Score: 0.294

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp