Back to Search Start Over

Pseudo-siamese network image tampering localization model based on reinforced samples

Authors :
Jinwei WANG, Zihe ZHANG, Xiangyang LUO, Bin MA
Source :
网络与信息安全学报, Vol 10, Iss 1, Pp 33-47 (2024)
Publication Year :
2024
Publisher :
POSTS&TELECOM PRESS Co., LTD, 2024.

Abstract

With the continuous development of the internet, an increasing number of images have been tampered with on the network, accompanied by a growing range of techniques to cover up tampering traces.However, most current detection models neglect the impact of image post-processing on tamper detection algorithms, limiting their real-life applications.To address these issues, a general image tampering location model based on enhanced samples and the pseudo-twin network was proposed.The pseudo-twin network enabled the model to learn tampering features in real images.On one hand, by applying convolution constraints, the image content was suppressed, allowing the model to focus more on residual trace information of tampering.The two-branch structure of the network facilitated the comprehensive utilization of image feature information.By utilizing enhanced samples, the model could dynamically generate the most crucial pictures for learning tamper types, enabling targeted training of the model.This approach ensured that the model converged in all directions, ultimately obtaining the global optimal model.The idea of data enhancement was employed to automatically generate abundant tampered images and corresponding masks, effectively resolving the limited tampering dataset issue.Extensive experiments were conducted on four datasets, demonstrating the feasibility and effectiveness of the proposed model in pixel-level tamper detection.Particularly on the Columbia dataset, the algorithm achieves a 33.5% increase in F1 score and a 23.3% increase in MCC score.These results indicate that the proposed model harnesses the advantages of deep learning models and significantly improves the effectiveness of tamper location detection.

Details

Language :
English, Chinese
ISSN :
2096109x and 2096109X
Volume :
10
Issue :
1
Database :
Directory of Open Access Journals
Journal :
网络与信息安全学报
Publication Type :
Academic Journal
Accession number :
edsdoj.6a7d2abdabb4e1c8becfb8909ace09d
Document Type :
article
Full Text :
https://doi.org/10.11959/j.issn.2096-109x.2024010