Deep Image Composition Meets Image Forgery

  • 2024-04-03 18:54:37
  • Eren Tahir, Mert Bal
  • 0

Abstract

Image forgery is a topic that has been studied for many years. Before thebreakthrough of deep learning, forged images were detected using handcraftedfeatures that did not require training. These traditional methods failed toperform satisfactorily even on datasets much worse in quality than real-lifeimage manipulations. Advances in deep learning have impacted image forgerydetection as much as they have impacted other areas of computer vision and haveimproved the state of the art. Deep learning models require large amounts oflabeled data for training. In the case of image forgery, labeled data at thepixel level is a very important factor for the models to learn. None of theexisting datasets have sufficient size, realism and pixel-level labeling at thesame time. This is due to the high cost of producing and labeling qualityimages. It can take hours for an image editing expert to manipulate just oneimage. To bridge this gap, we automate data generation using image compositiontechniques that are very related to image forgery. Unlike other automated datageneration frameworks, we use state of the art image composition deep learningmodels to generate spliced images close to the quality of real-lifemanipulations. Finally, we test the generated dataset on the SOTA imagemanipulation detection model and show that its prediction performance is lowercompared to existing datasets, i.e. we produce realistic images that are moredifficult to detect. Dataset will be available athttps://github.com/99eren99/DIS25k .

 

Quick Read (beta)

loading the full paper ...