Hide and Seek: How Does Watermarking Impact Face Recognition?

  • 2024-04-29 18:27:08
  • Yuguang Yao, Steven Grosz, Sijia Liu, Anil Jain
  • 0

Abstract

The recent progress in generative models has revolutionized the synthesis ofhighly realistic images, including face images. This technological developmenthas undoubtedly helped face recognition, such as training data augmentation forhigher recognition accuracy and data privacy. However, it has also introducednovel challenges concerning the responsible use and proper attribution ofcomputer generated images. We investigate the impact of digital watermarking, atechnique for embedding ownership signatures into images, on the effectivenessof face recognition models. We propose a comprehensive pipeline that integratesface image generation, watermarking, and face recognition to systematicallyexamine this question. The proposed watermarking scheme, based on anencoder-decoder architecture, successfully embeds and recovers signatures fromboth real and synthetic face images while preserving their visual fidelity.Through extensive experiments, we unveil that while watermarking enables robustimage attribution, it results in a slight decline in face recognition accuracy,particularly evident for face images with challenging poses and expressions.Additionally, we find that directly training face recognition models onwatermarked images offers only a limited alleviation of this performancedecline. Our findings underscore the intricate trade off between watermarkingand face recognition accuracy. This work represents a pivotal step towards theresponsible utilization of generative models in face recognition and serves toinitiate discussions regarding the broader implications of watermarking inbiometrics.

 

Quick Read (beta)

loading the full paper ...