DAP: A Dynamic Adversarial Patch for Evading Person Detectors

Abstract

Patch-based adversarial attacks were proven to compromise the robustness and reliability of computer vision systems. However their conspicuous and easily detectable nature challenge their practicality in real-world setting. To address this recent work has proposed using Generative Adversarial Networks (GANs) to generate naturalistic patches that may not attract human attention. However such approaches suffer from a limited latent space making it challenging to produce a patch that is efficient stealthy and robust to multiple real-world transformations. This paper introduces a novel approach that produces a Dynamic Adversarial Patch (DAP) designed to overcome these limitations. DAP maintains a naturalistic appearance while optimizing attack efficiency and robustness to real-world transformations. The approach involves redefining the optimization problem and introducing a novel objective function that incorporates a similarity metric to guide the patch's creation. Unlike GAN-based techniques the DAP directly modifies pixel values within the patch providing increased flexibility and adaptability to multiple transformations. Furthermore most clothing-based physical attacks assume static objects and ignore the possible transformations caused by non-rigid deformation due to changes in a person's pose. To address this limitation a `Creases Transformation' (CT) block is introduced enhancing the patch's resilience to a variety of real-world distortions. Experimental results demonstrate that the proposed approach outperforms state-of-the-art attacks achieving a success rate of up to 82.28% in the digital world when targeting the YOLOv7 detector and 65% in the physical world when targeting YOLOv3tiny detector deployed in edge-based smart cameras.

Cite

Text

Guesmi et al. "DAP: A Dynamic Adversarial Patch for Evading Person Detectors." Conference on Computer Vision and Pattern Recognition, 2024. doi:10.1109/CVPR52733.2024.02322

Markdown

[Guesmi et al. "DAP: A Dynamic Adversarial Patch for Evading Person Detectors." Conference on Computer Vision and Pattern Recognition, 2024.](https://mlanthology.org/cvpr/2024/guesmi2024cvpr-dap/) doi:10.1109/CVPR52733.2024.02322

BibTeX

@inproceedings{guesmi2024cvpr-dap,
  title     = {{DAP: A Dynamic Adversarial Patch for Evading Person Detectors}},
  author    = {Guesmi, Amira and Ding, Ruitian and Hanif, Muhammad Abdullah and Alouani, Ihsen and Shafique, Muhammad},
  booktitle = {Conference on Computer Vision and Pattern Recognition},
  year      = {2024},
  pages     = {24595-24604},
  doi       = {10.1109/CVPR52733.2024.02322},
  url       = {https://mlanthology.org/cvpr/2024/guesmi2024cvpr-dap/}
}