Search-and-Attack: Temporally Sparse Adversarial Perturbations on Videos
- Authors
- Heo, Hwan; Ko, Dohwan; Lee, Jaewon; Hong, Youngjoon; Kim, Hyunwoo J.
- Issue Date
- 2021
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Perturbation methods; Search problems; Linear programming; Three-dimensional displays; Solid modeling; Neural networks; Convolution; Action recognition; video classification; adversarial attack; sparse adversarial attack; safe AI
- Citation
- IEEE ACCESS, v.9, pp.146938 - 146947
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 9
- Start Page
- 146938
- End Page
- 146947
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/138679
- DOI
- 10.1109/ACCESS.2021.3124050
- ISSN
- 2169-3536
- Abstract
- Modern neural networks are known to be vulnerable to adversarial attacks in various domains. Although most attack methods usually densely change the input values, recent works have shown that deep neural networks (DNNs) are also vulnerable to sparse perturbations. Spatially sparse attacks on images or frames of a video are proven effective but the temporally sparse perturbations on videos have been less explored. In this paper, we present a novel framework to generate a temporally sparse adversarial attack, called Search-and-Attack scheme, on videos. The Search-and-Attack scheme first retrieves the most vulnerable frames and then attacks only those frames. Since identifying the most vulnerable set of frames involves an expensive combinatorial optimization problem, we introduce alternative definitions or surrogate objective functions: Magnitude of the Gradients (MoG) and Frame-wise Robustness Intensity (FRI). Combining them with iterative search schemes, extensive experiments on three public benchmark datasets (UCF, HMDB, and Kinetics) show that the proposed method achieves comparable performance to state-of-the-art dense attack methods.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Department of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.