Improving the robustness of model compression by on-manifold adversarial training
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kwon, J. | - |
dc.contributor.author | Lee, S. | - |
dc.date.accessioned | 2022-03-10T08:41:05Z | - |
dc.date.available | 2022-03-10T08:41:05Z | - |
dc.date.created | 2022-02-09 | - |
dc.date.issued | 2021 | - |
dc.identifier.issn | 1999-5903 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/138448 | - |
dc.description.abstract | Despite the advance in deep learning technology, assuring the robustness of deep neural networks (DNNs) is challenging and necessary in safety-critical environments, including automobiles, IoT devices in smart factories, and medical devices, to name a few. Furthermore, recent developments allow us to compress DNNs to reduce the size and computational requirements of DNNs to fit them into small embedded devices. However, how robust a compressed DNN can be has not been well studied in addressing its relationship to other critical factors, such as prediction performance and model sizes. In particular, existing studies on robust model compression have been focused on the robustness against off-manifold adversarial perturbation, which does not explain how a DNN will behave against perturbations that follow the same probability distribution as the training data. This aspect is relevant for on-device AI models, which are more likely to experience perturbations due to noise from the regular data observation environment compared with off-manifold perturbations provided by an external attacker. Therefore, this paper investigates the robustness of compressed deep neural networks, focusing on the relationship between the model sizes and the prediction performance on noisy perturbations. Our experiment shows that on-manifold adversarial training can be effective in building robust classifiers, especially when the model compression rate is high. © 2021 by the authors. Licensee MDPI, Basel, Switzerland. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | MDPI | - |
dc.title | Improving the robustness of model compression by on-manifold adversarial training | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lee, S. | - |
dc.identifier.doi | 10.3390/fi13120300 | - |
dc.identifier.scopusid | 2-s2.0-85120171616 | - |
dc.identifier.bibliographicCitation | Future Internet, v.13, no.12 | - |
dc.relation.isPartOf | Future Internet | - |
dc.citation.title | Future Internet | - |
dc.citation.volume | 13 | - |
dc.citation.number | 12 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scopus | - |
dc.subject.keywordAuthor | Adversarial robustness | - |
dc.subject.keywordAuthor | Model compression | - |
dc.subject.keywordAuthor | On-manifold perturbation | - |
dc.subject.keywordAuthor | Robust compression | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.