Prototypical Knowledge Distillation for Noise Robust Keyword Spotting
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Donghyeon | - |
dc.contributor.author | Kim, Gwantae | - |
dc.contributor.author | Lee, Bokyeung | - |
dc.contributor.author | Ko, Hanseok | - |
dc.date.accessioned | 2022-12-11T22:40:54Z | - |
dc.date.available | 2022-12-11T22:40:54Z | - |
dc.date.created | 2022-12-08 | - |
dc.date.issued | 2022 | - |
dc.identifier.issn | 1070-9908 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/147104 | - |
dc.description.abstract | Keyword Spotting (KWS) is an essential component in contemporary audio-based deep learning systems and should be of minimal design when the system is working in streaming and on-device environments. We presented a robust feature extraction with a single-layer dynamic convolution model in our previous work. In this letter, we expand our earlier study into multi-layers of operation and propose a robust Knowledge Distillation (KD) learning method. Based on the distribution between class-centroids and embedding vectors, we compute three distinct distance metrics for the KD training and feature extraction processes. The results indicate that our KD method shows similar KWS performance over state-of-the-art models in terms of KWS but with low computational costs. Furthermore, our proposed method results in a more robust performance in noisy environments than conventional KD methods. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.title | Prototypical Knowledge Distillation for Noise Robust Keyword Spotting | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Ko, Hanseok | - |
dc.identifier.doi | 10.1109/LSP.2022.3219358 | - |
dc.identifier.scopusid | 2-s2.0-85141651637 | - |
dc.identifier.wosid | 000886854900008 | - |
dc.identifier.bibliographicCitation | IEEE SIGNAL PROCESSING LETTERS, v.29, pp.2298 - 2302 | - |
dc.relation.isPartOf | IEEE SIGNAL PROCESSING LETTERS | - |
dc.citation.title | IEEE SIGNAL PROCESSING LETTERS | - |
dc.citation.volume | 29 | - |
dc.citation.startPage | 2298 | - |
dc.citation.endPage | 2302 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordAuthor | Keyword spotting | - |
dc.subject.keywordAuthor | knowledge distillation | - |
dc.subject.keywordAuthor | prototypical learning. features trained the | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
145 Anam-ro, Seongbuk-gu, Seoul, 02841, Korea+82-2-3290-2963
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.