Duration Controllable Voice Conversion via Phoneme-Based Information Bottleneck
- Authors
- Lee, S.; Noh, H.; Nam, W.; Lee, S.
- Issue Date
- 2022
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Decoding; Generative adversarial networks; information bottleneck; Licenses; non-autoregressive model; Speech; Speech processing; Timbre; Training; voice conversion; voice style transfer
- Citation
- IEEE/ACM Transactions on Audio Speech and Language Processing, v.30, pp.1173 - 1183
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE/ACM Transactions on Audio Speech and Language Processing
- Volume
- 30
- Start Page
- 1173
- End Page
- 1183
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/140172
- DOI
- 10.1109/TASLP.2022.3156757
- ISSN
- 2329-9290
- Abstract
- Several voice conversion (VC) methods using a simple autoencoder with a carefully designed information bottleneck have recently been studied. In general, they extract content information from a given speech through the information bottleneck between the encoder and the decoder, providing it to the decoder along with the target speaker information to generate the converted speech. However, their performance is highly dependent on the downsampling factor of an information bottleneck. In addition, such frame-by-frame conversion methods cannot convert speaking styles associated with the length of utterance, such as the duration. In this paper, we propose a novel duration controllable voice conversion (DCVC) model, which can transfer the speaking style and control the speed of the converted speech through a phoneme-based information bottleneck. The proposed information bottleneck does not need to find an appropriate downsampling factor, achieving a better audio quality and VC performance. In our experiments, DCVC outperformed the baseline models with a 3.78 MOS and a 3.83 similarity score. It can also smoothly control the speech duration while achieving a 39.35x speedup compared with a Seq2seq-based VC in terms of the inference speed. Author
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Department of Artificial Intelligence > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.