Variational Reward Estimator Bottleneck: Towards Robust Reward Estimator for Multidomain Task-Oriented Dialogue
- Authors
- Park, Jeiyoon; Lee, Chanhee; Park, Chanjun; Kim, Kuekyeng; Lim, Heuiseok
- Issue Date
- 7월-2021
- Publisher
- MDPI
- Keywords
- dialogue policy; inverse reinforcement learning; reinforcement learning; task-oriented dialogue
- Citation
- APPLIED SCIENCES-BASEL, v.11, no.14
- Indexed
- SCIE
SCOPUS
- Journal Title
- APPLIED SCIENCES-BASEL
- Volume
- 11
- Number
- 14
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/137179
- DOI
- 10.3390/app11146624
- ISSN
- 2076-3417
- Abstract
- Despite its significant effectiveness in adversarial training approaches to multidomain task-oriented dialogue systems, adversarial inverse reinforcement learning of the dialogue policy frequently fails to balance the performance of the reward estimator and policy generator. During the optimization process, the reward estimator frequently overwhelms the policy generator, resulting in excessively uninformative gradients. We propose the variational reward estimator bottleneck (VRB), which is a novel and effective regularization strategy that aims to constrain unproductive information flows between inputs and the reward estimator. The VRB focuses on capturing discriminative features by exploiting information bottleneck on mutual information. Quantitative analysis on a multidomain task-oriented dialogue dataset demonstrates that the VRB significantly outperforms previous studies.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Department of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.