A novel density-based clustering method using word embedding features for dialogue intention recognition
- Authors
- Jang, Jungsun; Lee, Yeonsoo; Lee, Seolhwa; Shin, Dongwon; Kim, Dongjun; Rim, Haechang
- Issue Date
- 12월-2016
- Publisher
- SPRINGER
- Keywords
- Dialogue Act; Emotion recognition; Density-based clustering; Word embedding
- Citation
- CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, v.19, no.4, pp.2315 - 2326
- Indexed
- SCIE
SCOPUS
- Journal Title
- CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS
- Volume
- 19
- Number
- 4
- Start Page
- 2315
- End Page
- 2326
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/86645
- DOI
- 10.1007/s10586-016-0649-7
- ISSN
- 1386-7857
- Abstract
- In dialogue systems, understanding user utterances is crucial for providing appropriate responses. Various classification models have been proposed to deal with natural language understanding tasks related to user intention analysis, such as dialogue acts or emotion recognition. However, models that use original lexical features without any modifications encounter the problem of data sparseness, and constructing sufficient training data to overcome this problem is labor-intensive, time-consuming, and expensive. To address this issue, word embedding models that can learn lexical synonyms using vast raw corpora have recently been proposed. However, the analysis of embedding features is not yet sufficient to validate the efficiency of such models. Specifically, using the cosine similarity score as a feature in the embedding space neglects the skewed nature of the word frequency distribution, which can affect the improvement of model performance. This paper describes a novel density-based clustering method that efficiently integrates word embedding vectors into dialogue intention recognition. Experimental results show that our proposed model helps overcome the data sparseness problem seen in previous classification models and can assist in improving the classification performance.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Informatics > Department of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.