Supervised Paragraph Vector: Distributed Representations of Words, Documents and Class Labels
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Eunjeong L. | - |
dc.contributor.author | Cho, Sungzoon | - |
dc.contributor.author | Kang, Pilsung | - |
dc.date.accessioned | 2021-09-01T22:46:46Z | - |
dc.date.available | 2021-09-01T22:46:46Z | - |
dc.date.created | 2021-06-19 | - |
dc.date.issued | 2019 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/68939 | - |
dc.description.abstract | While the traditional method of deriving representations for documents was bag-of-words, they suffered from high dimensionality and sparsity. Recently, many methods to obtain lower dimensional and densely distributed representations were proposed. Paragraph Vector is one of such algorithms, which extends the word2vec algorithm by considering the paragraph as an additional word. However, it generates a single representation for all tasks, while different tasks may require different representations. In this paper, we propose a Supervised Paragraph Vector, a task-specific variant of Paragraph Vector for situations where class labels exist. Essentially, Supervised Paragraph Vector uses class labels along with words and documents and obtains corresponding representations with respect to the particular classification task. In order to prove the benefits of the proposed algorithm, three performance criteria are used: interpretability, discriminative power, and computational efficiency. To test interpretability, we find words that are close and far to class vectors and demonstrate that such words are closely related to the corresponding class. We also use principal component analysis to visualize all words, documents, and class labels at the same time and show that our method effectively displays the related words and documents for each class label. To evaluate discriminative power and computational efficiency, we perform document classification on four commonly used datasets with various classifiers and achieve comparable classification accuracies to bag-of-words and Paragraph Vector. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.subject | CLASSIFICATION | - |
dc.title | Supervised Paragraph Vector: Distributed Representations of Words, Documents and Class Labels | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kang, Pilsung | - |
dc.identifier.doi | 10.1109/ACCESS.2019.2901933 | - |
dc.identifier.scopusid | 2-s2.0-85063262447 | - |
dc.identifier.wosid | 000461869900016 | - |
dc.identifier.bibliographicCitation | IEEE ACCESS, v.7, pp.29051 - 29064 | - |
dc.relation.isPartOf | IEEE ACCESS | - |
dc.citation.title | IEEE ACCESS | - |
dc.citation.volume | 7 | - |
dc.citation.startPage | 29051 | - |
dc.citation.endPage | 29064 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | CLASSIFICATION | - |
dc.subject.keywordAuthor | Class label | - |
dc.subject.keywordAuthor | distributed representations | - |
dc.subject.keywordAuthor | representation learning | - |
dc.subject.keywordAuthor | document embedding | - |
dc.subject.keywordAuthor | word embedding | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
145 Anam-ro, Seongbuk-gu, Seoul, 02841, Korea+82-2-3290-2963
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.