Sentence transition matrix: An efficient approach that preserves sentence semantics
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Jang, Myeongjun | - |
dc.contributor.author | Kang, Pilsung | - |
dc.date.accessioned | 2022-04-01T21:41:00Z | - |
dc.date.available | 2022-04-01T21:41:00Z | - |
dc.date.created | 2022-04-01 | - |
dc.date.issued | 2022-01 | - |
dc.identifier.issn | 0885-2308 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/139413 | - |
dc.description.abstract | Sentence embedding is an influential research topic in natural language processing (NLP). Generation of sentence vectors that reflect the intrinsic meaning of sentences is crucial for improving performance in various NLP tasks. Therefore, numerous supervised and unsupervised sentence-representation approaches have been proposed since the advent of the distributed representation of words. These approaches have been evaluated on semantic textual similarity (STS) tasks designed to measure the degree of semantic information preservation; neural network-based supervised embedding models typically deliver state-of-the-art performance. However, these models have limitations in that they have numerous learnable parameters and thus require large amounts of specific types of labeled training data. Pretrained language modelbased approaches, which have become a predominant trend in the NLP field, alleviate this issue to some extent; however, it is still necessary to collect sufficient labeled data for the fine-tuning process is still necessary. Herein, we propose an efficient approach that learns a transition matrix tuning a sentence embedding vector to capture the latent semantic meaning. Our proposed method has two practical advantages: (1) it can be applied to any sentence embedding method, and (2) it can deliver robust performance in STS tasks with only a few training examples. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | ACADEMIC PRESS LTD- ELSEVIER SCIENCE LTD | - |
dc.title | Sentence transition matrix: An efficient approach that preserves sentence semantics | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kang, Pilsung | - |
dc.identifier.doi | 10.1016/j.csl.2021.101266 | - |
dc.identifier.scopusid | 2-s2.0-85111056478 | - |
dc.identifier.wosid | 000761599000004 | - |
dc.identifier.bibliographicCitation | COMPUTER SPEECH AND LANGUAGE, v.71 | - |
dc.relation.isPartOf | COMPUTER SPEECH AND LANGUAGE | - |
dc.citation.title | COMPUTER SPEECH AND LANGUAGE | - |
dc.citation.volume | 71 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.subject.keywordAuthor | Sentence embedding | - |
dc.subject.keywordAuthor | Sentence semantics | - |
dc.subject.keywordAuthor | Transition matrix | - |
dc.subject.keywordAuthor | Paraphrase | - |
dc.subject.keywordAuthor | Natural language processing | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
145 Anam-ro, Seongbuk-gu, Seoul, 02841, Korea+82-2-3290-2963
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.