A pre-trained BERT for Korean medical natural language processing
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Yoojoong | - |
dc.contributor.author | Kim, Jong-Ho | - |
dc.contributor.author | Lee, Jeong Moon | - |
dc.contributor.author | Jang, Moon Joung | - |
dc.contributor.author | Yum, Yun Jin | - |
dc.contributor.author | Kim, Seongtae | - |
dc.contributor.author | Shin, Unsub | - |
dc.contributor.author | Kim, Young-Min | - |
dc.contributor.author | Joo, Hyung Joon | - |
dc.contributor.author | Song, Sanghoun | - |
dc.date.accessioned | 2022-09-23T18:40:35Z | - |
dc.date.available | 2022-09-23T18:40:35Z | - |
dc.date.created | 2022-09-23 | - |
dc.date.issued | 2022-08-16 | - |
dc.identifier.issn | 2045-2322 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/143778 | - |
dc.description.abstract | With advances in deep learning and natural language processing (NLP), the analysis of medical texts is becoming increasingly important. Nonetheless, despite the importance of processing medical texts, no research on Korean medical-specific language models has been conducted. The Korean medical text is highly difficult to analyze because of the agglutinative characteristics of the language, as well as the complex terminologies in the medical domain. To solve this problem, we collected a Korean medical corpus and used it to train the language models. In this paper, we present a Korean medical language model based on deep learning NLP. The model was trained using the pre-training framework of BERT for the medical context based on a state-of-the-art Korean language model. The pre-trained model showed increased accuracies of 0.147 and 0.148 for the masked language model with next sentence prediction. In the intrinsic evaluation, the next sentence prediction accuracy improved by 0.258, which is a remarkable enhancement. In addition, the extrinsic evaluation of Korean medical semantic textual similarity data showed a 0.046 increase in the Pearson correlation, and the evaluation for the Korean medical named entity recognition showed a 0.053 increase in the F1-score. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | NATURE PORTFOLIO | - |
dc.title | A pre-trained BERT for Korean medical natural language processing | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Song, Sanghoun | - |
dc.identifier.doi | 10.1038/s41598-022-17806-8 | - |
dc.identifier.scopusid | 2-s2.0-85135987936 | - |
dc.identifier.wosid | 000841397200059 | - |
dc.identifier.bibliographicCitation | SCIENTIFIC REPORTS, v.12, no.1 | - |
dc.relation.isPartOf | SCIENTIFIC REPORTS | - |
dc.citation.title | SCIENTIFIC REPORTS | - |
dc.citation.volume | 12 | - |
dc.citation.number | 1 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | Y | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Science & Technology - Other Topics | - |
dc.relation.journalWebOfScienceCategory | Multidisciplinary Sciences | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.