Validation of Text Data Preprocessing Using a Neural Network Model
- Authors
- Woo, HoSung; Kim, JaMee; Lee, WonGyu
- Issue Date
- 14-5월-2020
- Publisher
- HINDAWI LTD
- Citation
- MATHEMATICAL PROBLEMS IN ENGINEERING, v.2020
- Indexed
- SCIE
SCOPUS
- Journal Title
- MATHEMATICAL PROBLEMS IN ENGINEERING
- Volume
- 2020
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/55704
- DOI
- 10.1155/2020/1958149
- ISSN
- 1024-123X
- Abstract
- Many artificial intelligence studies focus on designing new neural network models or optimizing hyperparameters to improve model accuracy. To develop a reliable model, appropriate data are required, and data preprocessing is an essential part of acquiring the data. Although various studies regard data preprocessing as part of the data exploration process, those studies lack awareness about the need for separate technologies and solutions for preprocessing. Therefore, this study evaluated combinations of preprocessing types in a text-processing neural network model. Better performance was observed when two preprocessing types were used than when three or more preprocessing types were used for data purification. More specifically, using lemmatization and punctuation splitting together, lemmatization and lowering together, and lowering and punctuation splitting together showed positive effects on accuracy. This study is significant because the results allow better decisions to be made about the selection of the preprocessing types in various research fields, including neural network research.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School of Education > Computer Science Education > 1. Journal Articles
- Graduate School > Department of Computer Science and Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.