Document clustering method using dimension reduction and support vector clustering to overcome sparseness
- Authors
- Jun, Sunghae; Park, Sang-Sung; Jang, Dong-Sik
- Issue Date
- 1-6월-2014
- Publisher
- PERGAMON-ELSEVIER SCIENCE LTD
- Keywords
- Document clustering; Sparseness problem; Patent clustering; Dimension reduction; K-means clustering based on support vector clustering; Silhouette measure
- Citation
- EXPERT SYSTEMS WITH APPLICATIONS, v.41, no.7, pp.3204 - 3212
- Indexed
- SCIE
SCOPUS
- Journal Title
- EXPERT SYSTEMS WITH APPLICATIONS
- Volume
- 41
- Number
- 7
- Start Page
- 3204
- End Page
- 3212
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/98265
- DOI
- 10.1016/j.eswa.2013.11.018
- ISSN
- 0957-4174
- Abstract
- Many studies on developing technologies have been published as articles, papers, or patents. We use and analyze these documents to find scientific and technological trends. In this paper, we consider document clustering as a method of document data analysis. In general, we have trouble analyzing documents directly because document data are not suitable for statistical and machine learning methods of analysis. Therefore, we have to transform document data into structured data for analytical purposes. For this process, we use text mining techniques. The structured data are very sparse, and hence, it is difficult to analyze them. This study proposes a new method to overcome the sparsity problem of document clustering. We build a combined clustering method using dimension reduction and K-means clustering based on support vector clustering and Silhouette measure. In particular, we attempt to overcome the sparseness in patent document clustering. To verify the efficacy of our work, we first conduct an experiment using news data from the machine learning repository of the University of California at Irvine. Second, using patent documents retrieved from the United States Patent and Trademark Office, we carry out patent clustering for technology forecasting. (C) 2013 Elsevier Ltd. All rights reserved.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Graduate School of management of technology > 1. Journal Articles
- College of Engineering > School of Industrial and Management Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.