Indexing by Latent Dirichlet Allocation and an Ensemble Model
- Authors
- Wang, Yanshan; Lee, Jae-Sung; Choi, In-Chan
- Issue Date
- 7월-2016
- Publisher
- WILEY
- Keywords
- information retrieval; machine learning; searching
- Citation
- JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, v.67, no.7, pp.1736 - 1750
- Indexed
- SCIE
SSCI
SCOPUS
- Journal Title
- JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY
- Volume
- 67
- Number
- 7
- Start Page
- 1736
- End Page
- 1750
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/88207
- DOI
- 10.1002/asi.23444
- ISSN
- 2330-1643
- Abstract
- The contribution of this article is twofold. First, we present Indexing by latent Dirichlet allocation (LDI), an automatic document indexing method. Many ad hoc applications, or their variants with smoothing techniques suggested in LDA-based language modeling, can result in unsatisfactory performance as the document representations do not accurately reflect concept space. To improve document retrieval performance, we introduce a new definition of document probability vectors in the context of LDA and present a novel scheme for automatic document indexing based on LDA. Second, we propose an Ensemble Model (EnM) for document retrieval. EnM combines basic indexing models by assigning different weights and attempts to uncover the optimal weights to maximize the mean average precision. To solve the optimization problem, we propose an algorithm, which is derived based on the boosting method. The results of our computational experiments on benchmark data sets indicate that both the proposed approaches are viable options for document retrieval.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Industrial and Management Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.