Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine
- Authors
- Yang, Hee-Deok; Lee, Seong-Whan
- Issue Date
- 1-12월-2013
- Publisher
- ELSEVIER
- Keywords
- Sign language recognition; Conditional random field; BoostMap embedding; Support vector machine
- Citation
- PATTERN RECOGNITION LETTERS, v.34, no.16, pp.2051 - 2056
- Indexed
- SCIE
SCOPUS
- Journal Title
- PATTERN RECOGNITION LETTERS
- Volume
- 34
- Number
- 16
- Start Page
- 2051
- End Page
- 2056
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/101338
- DOI
- 10.1016/j.patrec.2013.06.022
- ISSN
- 0167-8655
- Abstract
- The sign language is composed of two categories of signals: manual signals such as signs and fingerspellings and non-manual ones such as body gestures and facial expressions. This paper proposes a new method for recognizing manual signals and facial expressions as non-manual signals. The proposed method involves the following three steps: First, a hierarchical conditional random field is used to detect candidate segments of manual signals. Second, the BoostMap embedding method is used to verify hand shapes of segmented signs and to recognize fingerspellings. Finally, the support vector machine is used to recognize facial expressions as non-manual signals. This final step is taken when there is some ambiguity in the previous two steps. The experimental results indicate that the proposed method can accurately recognize the sign language at an 84% rate based on utterance data. (C) 2013 Elsevier B. V. All rights reserved.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Department of Artificial Intelligence > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.