Simultaneous spotting of signs and fingerspellings based on hierarchical conditional random fields and boostmap embeddings
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Yang, Hee-Deok | - |
dc.contributor.author | Lee, Seong-Whan | - |
dc.date.accessioned | 2021-09-08T01:05:47Z | - |
dc.date.available | 2021-09-08T01:05:47Z | - |
dc.date.created | 2021-06-14 | - |
dc.date.issued | 2010-08 | - |
dc.identifier.issn | 0031-3203 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/115919 | - |
dc.description.abstract | A sign language consists of two types of action: signs and fingerspellings. Signs are dynamic gestures discriminated by continuous hand motions and hand configurations, while fingerspellings are a combination of continuous hand configurations. Sign language spotting is the task of detection and recognition of signs and fingerspellings in a signed utterance. The internal structures of signs and fingerspellings differ significantly. Therefore, it is difficult to spot signs and fingerspellings simultaneously. In this paper, a novel method for spotting signs and fingerspellings is proposed. It can distinguish signs, fingerspellings and non-sign patterns, and is robust to the various sizes, scales and rotations of the signer's hand. This is achieved through a hierarchical framework consisting of three steps: (1) Candidate segments of signs and fingerspellings are discriminated using a two-layer conditional random field (CRF). (2) Hand shapes of segmented signs and fingerspellings are verified using BoostMap embeddings. (3)The motions of fingerspellings are verified in order to distinguish those which have similar hand shapes and different hand motions. Experiments demonstrate that the proposed method can spot signs and fingerspellings from utterance data at rates of 83% and 78%, respectively. (C) 2010 Elsevier Ltd. All rights reserved. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | ELSEVIER SCI LTD | - |
dc.subject | LANGUAGE RECOGNITION | - |
dc.title | Simultaneous spotting of signs and fingerspellings based on hierarchical conditional random fields and boostmap embeddings | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lee, Seong-Whan | - |
dc.identifier.doi | 10.1016/j.patcog.2010.03.007 | - |
dc.identifier.scopusid | 2-s2.0-77951256935 | - |
dc.identifier.wosid | 000278186700021 | - |
dc.identifier.bibliographicCitation | PATTERN RECOGNITION, v.43, no.8, pp.2858 - 2870 | - |
dc.relation.isPartOf | PATTERN RECOGNITION | - |
dc.citation.title | PATTERN RECOGNITION | - |
dc.citation.volume | 43 | - |
dc.citation.number | 8 | - |
dc.citation.startPage | 2858 | - |
dc.citation.endPage | 2870 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordPlus | LANGUAGE RECOGNITION | - |
dc.subject.keywordAuthor | Sign language spotting | - |
dc.subject.keywordAuthor | Fingerspelling spotting | - |
dc.subject.keywordAuthor | Conditional random field | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.