Sign Language Spotting with a Threshold Model Based on Conditional Random Fields
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Yang, Hee-Deok | - |
dc.contributor.author | Sclaroff, Stan | - |
dc.contributor.author | Lee, Seong-Whan | - |
dc.date.accessioned | 2021-09-08T15:47:18Z | - |
dc.date.available | 2021-09-08T15:47:18Z | - |
dc.date.created | 2021-06-10 | - |
dc.date.issued | 2009-07 | - |
dc.identifier.issn | 0162-8828 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/119741 | - |
dc.description.abstract | Sign language spotting is the task of detecting and recognizing signs in a signed utterance, in a set vocabulary. The difficulty of sign language spotting is that instances of signs vary in both motion and appearance. Moreover, signs appear within a continuous gesture stream, interspersed with transitional movements between signs in a vocabulary and nonsign patterns (which include out-of-vocabulary signs, epentheses, and other movements that do not correspond to signs). In this paper, a novel method for designing threshold models in a conditional random field (CRF) model is proposed which performs an adaptive threshold for distinguishing between signs in a vocabulary and nonsign patterns. A short-sign detector, a hand appearance-based sign verification method, and a subsign reasoning method are included to further improve sign language spotting accuracy. Experiments demonstrate that our system can spot signs from continuous data with an 87.0 percent spotting rate and can recognize signs from isolated data with a 93.5 percent recognition rate versus 73.5 percent and 85.4 percent, respectively, for CRFs without a threshold model, short-sign detection, subsign reasoning, and hand appearance-based sign verification. Our system can also achieve a 15.0 percent sign error rate (SER) from continuous data and a 6.4 percent SER from isolated data versus 76.2 percent and 14.5 percent, respectively, for conventional CRFs. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEEE COMPUTER SOC | - |
dc.subject | RECOGNITION | - |
dc.subject | TIME | - |
dc.title | Sign Language Spotting with a Threshold Model Based on Conditional Random Fields | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lee, Seong-Whan | - |
dc.identifier.doi | 10.1109/TPAMI.2008.172 | - |
dc.identifier.scopusid | 2-s2.0-67349252145 | - |
dc.identifier.wosid | 000266188900010 | - |
dc.identifier.bibliographicCitation | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, v.31, no.7, pp.1264 - 1277 | - |
dc.relation.isPartOf | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | - |
dc.citation.title | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE | - |
dc.citation.volume | 31 | - |
dc.citation.number | 7 | - |
dc.citation.startPage | 1264 | - |
dc.citation.endPage | 1277 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Artificial Intelligence | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordPlus | RECOGNITION | - |
dc.subject.keywordPlus | TIME | - |
dc.subject.keywordAuthor | Sign language recognition | - |
dc.subject.keywordAuthor | sign language spotting | - |
dc.subject.keywordAuthor | conditional random field | - |
dc.subject.keywordAuthor | threshold model | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.