Detailed Information

Cited 0 time in webofscience Cited 0 time in scopus
Metadata Downloads

Real-Time Continuous Phoneme Recognition System Using Class-Dependent Tied-Mixture HMM With HBT Structure for Speech-Driven Lip-Sync

Authors
Park, JunhoKo, Hanseok
Issue Date
11월-2008
Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Keywords
Head-body-tail HMM; phoneme recognition; real-time lip-sync
Citation
IEEE TRANSACTIONS ON MULTIMEDIA, v.10, no.7, pp.1299 - 1306
Indexed
SCIE
SCOPUS
Journal Title
IEEE TRANSACTIONS ON MULTIMEDIA
Volume
10
Number
7
Start Page
1299
End Page
1306
URI
https://scholar.korea.ac.kr/handle/2021.sw.korea/122424
DOI
10.1109/TMM.2008.2004908
ISSN
1520-9210
Abstract
This work describes a real-time lip-sync method using which an avatar's lip shape is synchronized with the corresponding speech signal. Phoneme recognition is generally regarded as an important task in the operation of a real-time lip-sync system. In this work, the use of the Head-Body-Tail (HBT) model is proposed for the purpose of more efficiently recognizing phonemes which are variously uttered due to co-articulation effects. The HBT model effectively deals with the transition parts of context-dependent models for small-sized vocabulary tasks. These models provide better recognition performance than general context-dependent or context-independent models for the task of digit or vowel recognition. Moreover, each phoneme is categorized into one among four classes and the class-dependent codebook is generated to further improve the performance. Additionally, for the clear representation of the context dependency information in the transient parts, some Gaussians are excluded from class-dependent codebook. The proposed method leads to a lip-sync system that performs at a level that is similar to previous designs based on HBT and continuous hidden Markov models (CHMMs). However, our method reduces the number of model parameters by one-third and enables real-time operation.
Files in This Item
There are no files associated with this item.
Appears in
Collections
College of Engineering > School of Electrical Engineering > 1. Journal Articles

qrcode

Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Researcher Ko, Han seok photo

Ko, Han seok
공과대학 (전기전자공학부)
Read more

Altmetrics

Total Views & Downloads

BROWSE