Dialogue enabling speech-to-text user assistive agent system for hearing-impaired person
- Authors
- Lee, Seongjae; Kang, Sunmee; Han, David K.; Ko, Hanseok
- Issue Date
- 6월-2016
- Publisher
- SPRINGER HEIDELBERG
- Keywords
- Hearing-impaired person; Speech-to-text transcription; Beamforming; Keyword spotting; User interface
- Citation
- MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, v.54, no.6, pp.915 - 926
- Indexed
- SCIE
SCOPUS
- Journal Title
- MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING
- Volume
- 54
- Number
- 6
- Start Page
- 915
- End Page
- 926
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/88423
- DOI
- 10.1007/s11517-015-1447-8
- ISSN
- 0140-0118
- Abstract
- A novel approach for assisting bidirectional communication between people of normal hearing and hearing-impaired is presented. While the existing hearing-impaired assistive devices such as hearing aids and cochlear implants are vulnerable in extreme noise conditions or post-surgery side effects, the proposed concept is an alternative approach wherein spoken dialogue is achieved by means of employing a robust speech recognition technique which takes into consideration of noisy environmental factors without any attachment into human body. The proposed system is a portable device with an acoustic beamformer for directional noise reduction and capable of performing speech-to-text transcription function, which adopts a keyword spotting method. It is also equipped with an optimized user interface for hearing-impaired people, rendering intuitive and natural device usage with diverse domain contexts. The relevant experimental results confirm that the proposed interface design is feasible for realizing an effective and efficient intelligent agent for hearing-impaired.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.