EARSHOT: A Minimal Neural Network Model of Incremental Human Speech Recognition
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Magnuson, James S. | - |
dc.contributor.author | You, Heejo | - |
dc.contributor.author | Luthra, Sahil | - |
dc.contributor.author | Li, Monica | - |
dc.contributor.author | Nam, Hosung | - |
dc.contributor.author | Escabi, Monty | - |
dc.contributor.author | Brown, Kevin | - |
dc.contributor.author | Allopenna, Paul D. | - |
dc.contributor.author | Theodore, Rachel M. | - |
dc.contributor.author | Monto, Nicholas | - |
dc.contributor.author | Rueckl, Jay G. | - |
dc.date.accessioned | 2021-08-31T04:52:00Z | - |
dc.date.available | 2021-08-31T04:52:00Z | - |
dc.date.created | 2021-06-18 | - |
dc.date.issued | 2020-04 | - |
dc.identifier.issn | 0364-0213 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/56805 | - |
dc.description.abstract | Despite the lack of invariance problem (the many-to-many mapping between acoustics and percepts), human listeners experience phonetic constancy and typically perceive what a speaker intends. Most models of human speech recognition (HSR) have side-stepped this problem, working with abstract, idealized inputs and deferring the challenge of working with real speech. In contrast, carefully engineered deep learning networks allow robust, real-world automatic speech recognition (ASR). However, the complexities of deep learning architectures and training regimens make it difficult to use them to provide direct insights into mechanisms that may support HSR. In this brief article, we report preliminary results from a two-layer network that borrows one element from ASR, long short-term memory nodes, which provide dynamic memory for a range of temporal spans. This allows the model to learn to map real speech from multiple talkers to semantic targets with high accuracy, with human-like timecourse of lexical access and phonological competition. Internal representations emerge that resemble phonetically organized responses in human superior temporal gyrus, suggesting that the model develops a distributed phonological code despite no explicit training on phonetic or phonemic targets. The ability to work with real speech is a major advance for cognitive models of HSR. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | WILEY | - |
dc.subject | PERCEPTION | - |
dc.title | EARSHOT: A Minimal Neural Network Model of Incremental Human Speech Recognition | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Nam, Hosung | - |
dc.identifier.doi | 10.1111/cogs.12823 | - |
dc.identifier.scopusid | 2-s2.0-85083180780 | - |
dc.identifier.wosid | 000529264000001 | - |
dc.identifier.bibliographicCitation | COGNITIVE SCIENCE, v.44, no.4 | - |
dc.relation.isPartOf | COGNITIVE SCIENCE | - |
dc.citation.title | COGNITIVE SCIENCE | - |
dc.citation.volume | 44 | - |
dc.citation.number | 4 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | ssci | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Psychology | - |
dc.relation.journalWebOfScienceCategory | Psychology, Experimental | - |
dc.subject.keywordPlus | PERCEPTION | - |
dc.subject.keywordAuthor | Human speech recognition | - |
dc.subject.keywordAuthor | Computational modeling | - |
dc.subject.keywordAuthor | Neurobiology of language | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.