비음이 성문음보다 더 밝고 노랗다: 자음과 색 간의 교차감각 연합 연구

Abstract

People share implicit cross-modal mappings for certain visual and auditory features such as pitch and human speech. The current study explored the role of phonetic features in intrinsic associations between consonant sounds and colors. For this purpose, we presented synthetic consonant sounds generated by parametrically manipulating oral and non-oral constriction gestures of speech organs, using an articulatory synthesizer. Participants were asked to choose a color after hearing each sound. Color-matching results showed that nasal sounds characterized by a velic gesture were associated with lighter and more yellowish colors than other sounds. The perceptual space of the consonant sounds from dissimilarity judgment ratings indicated that participants could capture the consonantal nature of the stimuli. These results imply the non-arbitrary association between phonetic features of consonants and colors.