Challenges in Syntax-semantic Integration for Language Models: A Case Study of Korean Control Dependencies

Challenges in Syntax-semantic Integration for Language Models: A Case Study of Korean Control Dependencies

초록

This study evaluates the ability of language models (LMs) to process subject-verb dependencies in Korean control constructions, involving a covert subject (PRO), using three models: KLUE-RoBERTa, KR-BERT, and KoELECTRA. We focused on LMs’ capacity to detect honorific mismatches and manage complex grammatical structures. Unlike previous findings in Indo-European languages, KLUE-RoBERTa and KR- BERT showed greater sensitivity to subject NPs, whereas KoELECTRA was more responsive to object NPs and better at detecting honorific mismatches. Additionally, increasing the distance between subject and object NPs generally improved model performance.

키워드

subject control; object control; language model; honorific mismatches; dependency formation
제목
Challenges in Syntax-semantic Integration for Language Models: A Case Study of Korean Control Dependencies
제목 (타언어)
Challenges in Syntax-semantic Integration for Language Models: A Case Study of Korean Control Dependencies
저자
유명혜; 송상헌
발행일
2024-08
저널명
언어와 정보
권
28
호
2
페이지
77 ~ 97