Physiological Signal-Based Real-Time Emotion Recognition Based on Exploiting Mutual Information with Physiologically Common Features

Citations

WEB OF SCIENCE

21
Citations

SCOPUS

24

초록

This paper proposes a real-time emotion recognition system that utilizes photoplethysmography (PPG) and electromyography (EMG) physiological signals. The proposed approach employs a complex-valued neural network to extract common features from the physiological signals, enabling successful emotion recognition without interference. The system comprises three stages: single-pulse extraction, a physiological coherence feature module, and a physiological common feature module. The experimental results demonstrate that the proposed method surpasses alternative approaches in terms of accuracy and the recognition interval. By extracting common features of the PPG and EMG signals, this approach achieves effective emotion recognition without mutual interference. The findings provide a significant advancement in real-time emotion analysis and offer a clear and concise framework for understanding individuals' emotional states using physiological signals.

키워드

emotion recognition; physiological signal; PPG; EMG; multimodal network; convolutional autoencoder; short-time Fourier transform (STFT); complex-valued convolutional neural network (CVCNN); NEURAL-NETWORK; CLASSIFICATION; SYSTEM
제목
Physiological Signal-Based Real-Time Emotion Recognition Based on Exploiting Mutual Information with Physiologically Common Features
저자
Han, Ean-Gyu; Kang, Tae-Koo; Lim, Myo-Taeg
DOI
10.3390/electronics12132933
발행일
2023-07
유형
Article
저널명
Electronics (Basel)
권
12
호
13