Classification of pilots' mental states using a multimodal deep learning network
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Han, Soo-Yeon | - |
dc.contributor.author | Kwak, No-Sang | - |
dc.contributor.author | Oh, Taegeun | - |
dc.contributor.author | Lee, Seong-Whan | - |
dc.date.accessioned | 2021-08-31T14:55:06Z | - |
dc.date.available | 2021-08-31T14:55:06Z | - |
dc.date.created | 2021-06-19 | - |
dc.date.issued | 2020-01 | - |
dc.identifier.issn | 0208-5216 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/58436 | - |
dc.description.abstract | An automation system for detecting the pilot's diversified mental states is an extremely important and essential technology, as it could prevent catastrophic accidents caused by the deteriorated cognitive state of pilots. Various types of biosignals have been employed to develop the system, since they accompany neurophysiological changes corresponding to the mental state transitions. In this study, we aimed to investigate the feasibility of a robust detection system of the pilot's mental states (i.e., distraction, workload, fatigue, and normal) based on multimodal biosignals (i.e., electroencephalogram, electrocardiogram, respiration, and electrodermal activity) and a multimodal deep learning (MDL) network. To do this, first, we constructed an experimental environment using a flight simulator in order to induce the different mental states and to collect the biosignals. Second, we designed the MDL architecture - which consists of a convolutional neural network and long short-term memory models - to efficiently combine the information of the different biosignals. Our experimental results successfully show that utilizing multimodal biosignals with the proposed MDL could significantly enhance the detection accuracy of the pilot's mental states. (c) 2020 Nalecz Institute of Biocybernetics and Biomedical Engineering of the Polish Academy of Sciences. Published by Elsevier B.V. All rights reserved. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | ELSEVIER | - |
dc.subject | DRIVER FATIGUE | - |
dc.subject | FEATURE-EXTRACTION | - |
dc.subject | HEART-RATE | - |
dc.subject | EEG | - |
dc.subject | ALGORITHMS | - |
dc.subject | FUSION | - |
dc.subject | SYSTEM | - |
dc.title | Classification of pilots' mental states using a multimodal deep learning network | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lee, Seong-Whan | - |
dc.identifier.doi | 10.1016/j.bbe.2019.12.002 | - |
dc.identifier.scopusid | 2-s2.0-85078807614 | - |
dc.identifier.wosid | 000528800500025 | - |
dc.identifier.bibliographicCitation | BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, v.40, no.1, pp.324 - 336 | - |
dc.relation.isPartOf | BIOCYBERNETICS AND BIOMEDICAL ENGINEERING | - |
dc.citation.title | BIOCYBERNETICS AND BIOMEDICAL ENGINEERING | - |
dc.citation.volume | 40 | - |
dc.citation.number | 1 | - |
dc.citation.startPage | 324 | - |
dc.citation.endPage | 336 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Engineering, Biomedical | - |
dc.subject.keywordPlus | DRIVER FATIGUE | - |
dc.subject.keywordPlus | FEATURE-EXTRACTION | - |
dc.subject.keywordPlus | HEART-RATE | - |
dc.subject.keywordPlus | EEG | - |
dc.subject.keywordPlus | ALGORITHMS | - |
dc.subject.keywordPlus | FUSION | - |
dc.subject.keywordPlus | SYSTEM | - |
dc.subject.keywordAuthor | MDL | - |
dc.subject.keywordAuthor | EEG | - |
dc.subject.keywordAuthor | ECG | - |
dc.subject.keywordAuthor | Respiration | - |
dc.subject.keywordAuthor | EDA | - |
dc.subject.keywordAuthor | Pilot&apos | - |
dc.subject.keywordAuthor | s mental states | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.