fMRI volume classification using a 3D convolutional neural network robust to shifted and scaled neuronal activations
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Hanh Vu | - |
dc.contributor.author | Kim, Hyun-Chul | - |
dc.contributor.author | Jung, Minyoung | - |
dc.contributor.author | Lee, Jong-Hwan | - |
dc.date.accessioned | 2021-08-30T07:16:30Z | - |
dc.date.available | 2021-08-30T07:16:30Z | - |
dc.date.created | 2021-06-18 | - |
dc.date.issued | 2020-12 | - |
dc.identifier.issn | 1053-8119 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/51432 | - |
dc.description.abstract | Deep-learning methods based on deep neural networks (DNNs) have recently been successfully utilized in the analysis of neuroimaging data. A convolutional neural network (CNN) is a type of DNN that employs a convolution kernel that covers a local area of the input sample and moves across the sample to provide a feature map for the subsequent layers. In our study, we hypothesized that a 3D-CNN model with down-sampling operations such as pooling and/or stride would have the ability to extract robust feature maps from the shifted and scaled neuronal activations in a single functional MRI (fMRI) volume for the classification of task information associated with that volume. Thus, the 3D-CNN model would be able to ameliorate the potential misalignment of neuronal activations and over-/under-activation in local brain regions caused by imperfections in spatial alignment algorithms, confounded by variability in blood-oxygenation-level-dependent (BOLD) responses across sessions and/or subjects. To this end, the fMRI volumes acquired from four sensorimotor tasks (left-hand clenching, right-hand clenching, auditory attention, and visual stimulation) were used as input for our 3D-CNN model to classify task information using a single fMRI volume. The classification performance of the 3D-CNN was systematically evaluated using fMRI volumes obtained from various minimal preprocessing scenarios applied to raw fMRI volumes that excluded spatial normalization to a template and those obtained from full preprocessing that included spatial normalization. Alternative classifier models such as the 1D fully connected DNN (1D-fcDNN) and support vector machine (SVM) were also used for comparison. The classification performance was also assessed for several k-fold cross-validation (CV) schemes, including leave-one-subject-out CV (LOOCV). Overall, the classification results of the 3D-CNN model were superior to that of the 1D-fcDNN and SVM models. When using the fully-processed fMRI volumes with LOOCV, the mean error rates (+/- the standard error of the mean) for the 3D-CNN, 1D-fcDNN, and SVM models were 2.1% (+/- 0.9), 3.1% (+/- 1.2), and 4.1% (+/- 1.5), respectively (p = 0.041 from a one-way ANOVA). The error rates for 3-fold CV were higher (2.4% +/- 1.0, 4.2% +/- 1.3, and 10.1% +/- 2.0; p < 0.0003 from a one-way ANOVA). The mean error rates also increased considerably using the raw fMRI 3D volume data without preprocessing (26.2% for the 3D-CNN, 75.0% for the 1D-fcDNN, and 75.0% for the SVM). Furthermore, the ability of the pre-trained 3D-CNN model to handle shifted and scaled neuronal activations was demonstrated in an online scenario for five-class classification (i.e., four sensorimotor tasks and the resting state) using the real-time fMRI of three participants. The resulting classification accuracy was 78.5% (+/- 1.4), 26.7% (+/- 5.9), and 21.5% (+/- 3.1) for the 3D-CNN, 1D-fcDNN, and SVM models, respectively. The superior performance of the 3D-CNN compared to the 1D-fcDNN was verified by analyzing the resulting feature maps and convolution filters that handled the shifted and scaled neuronal activations and by utilizing an independent public dataset from the Human Connectome Project. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | ACADEMIC PRESS INC ELSEVIER SCIENCE | - |
dc.subject | REAL-TIME FMRI | - |
dc.subject | FUNCTIONAL CONNECTIVITY | - |
dc.subject | BRAIN NETWORKS | - |
dc.subject | INDIVIDUAL-DIFFERENCES | - |
dc.subject | AUTOMATIC RECOGNITION | - |
dc.subject | HESCHLS GYRUS | - |
dc.subject | NEUROFEEDBACK | - |
dc.subject | PARCELLATION | - |
dc.subject | INTERFACE | - |
dc.subject | ORGANIZATION | - |
dc.title | fMRI volume classification using a 3D convolutional neural network robust to shifted and scaled neuronal activations | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Lee, Jong-Hwan | - |
dc.identifier.doi | 10.1016/j.neuroimage.2020.117328 | - |
dc.identifier.scopusid | 2-s2.0-85090419177 | - |
dc.identifier.wosid | 000582799600045 | - |
dc.identifier.bibliographicCitation | NEUROIMAGE, v.223 | - |
dc.relation.isPartOf | NEUROIMAGE | - |
dc.citation.title | NEUROIMAGE | - |
dc.citation.volume | 223 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Neurosciences & Neurology | - |
dc.relation.journalResearchArea | Radiology, Nuclear Medicine & Medical Imaging | - |
dc.relation.journalWebOfScienceCategory | Neurosciences | - |
dc.relation.journalWebOfScienceCategory | Neuroimaging | - |
dc.relation.journalWebOfScienceCategory | Radiology, Nuclear Medicine & Medical Imaging | - |
dc.subject.keywordPlus | REAL-TIME FMRI | - |
dc.subject.keywordPlus | FUNCTIONAL CONNECTIVITY | - |
dc.subject.keywordPlus | BRAIN NETWORKS | - |
dc.subject.keywordPlus | INDIVIDUAL-DIFFERENCES | - |
dc.subject.keywordPlus | AUTOMATIC RECOGNITION | - |
dc.subject.keywordPlus | HESCHLS GYRUS | - |
dc.subject.keywordPlus | NEUROFEEDBACK | - |
dc.subject.keywordPlus | PARCELLATION | - |
dc.subject.keywordPlus | INTERFACE | - |
dc.subject.keywordPlus | ORGANIZATION | - |
dc.subject.keywordAuthor | Classification | - |
dc.subject.keywordAuthor | Convolutional neural networks | - |
dc.subject.keywordAuthor | Deep neural networks | - |
dc.subject.keywordAuthor | Functional MRI | - |
dc.subject.keywordAuthor | Human Connectome Project | - |
dc.subject.keywordAuthor | Machine learning | - |
dc.subject.keywordAuthor | Real-time fMRI | - |
dc.subject.keywordAuthor | Sensorimotor tasks | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.