Multimodal Deep Fusion Network for Visibility Assessment With a Small Training Dataset
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Wang, Han | - |
dc.contributor.author | Shen, Kecheng | - |
dc.contributor.author | Yu, Peilun | - |
dc.contributor.author | Shi, Quan | - |
dc.contributor.author | Ko, Hanseok | - |
dc.date.accessioned | 2021-08-31T16:11:48Z | - |
dc.date.available | 2021-08-31T16:11:48Z | - |
dc.date.created | 2021-06-18 | - |
dc.date.issued | 2020 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/59042 | - |
dc.description.abstract | Visibility is a measure of the transparency of the atmosphere, which is an important factor for road, air, and water transportation safety. Recently, features extracted from convolutional neural networks (CNNs) have obtained state-of-the-art results for the estimation of the visibility range for images of foggy weather. However, existing CNN-based approaches have only adopted visible images as observational data. Unlike these previous studies, in this paper, visible-infrared image pairs are used to estimate the visibility range. A novel multimodal deep fusion architecture based on a CNN is then proposed to learn the robust joint features of the two sensor modalities. Our network architecture is composed of two integrated residual network processing streams and one CNN stream, which are connected in parallel. In addition, we construct a visible-infrared multimodal dataset for various fog densities and label the visibility range. We then compare our proposed method with conventional deep-learning-based approaches and analyze the contributions of various observational and classical deep fusion models to the classification of the visibility range. The experimental results demonstrate that both accuracy and robustness can be strongly enhanced using the proposed method, especially for small training datasets. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.subject | ATMOSPHERIC VISIBILITY | - |
dc.subject | FOG | - |
dc.title | Multimodal Deep Fusion Network for Visibility Assessment With a Small Training Dataset | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Ko, Hanseok | - |
dc.identifier.doi | 10.1109/ACCESS.2020.3031283 | - |
dc.identifier.scopusid | 2-s2.0-85098072459 | - |
dc.identifier.wosid | 000597193400001 | - |
dc.identifier.bibliographicCitation | IEEE ACCESS, v.8, pp.217057 - 217067 | - |
dc.relation.isPartOf | IEEE ACCESS | - |
dc.citation.title | IEEE ACCESS | - |
dc.citation.volume | 8 | - |
dc.citation.startPage | 217057 | - |
dc.citation.endPage | 217067 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | ATMOSPHERIC VISIBILITY | - |
dc.subject.keywordPlus | FOG | - |
dc.subject.keywordAuthor | Atmospheric modeling | - |
dc.subject.keywordAuthor | Feature extraction | - |
dc.subject.keywordAuthor | Estimation | - |
dc.subject.keywordAuthor | Cameras | - |
dc.subject.keywordAuthor | Deep learning | - |
dc.subject.keywordAuthor | Image resolution | - |
dc.subject.keywordAuthor | Visibility range classification | - |
dc.subject.keywordAuthor | multimodal fusion network | - |
dc.subject.keywordAuthor | visible& | - |
dc.subject.keywordAuthor | #8211 | - |
dc.subject.keywordAuthor | infrared image pairs | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.