Monocular Human Depth Estimation Via Pose Estimation
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Jun, Jinyoung | - |
dc.contributor.author | Lee, Jae-Han | - |
dc.contributor.author | Lee, Chul | - |
dc.contributor.author | Kim, Chang-Su | - |
dc.date.accessioned | 2022-03-11T23:41:11Z | - |
dc.date.available | 2022-03-11T23:41:11Z | - |
dc.date.created | 2022-01-20 | - |
dc.date.issued | 2021 | - |
dc.identifier.issn | 2169-3536 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/138656 | - |
dc.description.abstract | We propose a novel monocular depth estimator, which improves the prediction accuracy on human regions by utilizing pose information. The proposed algorithm consists of two networks - PoseNet and DepthNet - to estimate keypoint heatmaps and a depth map, respectively. We incorporate the pose information from PoseNet to improve the depth estimation performance of DepthNet. Specifically, we develop the feature blending block, which fuses the features from PoseNet and DepthNet and feeds them into the next layer of DepthNet, to make the networks learn to predict the depths of human regions more accurately. Furthermore, we develop a novel joint training scheme using partially labeled datasets, which balances multiple loss functions effectively by adjusting weights. Experimental results demonstrate that the proposed algorithm can improve depth estimation performance significantly, especially around human regions. For example, the proposed algorithm improves the depth estimation performance on the human regions of ResNet-50 by 2.8% and 7.0% in terms of delta 1 and RMSE, respectively, on the proposed HD + P dataset. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | - |
dc.title | Monocular Human Depth Estimation Via Pose Estimation | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Kim, Chang-Su | - |
dc.identifier.doi | 10.1109/ACCESS.2021.3126629 | - |
dc.identifier.scopusid | 2-s2.0-85119720337 | - |
dc.identifier.wosid | 000719557600001 | - |
dc.identifier.bibliographicCitation | IEEE ACCESS, v.9, pp.151444 - 151457 | - |
dc.relation.isPartOf | IEEE ACCESS | - |
dc.citation.title | IEEE ACCESS | - |
dc.citation.volume | 9 | - |
dc.citation.startPage | 151444 | - |
dc.citation.endPage | 151457 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordAuthor | Monocular depth estimation | - |
dc.subject.keywordAuthor | human pose estimation | - |
dc.subject.keywordAuthor | human depth estimation | - |
dc.subject.keywordAuthor | loss rebalancing strategy | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.