Single-image depth estimation using relative depths
- Authors
- Lee, Jae-Han; Kim, Chang-Su
- Issue Date
- 4월-2022
- Publisher
- ACADEMIC PRESS INC ELSEVIER SCIENCE
- Keywords
- Monocular depth estimation; Relative depth; 3D analysis
- Citation
- JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v.84
- Indexed
- SCIE
SCOPUS
- Journal Title
- JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION
- Volume
- 84
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/140820
- DOI
- 10.1016/j.jvcir.2022.103459
- ISSN
- 1047-3203
- Abstract
- Depth estimation from a single RGB image is a challenging task. It is ill-posed since a single 2D image may correspond to various 3D scenes at different scales. On the other hand, estimating the relative depth relationship between two objects in a scene is easier and may yield more reliable results. Thus, in this paper, we propose a novel algorithm for monocular depth estimation using relative depths. First, using a convolutional neural network, we estimate two types of depths at multiple spatial resolutions: ordinary depth maps and relative depth tensors. Second, we restore a relative depth map from each relative depth tensor. A relative depth map is equivalent to an ordinary depth map with global scale information removed. For the restoration, sparse pairwise comparison matrices are constructed from available relative depths, and missing entries are filled in using the alternative least square (ALS) algorithm. Third, we decompose the ordinary and relative depth maps into components and recombine them to yield a final depth map. To reduce the computational complexity, relative depths at fine spatial resolutions are directly used to refine the final depth map. Extensive experimental results on the NYUv2 dataset demonstrate that the proposed algorithm provides state-of-the-art performance.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.