Coarse-to-Fine Deep Learning of Continuous Pedestrian Orientation Based on Spatial Co-Occurrence Feature
- Authors
- Kim, Sung-Soo; Gwak, In-Youb; Lee, Seong-Whan
- Issue Date
- 6월-2020
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Estimation; Visualization; Training; Task analysis; Feature extraction; Deep learning; Complexity theory; Advanced driver assistance system; coarse-to-fine learning; convolutional neural networks; continuous orientation estimation
- Citation
- IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, v.21, no.6, pp.2522 - 2533
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS
- Volume
- 21
- Number
- 6
- Start Page
- 2522
- End Page
- 2533
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/55578
- DOI
- 10.1109/TITS.2019.2919920
- ISSN
- 1524-9050
- Abstract
- The continuous orientation estimation of a moving pedestrian is a crucial issue in autonomous driving that requires the detection of a pedestrian intending to cross a road. It is still a challenging task owing to several reasons, including the diversity of pedestrian appearances, the subtle pose difference between adjacent orientations, and similar poses with different orientations such as axisymmetric orientations. These problems render the task highly difficult. Recent studies involving convolutional neural networks (CNNs) have attempted to solve these problems. However, their performance is still far from satisfactory for application in intelligent vehicles. In this paper, we propose a CNN-based two-stream network for continuous orientation estimation. The network can learn representations based on the spatial co-occurrence of visual patterns among pedestrians. To boost estimation performance, we applied a coarse-to-fine learning approach that consists of two learning stages. We investigated continuous orientation performance on the TUD Multiview Pedestrian dataset and the KITTI dataset and compared them with the state-of-the-art methods. The results show that our method outperforms other existing methods.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Graduate School > Department of Artificial Intelligence > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.