Tracking-by-Segmentation Using Superpixel-Wise Neural Network
- Authors
- Lee, Se-Ho; Jang, Won-Dong; Kim, Chang-Su
- Issue Date
- 2018
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Tracking-by-segmentation; visual tracking; object tracking; object segmentation
- Citation
- IEEE ACCESS, v.6, pp.54982 - 54993
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 6
- Start Page
- 54982
- End Page
- 54993
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/80895
- DOI
- 10.1109/ACCESS.2018.2872735
- ISSN
- 2169-3536
- Abstract
- A tracking-by-segmentation algorithm, which tracks and segments a target object in a video sequence, is proposed in this paper. In the first frame, we segment out the target object in a user-annotated bounding box. Then, we divide subsequent frames into superpixels. We develop a superpixel-wise neural network for tracking-by-segmentation, called TBSNet, which extracts multi-level convolutional features of each superpixel and yields the foreground probability of the superpixel as the output. We train TBSNet in two stages. First, we perform offline training to enable TBSNet to discriminate general objects from the background. Second, during the tracking, we fine-tune TBSNet to distinguish the target object from non-targets and adapt to color change and shape variation of the target object. Finally, we perform conditional random field optimization to improve the segmentation quality further. Experimental results demonstrate that the proposed algorithm outperforms the state-of-the-art trackers on four challenging data sets.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.