Spatiotemporal Saliency Detection for Video Sequences Based on Random Walk With Restart
- Authors
- Kim, Hansang; Kim, Youngbae; Sim, Jae-Young; Kim, Chang-Su
- Issue Date
- Aug-2015
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Saliency detection; video saliency; random walk with restart; spatiotemporal feature; motion profile
- Citation
- IEEE TRANSACTIONS ON IMAGE PROCESSING, v.24, no.8
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE TRANSACTIONS ON IMAGE PROCESSING
- Volume
- 24
- Number
- 8
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/92891
- DOI
- 10.1109/TIP.2015.2425544
- ISSN
- 1057-7149
- Abstract
- A novel saliency detection algorithm for video sequences based on the random walk with restart (RWR) is proposed in this paper. We adopt RWR to detect spatially and temporally salient regions. More specifically, we first find a temporal saliency distribution using the features of motion distinctiveness, temporal consistency, and abrupt change. Among them, the motion distinctiveness is derived by comparing the motion profiles of image patches. Then, we employ the temporal saliency distribution as a restarting distribution of the random walker. In addition, we design the transition probability matrix for the walker using the spatial features of intensity, color, and compactness. Finally, we estimate the spatiotemporal saliency distribution by finding the steady-state distribution of the walker. The proposed algorithm detects foreground salient objects faithfully, while suppressing cluttered backgrounds effectively, by incorporating the spatial transition matrix and the temporal restarting distribution systematically. Experimental results on various video sequences demonstrate that the proposed algorithm outperforms conventional saliency detection algorithms qualitatively and quantitatively.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholar.korea.ac.kr/handle/2021.sw.korea/92891)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.