Video Deraining and Desnowing Using Temporal Correlation and Low-Rank Matrix Completion
- Authors
- Kim, Jin-Hwan; Sim, Jae-Young; Kim, Chang-Su
- Issue Date
- 9월-2015
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Video deraining; desnowing; rain streak removal; low rank matrix completion; sparse representation
- Citation
- IEEE TRANSACTIONS ON IMAGE PROCESSING, v.24, no.9, pp.2658 - 2670
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE TRANSACTIONS ON IMAGE PROCESSING
- Volume
- 24
- Number
- 9
- Start Page
- 2658
- End Page
- 2670
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/92656
- DOI
- 10.1109/TIP.2015.2428933
- ISSN
- 1057-7149
- Abstract
- A novel algorithm to remove rain or snow streaks from a video sequence using temporal correlation and low-rank matrix completion is proposed in this paper. Based on the observation that rain streaks are too small and move too fast to affect the optical flow estimation between consecutive frames, we obtain an initial rain map by subtracting temporally warped frames from a current frame. Then, we decompose the initial rain map into basis vectors based on the sparse representation, and classify those basis vectors into rain streak ones and outliers with a support vector machine. We then refine the rain map by excluding the outliers. Finally, we remove the detected rain streaks by employing a low-rank matrix completion technique. Furthermore, we extend the proposed algorithm to stereo video deraining. Experimental results demonstrate that the proposed algorithm detects and removes rain or snow streaks efficiently, outperforming conventional algorithms.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.