Compression Artifacts Reduction Using Fusion of Multiple Restoration Networks
- Authors
- Cho, Sung-Jin; Chung, Jae Ryun; Kim, Seung-Wook; Jung, Seung-Won; Ko, Sung-Jea
- Issue Date
- 2021
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Automobiles; Image coding; Image reconstruction; Image restoration; Training; Video compression; Quantization (signal); Compression artifacts reduction; convolutional neural network; deep learning; network fusion; video compression
- Citation
- IEEE ACCESS, v.9, pp.66176 - 66187
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 9
- Start Page
- 66176
- End Page
- 66187
- URI
- https://scholar.korea.ac.kr/handle/2021.sw.korea/130048
- DOI
- 10.1109/ACCESS.2021.3076763
- ISSN
- 2169-3536
- Abstract
- Lossy video compression achieves coding gains at the expense of the quality loss of the decoded images. Owing to the success of deep learning techniques, especially convolutional neural networks (CNNs), many compression artifacts reduction (CAR) techniques have been used to significantly improve the quality of decoded images by applying CNNs which are trained to predict the original artifact-free images from the decoded images. Most existing video compression standards control the compression ratio using a quantization parameter (QP), so the quality of the decoded images is strongly QP-dependent. Training individual CNNs for predetermined QPs is one of the common approaches to dealing with different levels of compression artifacts. However, compression artifacts are also dependent on the local characteristics of an image. Therefore, a CNN trained for specific QP cannot fully remove the compression artifacts of all images, even those encoded using the same QP. In this paper, we introduce a pixel-precise network selection network (PNSNet). From multiple reconstructed images obtained using multiple QP-specific CAR networks, PNSNet is trained to find the best CAR network for each pixel. The output of PNSNet is then used as an explicit spatial attention channel for an image fusion network that combines multiple reconstructed images. Experimental results demonstrated that the quality of decoded images can be significantly improved by the proposed multiple CAR network fusion method.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Engineering > School of Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.