An end-to-end face parsing model using channel and spatial attentions

Abstract

Facial image parsing requires accurate extraction of facial components and features, and image segmentation can be used. Recently, various attention mechanisms showed excellent performance in segmentation by extracting features based on spatial and channel relationships for input images. In this paper, we propose a new face parsing technique using an attention block that combines the spatial attention block and the channel attention block to effectively utilize their functions. In this process, we improve the structure of the two blocks to compensate for their weaknesses. The attention block extracts features related to the shape of facial components from spatial relationships and concentrates on more important channels from correlation among channels. We built several segmentation models using the proposed block and compared their performance with well-known segmentation models. Experimental results showed that our combined block-based model can improve the segmentation accuracy by more than 5% in F1 score compared to other models.