Real-time shape tracking of facial landmarks
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kim, Hyungjoon | - |
dc.contributor.author | Kim, Hyeonwoo | - |
dc.contributor.author | Hwang, Eenjun | - |
dc.date.accessioned | 2021-08-30T22:16:34Z | - |
dc.date.available | 2021-08-30T22:16:34Z | - |
dc.date.created | 2021-06-18 | - |
dc.date.issued | 2020-06 | - |
dc.identifier.issn | 1380-7501 | - |
dc.identifier.uri | https://scholar.korea.ac.kr/handle/2021.sw.korea/55476 | - |
dc.description.abstract | Detection of facial landmarks and accurate tracking of their shape are essential in real-time applications such as virtual makeup, where users can see the makeup's effect by moving their face in diverse directions. Typical face tracking techniques detect facial landmarks and track them using a point tracker such as the Kanade-Lucas-Tomasi (KLT) point tracker. Typically, 5 or 64 points are used for tracking a face. Even though these points are enough to track the approximate locations of facial landmarks, they are not sufficient to track the exact shape of facial landmarks. In this paper, we propose a method that can track the exact shape of facial landmarks in real-time by combining a deep learning technique and a point tracker. We detect facial landmarks accurately using SegNet, which performs semantic segmentation based on deep learning. Edge points of detected landmarks are tracked using the KLT point tracker. In spite of its popularity, the KLT point tracker suffers from the point loss problem. We solve this problem by executing SegNet periodically to recalculate the shape of facial landmarks. That is, by combining the two techniques, we can avoid the computational overhead of SegNet and the point loss problem of the KLT point tracker, which leads to accurate real-time shape tracking. We performed several experiments to evaluate the performance of our method and report some of the results herein. | - |
dc.language | English | - |
dc.language.iso | en | - |
dc.publisher | SPRINGER | - |
dc.title | Real-time shape tracking of facial landmarks | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Hwang, Eenjun | - |
dc.identifier.doi | 10.1007/s11042-018-6814-7 | - |
dc.identifier.scopusid | 2-s2.0-85055972784 | - |
dc.identifier.wosid | 000544744600009 | - |
dc.identifier.bibliographicCitation | MULTIMEDIA TOOLS AND APPLICATIONS, v.79, no.23-24, pp.15945 - 15963 | - |
dc.relation.isPartOf | MULTIMEDIA TOOLS AND APPLICATIONS | - |
dc.citation.title | MULTIMEDIA TOOLS AND APPLICATIONS | - |
dc.citation.volume | 79 | - |
dc.citation.number | 23-24 | - |
dc.citation.startPage | 15945 | - |
dc.citation.endPage | 15963 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Software Engineering | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Theory & Methods | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.subject.keywordAuthor | Facial landmarks | - |
dc.subject.keywordAuthor | Real-time tracking | - |
dc.subject.keywordAuthor | SegNet | - |
dc.subject.keywordAuthor | Point tracker | - |
dc.subject.keywordAuthor | Virtual makeup | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
(02841) 서울특별시 성북구 안암로 14502-3290-1114
COPYRIGHT © 2021 Korea University. All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.