Detailed Information

Cited 0 time in webofscience Cited 0 time in scopus
Metadata Downloads

Matching Composite Sketches to Face Photos: A Component-Based Approach

Authors
Han, HuKlare, Brendan F.Bonnen, KathrynJain, Anil K.
Issue Date
1월-2013
Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Keywords
Component-based face representation; composite sketch; face recognition; forensic sketch; heterogeneous face recognition; modality gap
Citation
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, v.8, no.1, pp.191 - 204
Indexed
SCIE
SCOPUS
Journal Title
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY
Volume
8
Number
1
Start Page
191
End Page
204
URI
https://scholar.korea.ac.kr/handle/2021.sw.korea/104287
DOI
10.1109/TIFS.2012.2228856
ISSN
1556-6013
Abstract
The problem of automatically matching composite sketches to facial photographs is addressed in this paper. Previous research on sketch recognition focused on matching sketches drawn by professional artists who either looked directly at the subjects (viewed sketches) or used a verbal description of the subject's appearance as provided by an eyewitness (forensic sketches). Unlike sketches hand drawn by artists, composite sketches are synthesized using one of the several facial composite software systems available to law enforcement agencies. We propose a component-based representation (CBR) approach to measure the similarity between a composite sketch and mugshot photograph. Specifically, we first automatically detect facial landmarks in composite sketches and face photos using an active shape model (ASM). Features are then extracted for each facial component using multiscale local binary patterns (MLBPs), and per component similarity is calculated. Finally, the similarity scores obtained from individual facial components are fused together, yielding a similarity score between a composite sketch and a face photo. Matching performance is further improved by filtering the large gallery of mugshot images using gender information. Experimental results on matching 123 composite sketches against two galleries with 10,123 and 1,316 mugshots show that the proposed method achieves promising performance (rank-100 accuracies of 77.2% and 89.4%, respectively) compared to a leading commercial face recognition system (rank-100 accuracies of 22.8% and 52.0%) and densely sampled MLBP on holistic faces (rank-100 accuracies of 27.6% and 10.6%). We believe our prototype system will be of great value to law enforcement agencies in apprehending suspects in a timely fashion.
Files in This Item
There are no files associated with this item.
Appears in
Collections
Graduate School > Department of Brain and Cognitive Engineering > 1. Journal Articles

qrcode

Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.

Altmetrics

Total Views & Downloads

BROWSE