Face Recognition from Multiple Stylistic Sketches: Scenarios, Datasets, and Evaluation
Matching a face sketch against mug shots, which plays an important role in law enforcement and security, is an interesting and challenging topic in face recognition community. Although great progress has been made in recent years, main focus is the face r
- PDF / 1,520,945 Bytes
- 16 Pages / 439.37 x 666.142 pts Page_size
- 94 Downloads / 214 Views
Abstract. Matching a face sketch against mug shots, which plays an important role in law enforcement and security, is an interesting and challenging topic in face recognition community. Although great progress has been made in recent years, main focus is the face recognition based on SINGLE sketch in existing studies. In this paper, we present a fundamental study of face recognition from multiple stylistic sketches. Three specific scenarios with corresponding datasets are carefully introduced to mimic real-world situations: (1) recognition from multiple handdrawn sketches; (2) recognition from hand-drawn sketch and composite sketches; (3) recognition from multiple composite sketches. We further provide the evaluation protocols and several benchmarks on these proposed scenarios. Finally, we discuss the plenty of challenges and possible future directions that worth to be further investigated. All the materials will be publicly available online (Available at http://chunleipeng.com/ FRMSketches.html.) for comparisons and further study of this problem. Keywords: Face recognition Fusion
1
·
Viewed sketch
·
Composite sketch
·
Introduction
In criminal investigation, face sketch recognition is an essential technique for real-world situations when the photo of the suspect is unavailable or is captured under poor quality. A face sketch is usually generated by the forensic artist [40] or facial composite software [10] based on the information provided by an eyewitness, victim, or poor quality surveillance videos. The sketch is the only clue to identify the suspect. Due to the large domain gap between face sketches and photos, face recognition from a probe sketch remains a challenging and prevalent topic in the community. The technique of matching a face sketch against photos has been extensively studied in recent years. Existing approaches can be generally classified into four categories based on the types of sketches used: hand-drawn viewed sketch [36,40], hand-drawn semi-forensic sketch [5,25], hand-drawn forensic sketch [15,16,30], and software-generated composite sketch [10]. Early study mainly focuses on c Springer International Publishing Switzerland 2016 G. Hua and H. J´ egou (Eds.): ECCV 2016 Workshops, Part I, LNCS 9913, pp. 3–18, 2016. DOI: 10.1007/978-3-319-46604-0 1
4
C. Peng et al.
viewed sketch, which is drawn by viewing the photo directly. Because the viewed sketch is relatively reliable for identifying the subject, saturated performance [7,29–31,41,42] has been achieved on the viewed sketch benchmark (CUHK face sketch database, CUFS [40]). However, face sketches are usually unreliable in real-world situations due to the domain gap caused by perceptual bias, descriptive bias, and generating bias [24,25]. In order to better understand face sketch recognition in real-worlds, semi-forensic sketch is introduced recently, which is drawn based on the recall of the artist after viewing the photo a few minutes ago. Models trained on semi-forensic sketches have shown their possibility to improve face sketch rec
Data Loading...
