A Novel Approach to Mugshot Based Arbitrary View Face Recognition

National Key Laboratory of Fundamental Science on Synthetic Vision,College of Computer Science, Sichuan University, Chengdu 610065, P. R. China(Received November 18, 2015 : revised February 11, 2016 : accepted March 4, 2016)Mugshot face images, routinely collected by police, usually contain both frontal and profile views. Existing automated face recognition methods exploited mugshot databases by enlarging the gallery with synthetic multi-view face images generated from the mugshot face images. This paper, instead, proposes to match the query arbitrary view face image directly to the enrolled frontal and profile face images. During matching, the 3D face shape model reconstructed from the mugshot face images is used to establish corresponding semantic parts between query and gallery face images, based on which comparison is done. The final recognition result is obtained by fusing the matching results with frontal and profile face images. Compared with previous methods, the proposed method better utilizes mugshot databases without using synthetic face images that may have artifacts. Its effectiveness has been demonstrated on the Color FERET and CMU PIE databases. Keywords : Mugshot-based face recognition, Arbitrary view face recognition, Three-dimensional face reconstructionOCIS codes : (100.5010) Pattern recognition; (100.0100) Image processing; (100.3008) Image recognition, algorithms and filters; (100.6890) Three-dimensional image processing