FREE ELECTRONIC LIBRARY - Dissertations, online materials

Pages:   || 2 | 3 | 4 | 5 |   ...   | 6 |

«Three-Dimensional Face Recognition ∗ Alexander M. Bronstein, Michael M. Bronstein and Ron Kimmel Department of Computer Science Technion – Israel ...»

-- [ Page 1 ] --

Three-Dimensional Face Recognition ∗

Alexander M. Bronstein, Michael M. Bronstein and Ron Kimmel

Department of Computer Science

Technion – Israel Institute of Technology, Haifa 32000, Israel

First version: May 18, 2004; Second version: December 10, 2004.


An expression-invariant 3D face recognition approach is presented. Our basic

assumption is that facial expressions can be modelled as isometries of the facial

surface. This allows to construct expression-invariant representations of faces using the canonical forms approach. The result is an efficient and accurate face recognition algorithm, robust to facial expressions that can distinguish between identical twins (the first two authors). We demonstrate a prototype system based on the proposed algorithm and compare its performance to classical face recognition methods.

The numerical methods employed by our approach do not require the facial surface explicitly. The surface gradients field, or the surface metric, are sufficient for constructing the expression-invariant representation of any given face. It allows us to perform the 3D face recognition task while avoiding the surface reconstruction stage.

Keywords: expression-invariant 3D face recognition, isometry invariant, facial ex- pressions, multidimensional scaling.

1. Introduction Automatic face recognition has been traditionally associated with the fields of computer vision and pattern recognition. Face recognition is considered a natural, non-intimidating, and widely accepted biometric identification method (Ashbourn, 2002; Ortega-Garcia et al., 2004). As such, it has the potential of becoming the leading biometric technology.

Unfortunately, it is also one of the most difficult pattern recognition problems. So far, all existing solutions provide only partial, and usually unsatisfactory, answers to the market needs.

In the context of face recognition, it is common to distinguish be- tween the problem of authentication and that of recognition. In the first case, the enrolled individual (probe) claims identity of a person whose template is stored in the database (gallery). We refer to the data used for a specific recognition task as a template. The face recognition algorithm needs to compare a given face with a given template and ∗ This research was partially supported by Dvorah Fund of the Technion, the Bar Nir Bergreen Software Technology Center of Excellence and the Technion V.P.R.

Fund - E. and J. Bishop Research Fund.

c 2004 Kluwer Academic Publishers. Printed in the Netherlands.

"IJCV - second review - 3".tex; 14/12/2004; 20:14; p.1 2 Michael M. Bronstein, Alexander M. Bronstein, Ron Kimmel verify their equivalence. Such a setup (one-to-one matching) can occur when biometric technology is used to secure financial transactions, for example, in an automatic teller machine (ATM). In this case, the user is usually assumed to be collaborative.

The second case is more difficult. Recognition implies that the probe subject should be compared with all the templates stored in the gallery database. The face recognition algorithm should then match a given face with one of the individuals in the database. Finding a terrorist in a crowd (one-to-many matching) is one such application. Needless to say, no collaboration can be assumed in this case. At current technological level, one-to-many face recognition with non-collaborative users is practically unsolvable. That is, if one intentionally wishes not to be recognized, he can always deceive any face recognition technology. In the following, we will assume collaborative users.

Even collaborative users in a natural environment present high variability of their faces – due to natural factors beyond our control. The greatest difficulty of face recognition, compared to other biometrics, stems from the immense variability of the human face. The facial appearance depends heavily on environmental factors, for example, the lighting conditions, background scene and head pose. It also depends on facial hair, the use of cosmetics, jewelry and piercing. Last but not least, plastic surgery or long-term processes like aging and weight gain can have a significant influence on facial appearance.

Yet, much of the facial appearance variability is inherent to the face itself. Even if we hypothetically assume that external factors do not exist, for example, that the facial image is always acquired under the same illumination, pose, and with the same haircut and make up, still, the variability in a facial image due to facial expressions may be even greater than a change in the person’s identity (see Figure 1).

Face recognition with varying lighting, head pose, and facial Figure 1.

expression is a non-trivial task.

–  –  –

1.1. Two-dimensional face recognition: Invariant versus generative approaches Trying to make face recognition algorithms insensitive to illumination, head pose, and other factors mentioned above is one of the main efforts of current research in the field. Broadly speaking, there are two alternatives in approaching this problem. One is to find features that are not affected by the viewing conditions; we call this the invariant approach. Early face recognition algorithms advocated the invariant approach by finding a set of fiducial points such as eyes, nose, mouth, etc. and comparing their geometric relations (feature-based recognition) (Bledsoe, 1966; Kanade, 1973; Goldstein et al., 1971) or comparing the face to a whole facial template (template-based recognition) (Brunelli and Poggio, 1993).

It appears, however, that very few reliable fiducial points can be extracted from a 2D facial image in the presence of pose, illumination, and facial expression variability. As the result, feature-based algorithms are forced to use a limited set of points, which provide low discrimination ability between faces (Cox et al., 1996). Likewise, templates used in template matching approaches change due to variation of pose or facial expression (Brunelli and Poggio, 1993). Using elastic graph matching (Wiskott, 1995; Wiskott et al., 1997) as an attempt to account for the deformation of templates due to flexibility of the facial surface has yielded limited success since the attributed graph is merely a flat representation of a curved 3D object (Ortega-Garcia et al., 2004).

Appearance-based methods that treat facial images as vectors of a multidimensional Euclidean space and use standard dimensionality reduction techniques to construct a representation of the face (eigenfaces (Turk and Pentland, 1991) and similar approaches (Sirovich and Kirby, 1987; Hallinan, 1994; Pentland et al., 1994)), require accurate registration between facial images. The registration problem brings us back to identifying reliably fiducial points on the facial image independently of the viewing conditions and the internal variability due to facial expressions. As a consequence, appearance-based methods perform well only when the probe image is acquired in conditions similar to those of the gallery image (Gheorghiades et al., 2001).

The second alternative is to generate synthetic images of the face in new, unseen conditions. Generating facial images with new pose and illumination requires some 3D facial surface as an intermediate stage. It is possible to use a generic 3D head model (Huang et al., 2002), or estimate a rough shape of the facial surface from a set of observations (e.g. using photometric stereo (Georghiades et al., 1998;

Gheorghiades et al., 2001)) in order to synthesize new facial images and "IJCV - second review - 3".tex; 14/12/2004; 20:14; p.3 4 Michael M. Bronstein, Alexander M. Bronstein, Ron Kimmel then apply standard face recognition methods like eigenfaces (Sirovich and Kirby, 1987; Turk and Pentland, 1991) to the synthetic images.

Yet, facial expressions appear to be more problematic to synthesize.

Approaches modelling facial expressions as warping of the facial image do not capture the true geometric changes of the facial surface, and are therefore useful mainly for computer graphics applications. That is, the results may look natural, but fail to represent the true nature of the expression.

Figure 2 shows a simple visual experiment that demonstrates the generative approach. We created synthetic faces of Osama Bin Laden (Figure 2c) and George Bush (Figure 2d) in different poses by mapping the respective textures onto the facial surface of another subject (Figure 2a,b). The resulting images are easily recognized as the world number one terrorist and the forty third president of the United States, though in both cases, the facial geometry belongs to a completely different individual. This is explained by the property of the human visual system, which uses mainly the 2D information of the face to perform recognition.

–  –  –

Figure 2. Simple texture mapping on the same facial surface can completely change the appearance of the 2D facial image and make the same face look like George Bush or Osama Bin Laden.

Simple texture mapping in our experiment allowed to create naturallylooking faces, yet, the individuality of the subject concealed in the 3D geometry of his face was completely lost. This reveals the intrinsic weakness of all the 2D face recognition approaches: the face is a 3D object, and using only its 2D projection can be misleading. Exaggerating this example, if one had the ability to draw any face on his facial surface,

–  –  –

he could make himself look essentially like any person and deceive any 2D face recognition method. Practically, even with very modest instruments, makeup specialists in the theater and movie industry can change completely the facial appearance of actors.

1.2. Three-dimensional face recognition Three-dimensional face recognition is a relatively recent trend that in some sense breaks the long-term tradition of mimicking the human visual recognition system, like the 2D methods attempt to do. As evaluations such as the Face Recognition Vendor Test (FRVT) demonstrate in an unarguable manner that current state of the art in 2D face recognition is insufficient for high-demanding biometric applications (Phillips et al., 2003), trying to use 3D information has become an emerging research direction in hope to make face recognition more accurate and robust.

Three-dimensional facial geometry represents the internal anatomical structure of the face rather than its external appearance influenced by environmental factors. As the result, unlike the 2D facial image, 3D facial surface is insensitive to illumination, head pose (Bowyer et al., 2004), and cosmetics (Mavridis et al., 2001). Moreover, 3D data can be used to produce invariant measures out of the 2D data (for example, given the facial surface, the albedo can be estimated from the 2D reflectance under assumptions of Lambertian reflection).

However, while in 2D face recognition a conventional camera is used, 3D face recognition requires a more sophisticated sensor, capable of acquiring depth information – usually referred to as depth or range camera or 3D scanner. The 3D shape of the face is usually acquired together with a 2D intensity image. This is one of the main disadvantages of 3D methods compared to 2D ones. Particularly, it prohibits the use of legacy photo databases, like those maintained by police and special agencies.

Early papers on 3D face recognition revealed the potential hidden in the 3D information rather than presented working algorithms or extensive tests. In one of the first papers on 3D face recognition, Cartoux et al. (1989) approached the problem by finding the plane of bilateral symmetry through the facial range image, and either matching the extracted profile of the face, or using the symmetry plane to compensate for the pose and then matching the whole surface. Similar approaches based on profiles extracted from 3D face data were also described in the follow-up papers by Nagamine et al. (1992), Beumier and Acheroy (1988) and Gordon (1997).

"IJCV - second review - 3".tex; 14/12/2004; 20:14; p.5 6 Michael M. Bronstein, Alexander M. Bronstein, Ron Kimmel Achermann et al. (1997), Hesher et al. (2003), Mavridis et al. (2001), Chang et al. (2003) Tsalakanidou et al. (2003) explored the extension of conventional dimensionality reduction techniques, like Principal Component Analysis (PCA), to range images or combination of intensity and range images. Gordon (1992) proposed representing a facial surface by a feature vector created from local information such as curvature and metric. The author noted that the feature vector is similar for different instances of the same face acquired in different conditions, except “variation due to expression” (Gordon, 1992).

Lee and Milios (1990) and Tanaka et al. (1998) proposed performing curvature-based segmentation of the range image into convex regions and compute the Extended Gaussian Image (EGI) locally for each region. A different local approach based on Gabor filters in 2D and point signatures in 3D was presented by Wang et al. (2002).

Finally, many theoretical works including Medioni and Waupotitsch (2003), Achermann and Bunke (2000), as well as some commercial systems, use rigid surface matching in order to perform 3D face recognition. However, facial expressions do change significantly the 3D facial surface not less than they change the 2D intensity image, hence modelling faces as rigid objects is invalid when considering facial expressions.

We note that the topic of facial expressions in 3D face recognition is very scarcely addressed in the literature, which makes difficult to draw any conclusions about the robustness of available algorithms. Many of the cited authors mention the problem of facial expressions, yet, none of them has addressed it explicitly, nor any of the algorithms except in Wang et al. (2002) was tested on a database with sufficiently large (if any) variability of facial expressions.

1.3. The 3DFACE approach

Pages:   || 2 | 3 | 4 | 5 |   ...   | 6 |

Similar works:

«Finding the Freedoms of Contemporary Free Verse Allison Porzio Most days Johnny holds the anger inside. He looks like any other teen with baggy jeans and a beat-up white shirt, but he is bigger than most, as though the anger puffs up his stomach with hot air, and waits to escape. I met Johnny one day while working in the local YMCA teen center. He played alone, leaning over the pool table, hitting balls into the pockets at random, not even using the cue ball. “Where do you go to school?” I...»

«ANNUAL REPORT 2014-2015 WESTERN PROVINCE CRICKET CLUB 146 Campground Road, Newlands, 7700, Cape Town, South Africa Newlands Office: +27 (0)21 657 3300 • Ave de Mist Office: +27 (0)21 657 3330 Email: members@wpcc.co.za • www.wpcc.co.za OFFICE BEARERS PRESIDENT Dr. Andrew Golding VICE PRESIDENTS G Anderson, JA Arenhold, DFJ Becker, BS Biebuyck, JJ Bisset, PM Burton JJ Coates, L De Waal, RF Delport, CH Kuhn, AK Lacey, WW Low, BT Michell, JD Nel, SM Nortier, GG Philipps, BM Risien, TP Smith, M...»

«Handshaking between Software Projects and Stakeholders Using Implementation Proposals Samuel Fricker1,2, Tony Gorschek3, and Petri Myllyperkiö 4 1 ABB Switzerland Ltd., Corporate Research, Segelhof, 5405 Baden-Daettwil, Switzerland samuel.fricker@ch.abb.com 2 University of Zurich, Department of Informatics, Binzmuehlestrasse 14, 8057 Zurich, Switzerland fricker@ifi.unizh.ch 3 Blekinge Institute of Technology, School of Engineering, PO Box 520, 372 25 Ronneby, Sweden tony.gorschek@bth.se 4 ABB...»

«Economic Development Strategy for Regional NSW January 2015 Economic Development Strategy for Regional NSW Published by NSW Department of Trade and Investment, Regional Infrastructure and Services Economic Development Strategy for Regional NSW First published February 2015 ISBN: 978 1 74256 703 7 More information www.trade.nsw.gov.au/regional-opportunities Cover Photo Credit: Paul Foley © State of New South Wales through the Department of Trade and Investment, Regional Infrastructure and...»

«MARINE INVESTIGATION REPORT M04L0092 GROUNDING CONTAINER SHIP HORIZON SAINTE-ANNE-DE-SOREL, QUEBEC 24 JULY 2004 The Transportation Safety Board of Canada (TSB) investigated this occurrence for the purpose of advancing transportation safety. It is not the function of the Board to assign fault or determine civil or criminal liability. Marine Investigation Report Grounding Container Ship Horizon Sainte-Anne-de-Sorel, Quebec 24 July 2004 Report Number M04L0092 Summary In the early morning hours of...»

«Vietnamese and English consonants 1 HO CHI MINH CITY UNIVERSITY OF EDUCATION ENGLISH DEPARMENT CONTRASTIVE ANALYSIS VIETNAMESE AND ENGLISH CONSONANTS THROUGH THE EXTRACT Instructor: NGUYEN NGOC VU Student: VO THI CAN Class: 5CQBT DECEMBER 28, 2009 Vietnamese and English consonants 2 The Vietnamese extract: ñang t a lan Khi có m t cơn bão b t thình lình th i ngoài khơi,m t thi u n can tàu m t thăng b ng và b h t ra kh i tàu. T c thì có m t ngư i nh y xu ng nh ng ñ t sóng c nh...»

«ASEN 5367 Comparison of Tetrahedral and Brick Elements for Linear Elastic Analysis Term Project AFEM Spring 2006 Date: 05/09/2006 Submitted to: Professor Carlos A. Felippa By Jochen Carl Dana Müller-Hoeppe Morgan Meadows 1 ABSTRACT In this term paper, the performances of elastic solid continuum finite elements are compared modeling both hexagonal and tetrahedral meshes. Elements with linear and quadratic shape functions are used to model three different tests. The first test is a clamped...»

«Report of the 2nd Future Earth Regional Workshop for Africa University of Pretoria Pretoria, South Africa 23 – 24 June 2014 Organised by Hosted by Funded by Workshop chair: Rungano Karimanzira Ministry of Higher and Tertiary Education, Science and Technology Development Zimbabwe 0 Table of Contents Introduction and Objectives Key Outcomes Observations Roles of the key stakeholders Academic Institutions Research institutions Academies of Science ICSU Members and Regional Alliance Members...»

«Instrument Inversion in Zulu Jochen Zeller University of KwaZulu-Natal, Durban, South Africa 1. Introduction ∗ A prominent feature of Bantu languages is the existence of so-called inversion constructions in which the logical subject (an agent or theme NP) appears post-verbally, while the pre-verbal grammatical subject position is occupied by an argument ranked lower on the thematic hierarchy. A well-known example is locative inversion, illustrated by the Chicheŵa sentence in (1b) (see e.g....»

«Dementia Behaviour Management Advisory Service (DBMAS) Vic. 1800 699 799 24 hour Freecall ™ Child Representational Therapy in Dementia Care January 2010 Dementia Behaviour Management Advisory Service (DBMAS) Vic Child Representational Therapy in Dementia Care Effective Dressing in Dementia Care May 2009 CONTENTS CLINICAL PRACTICE GUIDELINES FOR THE USE OF CHILD REP. THERAPY Definition Therapeutic goals Indications for the use of this therapy Individuals most likely to benefit from this form...»

«Chemical Thinning and Application Technology FUTURE ORCHARDS 2012 ORCHARD WALK NOTES SEPT 2007 Prepared by J Wilton AGFIRST HB Ltd. AUGUST 2007 Good chemical thinning strategies play a critical role in efficient, sustainable pipfruit production. Chemical thinning is as much art as science. The art is pulling together all of the orchard, variety, environmental and weather factors that can influence chemical thinning results so that consistent results can be achieved. Biennial Bearing Widespread...»

«Manual do Usuário Certificado Digital AC PRODERJ Guia CD-18 Público Índice 1. Emissão dos Certificados Digitais PRODERJ 2. Documentos Necessários para Emissão dos Certificados 3. Responsabilidades 4. Como instalar o Gerenciador do token 5. Como utilizar o Gerenciador SafeSign 5.1. Operações de Usuário 5.1.1. Alterar PIN 5.2.2 Alterar PUK 5.2.3 Destravar PIN 6. Agendamento da Validação Presencial para emissão do certificado digital. 7. Instalando a Cadeia de Certificados 8. Testando...»

<<  HOME   |    CONTACTS
2016 www.dissertation.xlibx.info - Dissertations, online materials

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.