COST-275, Halsmtad 03COST-275, Halsmtad 03

11/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

Biometrics Research Lab. /ATVS

Universidad Politecnica de Madrid

www.atvs.diac.upm.es

Javier Ortega-Garcia, PhD

Towards a “Chimeric” Towards a “Chimeric” Super-Database involving Super-Database involving

XM2VTS, MCYT and BIOMET XM2VTS, MCYT and BIOMET databasesdatabases

Towards a “Chimeric” Towards a “Chimeric” Super-Database involving Super-Database involving

XM2VTS, MCYT and BIOMET XM2VTS, MCYT and BIOMET databasesdatabases

COST-275, Halsmtad 03COST-275, Halsmtad 03

22/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

Motivation and Needs

Lack of large-scale (100s) fully multimodal databases

Ever-growing importance of multimodal biometric research

No common evaluation corpus and framework

«Construction» (definition/design, organization, protocol, production…) of a chimeric (imaginary individuals) super-database

Exploiting 3 large-scale existing databases: XM2VTS, MCYT, BIOMET

Most of the groups integrated under COST-275

COST-275, Halsmtad 03COST-275, Halsmtad 03

33/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

XM2VTS DatabaseUniversity of Surrey + IDIAP

295 individuals, 4 sessions, 2 shots per session

High quality digital video (+ audio) sequences

1st shot: Frontal image + speaking 3 common sentences

2nd shot: Head movemets

Clearly stablished protocol: training, evaluation (thresholding), testing

Strong points: large-scale, multi-session, face recognition-oriented, 3D face analysis, face profiling, lip movements, audio/video sync.

Lacks: less speech, common read sentences; no other modalities

COST-275, Halsmtad 03COST-275, Halsmtad 03

44/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

MCYT DatabaseSpanish Universities (National Project): Technical Univ. of

Madrid + School of EE at Mataró (Barcelona) + Univ. of Basque Country + Univ. of Valladolid.

332 individuals, 1 session, distributed collection (4 groups)

On-line signature: graphics tablet-based, high quality; each individual: 25 authentic (in separate sets of 5) and 25 high-skilled forgeries.

Fingerprints: 10 fingers per individual, 12 samples per sensor, 2 sensors (capacitive and optical), 3 levels of core position control in acquisition.

Strong points: large-scale, multi-site, written samples of signatures (valid for off-line purposes), inter-sensor variabilty of fingerprints, manual labelling of fingerprint subset (75 individuals, 9,000 samples) quality (14 quality categories)

Lacks: no multi-session (multisession subset currently under design); no other modalities

COST-275, Halsmtad 03COST-275, Halsmtad 03

55/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

BIOMET DatabaseFrench GET (ENST, INT, EURECOM)

131 individuals, 3 sessions

Modalities: Face, speech, on-line signature, fingerprints, hand shape

Hand shape: 1 image of left hand (optical scanner)

Fingerprints: index+middle fingers, right hand, 1 sample

On-line signature: 5 genuine + 5 (shape-based) forgeries

Digital video sequence: speech (french, digit-strings + 12 sentences) + face movements

Strong points: multimodality, multi-session, also face images (still) with infrared illumination, 3D face acquisition

Lacks: not so large-scale, no unified multimodal acquisition scenario

COST-275, Halsmtad 03COST-275, Halsmtad 03

66/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

Design Key Issues (preliminary)

XM2VTS: large, multisession, face rec.MCYT: large, single-session, on-line signature and

fingerprintsBIOMET: medium, multisession, multimodal, hand

geometrySpeech? Using of English XM2VTS, French BIOMET

and Spanish AHUMADA; read short sentences and digit strings

About 100 multimodal chimeric individualsData oriented to basic biometric recognitionControled intravariabiltiy problems (still frontal faces,

centered fingerprints, …)Production and disseminations costs (COST-275, 3

k€)Distribution issues (COST, ELDA, …)

COST-275, Halsmtad 03COST-275, Halsmtad 03

77/7/7Javier Ortega-Garcia / BRL UPMJavier Ortega-Garcia / BRL UPM

Workprogramme

Super-database proposal: Rome (Nov-02)

Exact description of each database (Feb-03)

Definition of super-database (March-03)

Def. of a common assessment protocol (Apr-03)

Discussion about definition and protocol (May-03)

Structure, organization, indexing of data (June-03)

Production (July-03)

Dissemination efforts (> July 2003)