Center for Identification Technology Research (CITeR)

Dr. Stephanie Schuckers, Clarkson University DirectorDr. Matt Valenti, West Virginia University, Site DirectorDr. Judee Burgoon, University of Arizona, Site Director

Dr. Venu Govindarajo, University at Buffalo, Site DirectorDr. Arun Ross, Michigan State University (Planned)

July 6, 2016

Center for Identification Technology Research (CITeR)

A National Science Foundation (NSF) Industry/University Cooperative Research Center (IUCRC)

2Research providing insight into the future of ID Technology

http://clarkson.edu/citer/

Working in partnership with our government and industry stakeholders to advance the state of the art

in human identification capabilities through coordinated university research

Multi-University Structure

3

Lead Site, 2011

Founding Site, 2001

Joined, 2006

Joined, 2013

Planning, 2016

Planning, Partnership, 2016

Core Capabilities

4

Security Science

Social Signal Processing

Data Analytics

Computing & Networking

Statistical Frameworks

CITeR Shared Datasets & Tools

Face Iris Finger Tattoo Sketch DNA Keystroke Cardiac

Human Sensing & Acquisition

Feature Extraction

and Processing

Machine Learning

and Analytics

Fusion and Decision Making

Borders Mobile

DefenseHumanitarian

Forensics

Cybersecurity

Identity ManagementApplication Areas

CITeR Current and Committed Affiliates—Spring 2016• Aware• BORDERS• CBSA—Canadian Border Services Agency• DoD—Defense Forensics and Biometrics Agency • DoD—Defense Intelligence Agency• DoD—Research & Engineering Enterprise• DHS—Office of Biometric Identity Management 

(OBIM)• DHS—Science & Technology • Federal Bureau of Investigation

• Laurea Institute• Morphotrak• National Security Agency (2 

organizations)• NexID Biometrics, LLC• Northrop Grumman• Qualcomm• SRC, Inc• STOPSO—Strategic Operational 

Solutions• US Army ARDEC

5

Value Proposition• Research on key challenges• Cross government/industry leveraging

– Projects selected by cross‐government and industry

– Shared research from the problem definition stage increases speed of innovation

– Programs reviewed twice a year in person• Part of National Science Foundation Industry/University Collaborative Research Center (I/UCRC) program for 15 years

I/UCRC Nucleus: A Cooperatively Defined, Funded & Shared Research Portfolio

7

CITeRFaculty Research

AABResearch Needs

I/UCRC Projects

Affiliate Advisory Board (AAB)• Composed of Government And Industry• Votes to determine funded projects • Pulls Next‐Gen ID Technology

CITeR Research Team• Composed of Faculty, 

Researchers, Graduate students, Undergraduates

• Proposes Projects to AAB• Pushes Next‐Gen ID Technology

How does an I/UCRC operate?

CITeRFaculty Research

AABResearch Needs

I/UCRC Projects

What Value Does an IUCRC Offer?

• Industry driven research projects• Investment leveraging via 

cooperative• Networking with industry peers 

and customers• Access to intellectual property• Pre‐publication access to research• World class researchers & 

facilities• Access to students• Technology Transfer• New research and education program 

dimensions• Leveraging of POC results from IUCRC projects

• Trusted relationships with industry• Ready partners for translation of discoveries• Student recruitment, retention and placement 

• Means to achieve institutional mission and meet constituency expectations.

Value to Faculty

Value to AAB

Operations• NSF funds used for administration, marketing, outreach• Affiliate dollars to fund research (not administration)• In Person Program Reviews Twice a Year

• Proposal• Progress Reports• Final Reports

• Between Meetings• Quarterly reports and webinars• Proposal definition• Affiliate‐researcher interactions

Shared research from the problem definition stage increases speed of innovation

How to Engage• $40,000 per year to affiliate

– Applied directly to research– No (0%) overhead – all funds applied directly to research

• Research projects– Projects selected through vote by affiliates – Each project ‐ 12 months, low budget– Meetings twice year for project selection and review– Project oversite by affiliates and NSF– Total research budget of >$800K per year – research budget leveraged amongst affiliates

Contributions to Scientific Literature*

• Over 300 academic publications to date• Lead editors on special journal issues

– Computer Aided Support of the Detection of Deception – Recent Advances in Biometric Systems– Others

• 10+ Best Paper Awards• Most cited publication:

– Anil Jain & Arun Ross, An Introduction to Biometric Recognition, IEEE Transactions on Circuits and Systems, 2004

– Cited 1535 times (Google Scholar)12 *See http://clarkson.edu/citer/research

Authored Books• Encyclopedia of Biometrics, S. Z. Li and A. K. Jain (eds.), Second Edition, 

Springer, 2015.• Jain, Ross, & Nandakumar, Introduction to Biometrics, Springer, 2012.• Schuckers, Computational Methods in Biometric Authentication: Statistical 

Methods for Performance Evaluation, Springer, 2010.• Nelson, America Identified: Society and Biometric Technology,, MIT Press, 

2010.• Maltoni, Maio, Jain, Prabhakar, Handbook of Fingerprints, 2nd Edition, 

Springer 2009.• Jain, Flynn, Ross, Handbook of Biometrics, Springer, 2007.• Ross, Nandakumar, Jain Handbook of Multibiometrics, 2006• Li, Jain (Eds.), Handbook of Face Recognition, Springer Verlag, 2005. • Nunamaker, Romano, & Briggs, Collaboration Systems:  Concepts, Value, 

Use, Series:  Advances in Management Systems, 2014.• Yunqian Ma, Guodong Guo, Support Vector Machines Applications, 2014.• Discovering hidden temporal patterns in behavior and interaction: T‐

pattern detection and analysis with THEME, Magnusson, M., Burgoon, J. K., & Casarrubea, M. (Eds.). New York, NY:  Springer. 2016.

• Social signal processing, Vinciarelli, A., Pantic, M., Magnenat‐Thalmann, N.  & Burgoon, J. K.  (Eds.),. Cambridge, UK: Cambridge University. In Press.

• Face Recognition Across the Imaging Spectrum, T. Bourlai (Ed.), Springer, 2016.

13

Examples: Shared Data and Tools*• Dataset:  Keystroke, 39 subjects, free‐text (CU)• Dataset: Facial Makeup (MSU/WVU)• Dataset:  Tattoo Sketch and Image (MSU)• Dataset:  Mobile Face Spoofing Database (MSU)• Dataset:  Q‐FIRE Cross‐Spectral Face Subset 

(CU)• Competition:  LivDet 2015:  Fingerprint & Iris 

(CU, others)• Tool:  Code for biometric cryptosystem 

implementation (CU)

14*See http://clarkson.edu/citer/resources

Keystroke

Facial Makeup

Tattoo Sketch

Face Spoofs

Cross-Spectral Face

Iris Spoofs Fingerprint Spoofs

Technology Transitions• Fingerprint liveness detection

– 3 patents, 3 applications– Licensed to NexIDBiometrics, LLC

– Clarkson/WVU Start‐up & CITeR Affiliate

• Altered finger detection– Licensed to MorphoTrak, CITeR Affiliate

 

 

Fingerprint Liveness

Altered Finger

Technology Transitions• Scars, marks, and tattoos

– Licensed to MorphoTrak, CITeRAffiliate

• Conjunctival vascular recognition– Licensed to Eyeverify, LLC– Mobile authentication start‐up– Venture capital funded

16

Scars, Marks, & Tattoos

Conjunctival Vascular

Technology Transitions• AVATAR kiosk

• U.S. Patent Application pending, 2015

• Multiple demonstrations, e.g. US Transportation Security Agency, Canada Border Services Agency (CBSA)

Avatar Interview Kiosk

Example CITeR Projects • GPU‐accelerated face analysis to 

automatically capture high‐quality frames– Implementation to be installed at FBI headquarters

• Collection on biometrics in children to study biometric changes with age– Six modalities, multiple years

• Multi‐spectral face/iris and cross‐spectral matching– Shared datasets

Real-time Face Detectionand Quality Analysis

Multi-Spectral FaceBiometrics in Children

Example CITeR Projects • Cardiac radar for biometric 

recognition

Cardiac ECG, PCG, & Radar

Day

Subject

Example CITeR Projects

• Impact of makeup on face recognition– Shared dataset

• Keystroke and computing behavioral patterns– Shared datasets of 39 users, 

multiple lab visits, over 4,000 keystrokes

– Collection ongoing for 100 users on personal laptops, over 100,000 keystrokes

• Biometric Internet of Things– User identification based on 

IoT behavior

Facial Makeup (MSU) Ross, et al

Keystroke (CU) Hou, et al

Biometric Internet of Things (CU) Kantarci, et al

Example CITeR Projects• Algorithms to detect face spoofing

– Shared dataset• Algorithms to detect fingerprint 

spoofing• Shared datasets for fingerprint and iris 

requested by over 100 organizations from 23 countries

• Competitions (LivDet) with independent datasets of live/spoof fingerprint and iris held in 2009, 2011, 2013, 2015

Face Spoofs (MSU) Jain et, al

Fingerprint Spoofs (CU) Schuckers et al

Example CITeR Projects• Dataset:  Cross‐device/cross‐

distance mobile face– Database for 

affiliates/researchers only• Tool for creating representative 

samples of sequestered datasets from public datasets

• Shared software implementation of a biometric cryptosystem– Available on github

Cross-Device/Cross-Distance Mobile Face DBCollected at MILab, WVU (Bourlai, et al)

Representative Sampling, WVU (Culp et al)Implementation a Biometric

Cryptosystem, CU (Liu et al)

Example CITeR Projects• Template protection methods for 

face recognition & secure matching • Development of model for 

improving user perception in involuntary settings– Incorporates privacy, attitude of 

organization, behavioral/cognitive control

• Approach to still to video face recognition– Results on Point and Shoot Challenge 

Database– Participating in NIST V2V Challenge

Secure Face Template Protection & Matching UB (Pandey, et al)

Model of User Perception UA (Wilson et al)Still to Video Face Recognition, WVU (Guo et al)

Challenge Problem WorkshopsExample: Border Security• Held May 31, 2016• Port Tour of Peace Bridge in Buffalo, NY• Speakers from DHS S&T, Customs and Border Protection, Border Patrol, Homeland 

Security Investigations, Canada Border Security Agency• Many challenges identified

– Port of the future—use of mobile/consumer electronics– People in video—faces, activities, crowds– Decision fusion—biometrics, biographics, missing data, system adaptability– DNA as a biometric—next generation challenges– Interactive Biometrics—spoofing, fraud prevention

Workforce Development• 200+ students graduated with Bachelor 

of Science in Biometric Systems from WVU

• 100+ Master’s and Ph.D. students graduated 

• 100+ undergraduates engaged in CITeRresearch

• Students working at FBI, DHS, MITRE, Noblis, NexID, DoD

25

Outreach 2016

• Biometric Aging in Children CITeR project (CU) 5/2016– STEM activities provided for over 600 students 5/2016

• Niagara Falls High School, 6/2016– Hands‐on activities– Careers panel with representatives from DHS, FBI, Northrop, Aware

26

Affiliation and Agreements• Membership fee structure

– Full Affiliate $40,000 per year – Associate Affiliate:  $10,000 per year (small business only)

• No overhead charged on affiliate $$ – ensures that affiliate money goes only fund research

• Patent rights held by university, with royalty free, non‐exclusive rights to center members

• Companies wishing to exercise rights to a royalty‐free license pay for the costs of patent application

• If only one company seeks a license, that COMPANY may obtain an exclusive fee‐bearing license 

• Publication delay policy• Affiliate Advisory Board – one representative from each 

company per membership. 27

Quotes from Affliates*

• “We have used the results from CITeR to plan our findings in new research areas and to direct development programs.”

• “Networking with other affiliates”• “We can narrow the focus of our own directed research based 

on CITeR project results”• “We use applicable CITeR results to inform our S&T Roadmap 

to help determine med to long range goals”• “CITeR has been a great resource that we have leveraged for 

research”• “CITeR brings together top researchers in their field and 

exchanges ideas with each other and the affiliates. This process alone has helped generate new ideas and guide research.“

28*Source: CITeR Affiliate Surveys 2010, 2016

CITeR Contacts• Clarkson University: 

– Dr. Stephanie Schuckers, Director 315.268.6536

– Laura Holsopple, Managing Director – {sschucke, lholsopp}@clarkson.edu 

• West Virginia University: – Dr. Matthew Valenti, Site Director – 304‐293‐9139– matthew.valenti@mail.wvu.edu

• University of Arizona: – Dr. Judee Burgoon, Site Director 

520.621.5818– Dr. Jay Nunamaker, Co‐Director– {jburgoon, 

jnunamaker}@cmi.arizona.edu

• University at Buffalo:Dr. Venu Govindaraju, Site Director 716‐645‐1558venu@cubs.buffalo.edu 

• Michigan State University (planned)Dr. Arun Ross517.353.9731rossarun@cse.msu.edu