University at Buffalo
Center for Unified Biometrics and
Sensors
March 2011
Overview
• Unique Capabilities
• Sponsors – Biometrics projects at CUBS
• Technology Transfer Record
• Current Leveraged Projects
• People – Faculty, Staff, Students
• Biometrics Community Leadership
Unique Capabilities
• Faculty strengths in multiple disciplines
• Behavioral Sciences, Social Issues
• Computer Vision, Visualization
• Chemical and Biological Sensors
• Pattern Recognition, Machine Learning
• Smart Environments, Pervasive Computing
• Spectroscopy
• Solid record of transferring of technology to field
• Large pool of current PhD students
• Growing pool of PhD alumni in industry
• Several current projects with industry
Sponsors(last 5 years)
• ACIS, Buffalo, NY
• Applied Media Analysis, College Park, MD
• BBN Technologies, Cambridge, MA
• Buffalo Computer Graphics, Blasdell, NY
• CUBRC, Cheektowaga, NY
• Fujitsu, Sunnyvale, CA
• HP Labs, India
• Health Transaction Network, Williamsville, NY
• Matrix, Niagara Falls, NY
• Ultra-Scan, Amherst, NY
• Army Research Labs
• Defense Intelligence Agency (DIA)
• Directorate of Central Intelligence (DCI)
• National Endowment of Humanities (NEH)
• National Science Foundation (NSF)
• NYSTAR
• Oishei Foundation
Technology Transfer
"USPS issued a contract to SUNY Buffalo to develop the handwriting recognition technology. ….. an estimated 400 million pieces of mail were automatically routed ….. saved the Postal Service at least $90 million in its first year in the field.
4 US patents awardedBiometric convolution; Handwriting comparisons; Diagnosis of physiological states; Handwriting recognition
4 US patents pending
Licensed technology to industry
Fingerprint hashing; Deceit and verity; Document classification; Document Imagecapture
Kyos Systems, Xact Data, Buffalo Computer Graphics, Lockheed Martin
USPS 1999 Annual Report
Current ProjectsLeveraged
1. Anthropometry
2. Cryptography
3. Fingerprint Indexing
4. Fusion
5. Handwriting Forensics
6. People Tracking
7. Lip Reading, Gaze Tracking
8. Sensors
9. Soft Biometrics
10.Web Security
Anthropometrics
Type
Description Hair and eye color
I very light, also "Celtic" Tends to have freckles, red or blond hair, blue or green eyes.
II light, or light-skinned European Tends to have light hair, blue/green or brown eyes.
III light intermediate, or dark-skinned European or "average Caucasian"
Tends to have brown hair and eyes.
IV intermediate, also Mediterranean or Olive
Tends to have dark brown eyes and hair.
V dark or Brown Often has dark brown eyes and hair.
VI very dark, or Brown-Black Usually has black-brown eyes and hair.
SKIN TONE
CryptographyCancelable Biometrics
Fingerprint verification
Image
Image
Fingerprint enrollment
Minutiae
Minutiae
h , h11 12
h , h21 22
h' , h'11 12
h' , h'21 22
Hashes
Hashes
FingerprintHash
Database
Store
Match
Fingerprint Indexing
Enrollment PhaseSearching Phase
Fusion
Handwriting Forensics
Lip Reading, Gaze Tracking
Did Bob and Frank meet at the library yesterday?Given building map, occupants, schedules, sensor locations
Unobtrusive People TrackingFreedom from Continuous Surveillance
RECOGNIZE
RETRIEVE
REASON Evolutiona
ryRecognitio
n
SensorsSkin spectroscopy and “liveness”
Soft BiometricsAge Estimation
Soft BiometricsExpressions
Facial Expression Manifold
FACS
FEAR
HAPPY
ANGER
SAD
+ + =
AU 1 AU 2 AU 4 AU 1, 2 & 4
+ =
AU 6 AU 12 AU 6 & 12
+ + =
AU 1 AU 4 AU 15 AU 1, 4 & 15
FEAR
HAPPY
SAD
Soft BiometricsEmotional States
Soft BiometricsSemantic Face Retrieval
Original Set Q: The suspect is male 1st
Iteration
Pruned SetQ: The suspect has a beard 2nd
Iteration
Pruned Set 3rd Iteration
SUSPECT
Q: The suspect wears spectacles
Soft Biometrics
Crash scene analysis
Web SecurityVerify humanness
English!
MACHINES FAIL
HUMANS SUCCEED
Synthetic handwriting generator poses questions in varying writing styles
PeopleFaculty
Venu GovindarajuSUNY Distinguished
ProfessorMachine LearningDirector
Atri RudraAssistant ProfessorCryptography, Coding theory
Raymond FuAssistant
ProfessorComputer Vision,
Visualization
Mark FrankProfessorBehavioral Sciences
Frank BrightSUNY Distinguished ProfessorBiological, Chemical Sensors
Alex CartwrightProfessorSpectroscopy, Photonics
PeopleStaff
• Amal HarbCommunications SpecialistInformatics, Psychology
• Ifeoma NwoguResearch Scientist
Computer Vision, Ontology
• Zhixin ShiSenior Research ScientistMathematics
• Philip KilinskasSoftware Engineer
Systems
• Ranga SetlurPrincipal Research ScientistPattern Recognition Systems
• Sergey Tulyakov Research Scientist
Biometrics Fusion
PeopleCurrent PhD students; Research topics
• Xi Cheng Biometric Fusion
• Gaurav Kumar Mobile Device Apps
• Utkarsh Poruwal People Tracking
• Chetan Ramaiah Writer Identification
• Manavender Reddy Gesture Recognition
• Ricardo N. Rodriguez Multimodal Fusion
• Arti Shivaram Mobile Device Apps
• Safwan Wshah Arabic Handwriting Recognition
• Daekeun You Medical Analytics
• Yingbou Zhou Image Segmentation
Ph.D. Alumni (20)2010 X. Peng Raytheon - BBN Technologies, MA
2010 A. Bhardwa Ebay, CA
2010 A. O. Thomas Yahoo! Research, CA
2009 I. Nwogu University of Rochester, NY
2009 J. Li University of Memphis, TN
2008 Z. Zhang IBM, NY
2008 H. Cao Raytheon - BBN Technologies
2008 R. V. Yampoliskiy University of Louisville, KY
2008 F. Farooq Siemens Medical Solutions, PA
2008 P. Mansukhani L1 Biometrics, NJ
2007 A. Rusu Fairfield University, CT
2007 C. Wu Digital Persona, CA
2007 S. Kompalli HP, India
2006 R. Milewski Tokyo University, Japan
2006 S. Tulyakov University at Buffalo, NY
2005 T. Jea IBM, NY
2005 H. Lei University of N. Texas, Brownsville, TX
2003 A. Teredesai University of Washington, Tacoma, WA
2002 H. Xue IBM, NY
2001 I. Krassimir Fair Isaac Inc.
Leadershipin Biometrics Community
Program ChairCVPR Biometrics Workshop Series 2006-2011
Program Co-ChairBiometrics: Theory, Applications, and Systems, BTAS 2007-2008
General ChairAutomatic Identification Advanced Technologies AutoID 05
Program CommitteeBTAS 2008-10, Biometric Symposium 2006-08, International Conference on Biometrics, 2007, SPIE Biometric Technology for Human Identification2009-10, International Joint Conference on Biometrics, 2011
IEEE Biometric Council Website Initiative 2011 Website Design, Construction, Hosting, and Maintenance
Contact
Venu Govindaraju
University at Buffalo
State University of New York