19
出出Signal Processing and Communications Applications, 2006 IEEE 出出Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 111/06/10 1 出出出出 出出出 出出 出出出 出出M97G0209

出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Embed Size (px)

Citation preview

Page 1: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

出處: Signal Processing and Communications Applications, 2006 IEEE

作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin

112/04/20 1

指導教授:張財榮學生:陳建宏學號: M97G0209

Page 2: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

OUTLINE

Introduction

Hand Gesture Recognition

Experimental Results

Conclusion

112/04/20 2

Page 3: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Introduction

Vision-based automatic hand gesture recognition

Human computer interaction

Robot control

Sign language interpretation

112/04/20 3

Page 4: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Introduction

Visual gesture recognition

112/04/20 4

Page 5: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Introduction

Chinese Sign Language Recognition Based on Gray-Level Co-Occurrence Matrix and Other Multi-features Fusion

112/04/20 5

Page 6: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Introduction

A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation

112/04/20 6

Page 7: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Introduction

The general problem

complex static and dynamic hand gestures

complex background

occlusions

112/04/20 7

Page 8: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Introduction

Our focus the recognition of a fixed set of manual commands by a robot

112/04/20 8

Page 9: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Hand Gesture Recognition

Localizing Hand-like Regions by Skin Detection

Segmentation and False-Region Elimination

Finding the Centroid and Farthest Distance

Constructing a Circle

Extracting a 1D Signal and Classifilcation

112/04/20 9

Page 10: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Localizing Hand-like Regions by Skin Detection

red/green (R/G) ratio is a discriminative characteristic feature for human skin color

112/04/20 10

Page 11: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Localizing Hand-like Regions by Skin Detection

skin thresholds Resulting in a black and white image output

112/04/20 11

Page 12: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Segmentation and False-Region Elimination

Our assumption the largest connected white region corresponds to the hand

Threshold : 20% of total white parts

112/04/20 12

70%

19%

11%

Page 13: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Finding the Centroid and Farthest Distance

Calculate center of gravity(COG)

Farthest Distance

112/04/20 13

Page 14: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Constructing a Circle

Radius= 0.7 * Farthest Distance

112/04/20 14

Page 15: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Extracting a 1D Signal and Classifilcation

Tracking the circle constructed

112/04/20 15

Page 16: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Extracting a 1D Signal and Classifilcation

Counting the number of zero-to-onesubtracting one (for the wrist)

112/04/20 16

Page 17: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Scale, Rotation, and Translation Invariance

Just counts the number of active fingers

112/04/20 17

Page 18: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Experimental Results

Source : 4 Mega-Pixel digital camera Recognition rate : 96/105=0.9142

112/04/20 18

Page 19: 出處: Signal Processing and Communications Applications, 2006 IEEE 作者: Asanterabi Malima, Erol Ozgur, and Miijdat Cetin 2015/10/251 指導教授:張財榮 學生:陳建宏

Conclusion

We proposed a fast and simple algorithm for a hand gesture recognition problem.

The segmentation portion of our algorithm is too simple

Reliable performance of hand gesture recognition techniques are still mostly beyond the current state of the art.

112/04/20 19