1

LiveFeedback Penguins FCI-CU

Computer vision

2

Prepared by Moustafa Mohamed Ali Yasmin Abobakr Mo’men Mohamed Radwa Samy Tariq Senosy

3

Outline Introduction Problem Statement Background Suggested Solution Related work Project Relevance System Architecture Accuracy Dataset Demo Future work Questions

4

Introduction Emotions in everyday human

communication Communication ways :

by language : 7% by paralanguage : 38% by facial expression : 55%

5

Problem Statement Getting feedback about a specific

session from attendees during the session.

We can’t stop the session every minutes and ask the attendees about their opinion.

We need to find a way that’s Quick Effective Get good estimates

6

Background Computer Vision Systems Emotion Recognition techniques

Brain signals (EEG) Speech Facial Expression

7

Suggested Solution A computer vision system that can get

feedback from audience of a session by detecting their emotions –in real time- through Facial Expression Analysis.

Theme :

8

Related work AFFDEX android and web application MIT Learning Companion

9

Value Proposition Using such system will be valuable in

Learning purposes Speakers’ presentations Ads feedback

10

Project Relevance Software Engineering (Agile, VCS, SDLC) Genetic Algorithms Machine Learning Computer Vision

11

System Architecture

12

Feature Extraction

Feature Selection

Classification

Face Detection

13

Face Detection Viola Jones Algorithm (OpenCV library)

It's made for frontal face positions

14

Feature Extraction MethodsGabor FilterConvolutional Neural Nets.Local Binary Pattern Active Appearance Model

Chosen Method(s)Gabor Filter

15

Feature Reduction MethodsGenetic AlgorithmDown samplingPCAAdaboost

Chosen Method(s)Genetic Algorithm (Tested)Downsampling (Currently in use)

16

ClassificationMethodsSVM (lib-svm)Neural Networks

Chosen Method(s)SVM

17

Accuracy Validation 67.95% Testing 53.125% Factors affecting the accuracy

Dataset size Dataset variation Features Features normalization

18

Data set

With more than 1000 image created from different datasets we trained our system Japanese women database (213 image) 10k US Adult Faces (10,000 faces) Total number of images (1500 images)

19

Demo

20

Future Work Improve accuracy by trying different

methods for each phase Use datasets specified for feedback

emotions Android version

21

22

Thank You