Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden –...

Detection, Analysis and Visualisation of Detection, Analysis and Visualisation of Georeferenced EmotionsGeoreferenced Emotions

Eva Hauthal & Dirk BurghardtEva Hauthal & Dirk BurghardtDresden Dresden ––

2013/08/262013/08/26

Motivation

Dresden – 2013/08/26 2Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Emotional Travel Guide

http://www.apfelnews.eu/2009/07/31/das‐iphone‐als‐mobiler‐reisefuhrer‐von‐polyglott/

Emotions

Overall emotional reaction:

∙

physiological reactions

∙

tonic posture reactions

∙

instrumental motoric reactions

∙

expressive motoric reactions

∙

expressive linguistic reactions

∙

subjective experience components

Dresden – 2013/08/26 3Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Battacchi et al. (1996)  Emotion und Sprache: zur Definition der 

Emotion und ihren Beziehungen zu kognitiven 

Prozessen, dem Gedächtnis und der Sprache. 

Lang, Frankfurt am Main.

4Dresden – 2013/08/26 Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

TitleTitle

DescriptionDescription

TagsTags

LongitudeLongitude

LatitudeLatitude

Emotional Associations

Dresden – 2013/08/26 5Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

memoriesexperiences

thing, place, activity, ... emotion

word

Structuring Emotions

Dresden – 2013/08/26 6Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Arousal

negative positive

arousing

unarousing

Valence

Russell (1980)  A circumplex model of affect. 

Journal of Personality and Social Psychology 39.

ANEW & BAWL-RAffective Norms for English Words

Berlin Affective Word List ‐

Reloaded

Dresden – 2013/08/26 7Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Võ et al. (2009) The Berlin Affective Word List Reloaded (BAWL‐

R). 

Behavior Research Methods 41(2). 

Bradley & Lang (2010) Affective norms for English Words (ANEW): 

Stimuli, instruction manual and affective ratings. Technical Report C‐2, University of Florida. 

Emotional Analysis of Dresden

Dresden – 2013/08/26 8Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Dresden – 2013/08/26 9Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Emotional Analysis of Dresden

Considerations

1 place ≠

1 emotion

personal preferences/experiences/memories

individual vs. collective emotions

temporal aspects

Dresden – 2013/08/26 10Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

Dresden – 2013/08/26 11Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

CC BY‐SA by

MalteFhttp://de.wikipedia.org/wiki/Dresden

CC  BY‐NC

by

lyricsarthttp://www.flickr.com/photos/91821458@N00/76083614/

1 place ≠

1 emotion temporal aspects

Dresden – 2013/08/26 12Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

CC  BY‐NC

by

_parrish_http://www.flickr.com/photos/_parrish_/439884019/

Dresden – 2013/08/26 13Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

CC  BY‐NC‐SA

by

18сецондсhttp://www.flickr.com/photos/18seconds/2949364022/

Dresden – 2013/08/26 14Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

CC  BY‐NC‐SA

by

realname ⇋

tonal decay http://www.flickr.com/photos/19363084@N07/5459318526

temporal aspects

Dresden – 2013/08/26 15Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Grammatical Special Cases

happy

based on Biedermann  (1969)

Die deutschen Gradadverbien in synchronischer und diasynchronischer Sicht. Dissertation, Heidelberg.Quirk et al. (1985)

A comprehensive grammar of the English language. Longman, London.van Os (1989)

Aspekte der Intensivierung im Deutschen. Narr, Tübingen.

Dresden – 2013/08/26 16Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Grammatical Special Cases degree words

based on Quirk et al. (1985)

A comprehensive grammar of the English language. Longman, London.

modifying the intensity of...

adjectives It was absolutely

good.

adverbs They love their dog very

dearly.

verbs He denied

it strongly.

nouns It was really

an adventure.

Modification of Valence and Arousal Values - Negation

e.g. unhappy

happy

VO

= 2.4075

AO

= 3.745

unhappy

Vneg

= ‐2.4075

Aneg

= 2.255

Dresden – 2013/08/26 17Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Vneg

= ‐VO Aneg

= 6 ‐

AO

Dresden – 2013/08/26 18Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Dresden – 2013/08/26 19Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Dresden – 2013/08/26 20Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

„... entirely 

destroyed...“„... totally 

destroyed...“

„... badly 

damaged ...“CC BY‐SA by

Deutsche Fotothekhttp://www.deutschefotothek.de/obj88880671.html

CC BY‐SA by Deutsche Fotothek

http://www.deutschefotothek.de/obj88950461.html

„... completely 

destroyed...“

Future Work

Dresden – 2013/08/26 21Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Mobile Emotional Travel Guide

∙

adaptation to ‚emotional  needs‘

of user

∙

emotional routing

∙

emotional profiles of  places/sights

∙

time dependence & temporal aspects

∙

distinction individual / collective emotions

∙

visualisation

Thanks for your attention!Thanks for your attention!

eva.hauthal@tueva.hauthal@tu‐‐dresden.dedresden.dedirk.burghardt@tudirk.burghardt@tu‐‐dresden.dedresden.de

Extracting Emotions from Language

Dresden – 2013/08/26 23Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Zarafani et al. (2010)  Sentiment Propagation in Social Networks: 

A Case Study in LiveJournal. 

Proceedings of Advances in social 

computing, Third International Conference 

on Social Computing, Behavioral Modeling, 

and Prediction.

Abbasi et al. (2008)  Affect Analysis of Web Forums and Blogs 

Using Correlation Ensembles. 

IEEE Transactions on Knowledge and Data 

Engineering 20(9).

Dresden – 2013/08/26 24Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

TitleDescriptionTags

Language Detection

Lemmatisation

ANEW / 

BAWL‐R

Found 

Word?

WordValence ArousalLongitudeLatitude

Hypernym /Synonym

ANEW / 

BAWL‐R

Found 

Word?

WordValence ArousalLongitudeLatitude

yes no

yes

POS Tagging

Extraction of Emotions from Photo-Metadata

Sentence Segmentation

Emotional Analysis of Dresden with Consideration of GSC

Dresden – 2013/08/26 25Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Dresden – 2013/08/26 26Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Error Analysis in 50 Test Data Records

Modification of Valence and Arousal Values - Negation

Dresden – 2013/08/26 27Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

1

2

3

4

5

‐3 ‐2 ‐1 0 1 2 3

Arousal

Valence

'happy' (ANEW)

'unhappy' (formula)

'unhappy' (ANEW)

Modification of Valence and Arousal Values

Maximum

Amplification

Attenutation

Minimum

Dresden – 2013/08/26 28Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Valence

Valence

Valence

Valence

Arousal

Arousal

Arousal

Arousal

Dresden – 2013/08/26 29Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Modification of Valence and Arousal Values - Amplification

e.g. very happy

happy

VO

= 2.4075

AO

= 3.745

very happy

Vamp

= 2.883

Aamp

= 4.2125

Dresden – 2013/08/26 30Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Aamp

= 2AO

‐

3 ‐

½

∙

|(AO

‐

3)| ∙

(AO

‐

3)

3‐|VO

|3

2 ‐

|AO

– 3|3

3‐|VO

|3∙

+1 ∙

+12‐|AO

‐

3|3

Vamp

= (2 ‐ ) ∙

VO

|VO

|3