30
Detection, Analysis and Visualisation of Detection, Analysis and Visualisation of Georeferenced Emotions Georeferenced Emotions Eva Hauthal & Dirk Burghardt Eva Hauthal & Dirk Burghardt Dresden Dresden 2013/08/26 2013/08/26

Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Detection, Analysis and Visualisation of Detection, Analysis and Visualisation of Georeferenced EmotionsGeoreferenced Emotions

Eva Hauthal & Dirk BurghardtEva Hauthal & Dirk BurghardtDresden Dresden ––

2013/08/262013/08/26

Page 2: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Motivation

Dresden – 2013/08/26 2Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Emotional Travel Guide

http://www.apfelnews.eu/2009/07/31/das‐iphone‐als‐mobiler‐reisefuhrer‐von‐polyglott/

Page 3: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Emotions

Overall emotional reaction:

physiological reactions

tonic posture reactions

instrumental motoric reactions

expressive motoric reactions

expressive linguistic reactions

subjective experience components

Dresden – 2013/08/26 3Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Battacchi et al. (1996)  Emotion und Sprache: zur Definition der 

Emotion und ihren Beziehungen zu kognitiven 

Prozessen, dem Gedächtnis und der Sprache. 

Lang, Frankfurt am Main.

Page 4: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

4Dresden – 2013/08/26 Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

TitleTitle

DescriptionDescription

TagsTags

LongitudeLongitude

LatitudeLatitude

Page 5: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Emotional Associations

Dresden – 2013/08/26 5Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

memoriesexperiences

thing, place, activity, ... emotion

word

Page 6: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Structuring Emotions

Dresden – 2013/08/26 6Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Arousal

negative positive

arousing

unarousing

Valence

Russell (1980)  A circumplex model of affect. 

Journal of Personality and Social Psychology 39.

Page 7: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

ANEW & BAWL-RAffective Norms for English Words

Berlin Affective Word List ‐

Reloaded

Dresden – 2013/08/26 7Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Võ et al. (2009) The Berlin Affective Word List Reloaded (BAWL‐

R). 

Behavior Research Methods 41(2). 

Bradley & Lang (2010) Affective norms for English Words (ANEW): 

Stimuli, instruction manual and affective ratings. Technical Report C‐2, University of Florida. 

Page 8: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Emotional Analysis of Dresden

Dresden – 2013/08/26 8Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Page 9: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 9Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Emotional Analysis of Dresden

Page 10: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Considerations

1 place ≠

1 emotion

personal preferences/experiences/memories

individual vs. collective emotions

temporal aspects

Dresden – 2013/08/26 10Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Page 11: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

Dresden – 2013/08/26 11Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

CC BY‐SA by

MalteFhttp://de.wikipedia.org/wiki/Dresden

CC  BY‐NC

by

lyricsarthttp://www.flickr.com/photos/91821458@N00/76083614/

1 place ≠

1 emotion temporal aspects

Page 12: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 12Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

CC  BY‐NC

by

_parrish_http://www.flickr.com/photos/_parrish_/439884019/

Page 13: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 13Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

CC  BY‐NC‐SA

by

18сецондсhttp://www.flickr.com/photos/18seconds/2949364022/

Page 14: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 14Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

< 442 words/km2

442 –

514515 –

956957 –

36273628 –

1976519766 –

117288

CC  BY‐NC‐SA

by

realname ⇋

tonal decay http://www.flickr.com/photos/19363084@N07/5459318526

temporal aspects

Page 15: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 15Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Grammatical Special Cases

happy

based on Biedermann  (1969)

Die deutschen Gradadverbien in synchronischer und diasynchronischer Sicht. Dissertation, Heidelberg.Quirk et al. (1985)

A comprehensive grammar of the English language. Longman, London.van Os (1989)

Aspekte der Intensivierung im Deutschen. Narr, Tübingen.

Page 16: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 16Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Grammatical Special Cases degree words

based on Quirk et al. (1985)

A comprehensive grammar of the English language. Longman, London.

modifying the intensity of...

adjectives It was absolutely

good.

adverbs They love their dog very

dearly.

verbs He denied

it strongly.

nouns It was really

an adventure.

Page 17: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Modification of Valence and Arousal Values - Negation

e.g. unhappy

happy

VO

= 2.4075

AO

= 3.745

unhappy

Vneg

= ‐2.4075

Aneg

= 2.255

Dresden – 2013/08/26 17Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Vneg

= ‐VO Aneg

= 6 ‐

AO

Page 18: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 18Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Page 19: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 19Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Page 20: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 20Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

„... entirely 

destroyed...“„... totally 

destroyed...“

„... badly 

damaged ...“CC BY‐SA by

Deutsche Fotothekhttp://www.deutschefotothek.de/obj88880671.html

CC BY‐SA by Deutsche Fotothek

http://www.deutschefotothek.de/obj88950461.html

„... completely 

destroyed...“

Page 21: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Future Work

Dresden – 2013/08/26 21Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Mobile Emotional Travel Guide

adaptation to ‚emotional  needs‘

of user

emotional routing

emotional profiles of  places/sights

time dependence & temporal aspects

distinction individual / collective emotions

visualisation

Page 22: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Thanks for your attention!Thanks for your attention!

[email protected]@tu‐‐[email protected]@tu‐‐dresden.dedresden.de

Page 23: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Extracting Emotions from Language

Dresden – 2013/08/26 23Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Zarafani et al. (2010)  Sentiment Propagation in Social Networks: 

A Case Study in LiveJournal. 

Proceedings of Advances in social 

computing, Third International Conference 

on Social Computing, Behavioral Modeling, 

and Prediction.

Abbasi et al. (2008)  Affect Analysis of Web Forums and Blogs 

Using Correlation Ensembles. 

IEEE Transactions on Knowledge and Data 

Engineering 20(9).

Page 24: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 24Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

TitleDescriptionTags

Language Detection

Lemmatisation

ANEW / 

BAWL‐R

Found 

Word?

WordValence ArousalLongitudeLatitude

Hypernym /Synonym

ANEW / 

BAWL‐R

Found 

Word?

WordValence ArousalLongitudeLatitude

yes no

yes

POS Tagging

Extraction of Emotions from Photo-Metadata

Sentence Segmentation

Page 25: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Emotional Analysis of Dresden with Consideration of GSC

Dresden – 2013/08/26 25Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Page 26: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 26Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Error Analysis in 50 Test Data Records

Page 27: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Modification of Valence and Arousal Values - Negation

Dresden – 2013/08/26 27Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

1

2

3

4

5

‐3 ‐2 ‐1 0 1 2 3

Arousal

Valence

'happy' (ANEW)

'unhappy' (formula)

'unhappy' (ANEW)

Page 28: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Modification of Valence and Arousal Values

Maximum

Amplification

Attenutation

Minimum

Dresden – 2013/08/26 28Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Valence

Valence

Valence

Valence

Arousal

Arousal

Arousal

Arousal

Page 29: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Dresden – 2013/08/26 29Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Page 30: Detection, Analysis and Visualisation of Georeferenced ...€¦ · Motivation. Dresden – 2013/08/26. Detection, Analysis and Visualisation of Georeferenced Emotions. 2 - Eva Hauthal

Modification of Valence and Arousal Values - Amplification

e.g. very happy

happy

VO

= 2.4075

AO

= 3.745

very happy

Vamp

= 2.883

Aamp

= 4.2125

Dresden – 2013/08/26 30Detection, Analysis and Visualisation of Georeferenced Emotions- Eva Hauthal & Dirk Burghardt -

Aamp

= 2AO

3 ‐

½

|(AO

3)| ∙

(AO

3)

3‐|VO

|3

2 ‐

|AO

– 3|3

3‐|VO

|3∙

+1 ∙

+12‐|AO

3|3

Vamp

= (2 ‐ ) ∙

VO

|VO

|3