The Influence of Personality on Users’ Emotional Reactions

BEvERly REssEgUIER, PIERRE-MajoRIqUE légER, sylvaIn sénécal, MaRIE-chRIsTInE BasTaRachE-RoBERgE and FRançoIs coURTEManchE

HCI International 2016Toronto, July 27th 2016

© Copyright Tech3Lab 2015

Prof. Pierre-Majorique Léger, Ph.D.

Full ProfessorDirector ERPsim LabCo-director Tech3Lab pml@hec.ca

GRAD STUDIES

POST-DOCTORATE

LABS VISITING PROFESSOR

Lab Serious games to learn enterprise systems and business analytics

https://www.researchgate.net/profile/Pierre-Majorique_Leger

THIS RESEARCH :

Explore the extent to which personality influences emotional reactions.OUR GOAL :

Develop neuroadaptive interfaces using emotional reactions taking into account users’ personality traits.

© Copyright Tech3Lab 2015© Copyright Tech3Lab 2015

© Copyright Tech3Lab 2016

Funding Agencies

© Copyright Tech3Lab 2016

Research Partners

TeCH3Lab 2016 :

7 experimental rooms

© copyright Léger et Sénécal 2015

© copyright Léger et Sénécal 2015

TeCH3Lab 2016 :

Broad range of thelastest neuroscience tools to capture user experience

© Copyright Tech3Lab 2016

Facial emotions

© Copyright Tech3Lab 2016Source : Lie to Me, Fox Broadcasting Company, sur IMDb http://www.imdb.com/media/rm2416675584/tt1235099?ref_=ttmd_md_nxt

PrImary emoTIon Has ITs own seT of faCIaL musCLe ConTraCTIons LeadIng To an unIque faCIaL exPressIon

© Copyright Tech3Lab 2016

Facial ExpressionsfaCIaL exPressIons are Caused by sImuLTaneous TemPorary ConTraCTIons (beTween 250 ms and 5 seConds) of dIfferenT faCIaL musCLes suCH as eyeLIds, LIPs, and nose

Source: Noldus

© Copyright Tech3Lab 2016

Zygomatic and CorrugatorInCreased aCTIvITy In THe zygomaTIC musCLe grouP (THe smILe musCLe near THe mouTH) Is reLaTed To PosITIve emoTIon, wHILe InCreased aCTIvITy In THe CorrugaTor musCLe grouP (THe frown musCLe near THe eye) Is reLaTed To negaTIve emoTIon

Source: https://imotions.com/blog/collect-and-analyze-facial-expressions/

© Copyright Tech3Lab 2016

EASE OF USE?

Automatic facial analysisdIsCern Human emoTIon THrougH THe use of sPeCIa-LIzed sofTware THaT Can deTeCT faCIaL feaTures assoCIaTed wITH faCIaL exPressIon

EASY TO USE?

© Copyright Tech3Lab 2016

EASE OF USE?

Automatic facial analysisa seT of aCTIon unITs Covers muLTIPLe PossIbILITIes of faCIaL aCTIons, suCH as THe rIse of an eyebrow or THePInCH of THe LIPs.

EASY TO USE?

© Copyright Tech3Lab 2016

HEXACO Personality Inventory

OPENNESS TO EXPERIENCE

HONESTY-HUMILITY

EMOTIONALITY EXTRAVERSION

AGREEABLENESS

CONSCIENTIOUSNESS

Lee, K. and M.C. Ashton, Psychometric properties of the HEXACO personality inventory. Multivariate Behavioral Research, 2004. 39(2): p. 329-358.

Methodology

Flow in group

players games88 120

© Copyright Tech3Lab 2016

Correlation analysis between personality traits and facial emotions

FLOW OF pLayer (a)= DiFF icuLty + cOmpet ency+

pLayer (a)+pLayer (B)

Predicting flow in multiplayer context

66%

© Copyright Tech3Lab 2016

Conclusion and next steps

EyE FIxaTIons TRIangUlaTIon and MachInE lEaRnIng

vIsUalIzaTIon oF EMoTIon and/oR cognITIvE sTaTEs aT FIxaTIon

Georges, V., Courtemanche, F., Senecal, S., Baccino, T., Fredette, M., & Leger, P. M. (2016, May). UX Heatmaps: Mapping User Experience on Visual Interfaces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 4850-4860). ACM.

Thank you!