79
CS 378: Autonomous Intelligent Robotics Instructor: Jivko Sinapov http://www.cs.utexas.edu/~jsinapov/teaching/cs378/

CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

CS 378: Autonomous Intelligent Robotics

Instructor: Jivko Sinapovhttp://www.cs.utexas.edu/~jsinapov/teaching/cs378/

Page 2: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Affective Computing and Human-Robot Interaction

Page 3: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Announcements

FRI Survey – please take the time to respond

Page 4: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Announcements

My own end-of-semester survey:

http://goo.gl/forms/rOmW8o4d6I

Page 5: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Announcements

Final Projects Presentation Date:

Thursday, May 12, 9:00-12:00 noon

Page 6: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Final Project Presentations

• 8-10 minutes talk + 5 min time for questions

• Video or Demo

• Location: Conference room next to BWI lab

• Rehearse your presentation before!

Page 7: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Project Report Structure / Outline

• Abstract

• Introduction

• Background and/or Related Work

• Technical Approach

• Experiments and/or Evaluation and/or Example Demonstration

• Conclusion and Future Work

Page 8: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Project Deliverables

• Final Report (6+ pages in PDF)

• Code and Documentation (posted on github)

• Presentation including video and/or demo

• Post in discussion forum on Canvas

Page 9: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Presentation Schedule

• TO DO

Page 10: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

A little bit about next semester...

• New robots: robot arm, quadcopter

• Virtually all of the grade will be based on a project

• There will still be some lectures and tutorials but much of the class time will be used to give updates on your projects and for discussions

Page 11: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Affective Computing and Human-Robot Interaction

Page 12: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Main Reference

Picard, Rosalind Wright. "Affective Computing." (1995). APA

http://affect.media.mit.edu/pdfs/95.picard.pdf

Page 13: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

What is “Affective Computing””?

Affective computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects. It is an interdisciplinary field spanning computer science, psychology, and cognitive science.

- Wikipedia

Page 14: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Simple affective computing

• Automatic Flatterer

• http://www.cse.unsw.edu.au/~geoffo/humour/flattery.html

Page 15: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Unfortunately this is not always the case

Page 16: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Unfortunately this is not always the case

Page 17: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

BIG PICTURE

Page 18: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 19: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 20: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

We already have robots in our homeslike this vacuuming robot

[Romba, iRobot Inc.]

Page 21: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Entertainment Robots

[Sony]

Page 22: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Robot Soccer

Page 23: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Robot Boxing

Page 24: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 25: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 26: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 27: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 28: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 29: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 30: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Military Robots

Page 31: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Science Fiction Robots

Page 32: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Honda’s Asimo

Page 33: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Honda’s Asimo

Page 34: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Androids and Geminoids

[University of Osaca]

Page 35: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Androids and Geminoids

Page 36: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Uncanny Valley

[http://en.wikipedia.org/wiki/Uncanny_Valley]

Page 37: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Uncanny Valley

http://4.bp.blogspot.com/_Q-VuyJsLVSk/SsTE3EqFtcI/AAAAAAAAAEI/0UrogiOX6Fg/s400/uncnany+valley.JPG

Page 38: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

[http://www.technovelgy.com/ct/Science-Fiction-News.asp?NewsNum=2345]

Page 39: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Uncanny Valley

“Emotional response of human subjects is plotted against anthropomorphism of a robot, following Mori's results. The Uncanny Valley is the region of negative emotional response for robots that seem "almost human". Movement amplifies the emotional response.“

[http://en.wikipedia.org/wiki/Uncanny_Valley]

Page 40: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 41: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 42: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Robotic Bride?

Page 43: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Robotic Bride?

Page 44: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 45: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 46: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 47: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

[From “AI” the movie, Steven Spielberg]

Page 48: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

For more info and some great pictures check out

Page 49: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 50: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 51: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Why do you think these toys were so popular?

[Furby] [Tomagotchi]

Page 52: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Why do you think this car is so popular?

Page 53: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

[http://www.agent.ai/img/upload/200312/AffectiveComputing_rendszer.jpg]

Page 54: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Sensing Human Affect Response

Page 55: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Affective Computing (Rosalind Picard, MIT)

Galvanic SkinResponse

(GSR) rings and bracelet

Blood Volume Pressure (BVP) earring

Page 56: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Skin Galvenometry for the Masses

[http://www.medgadget.com/archives/img/legolie.jpg]

Page 57: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

And Another One

Page 58: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 59: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 60: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Thad Starner

Page 61: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

…and his younger brother Eric Starner

Page 62: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 63: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Possible Response Dimensions

Page 64: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Possible Response Dimensions (Russell)

Page 65: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Recognizing Affect Response Patterns

Page 66: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Ekman’s Six Facial Expressions

Page 67: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Facial Motion Energy Maps

Page 68: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

FaceReader © Noldus Information Technology 2012

Page 69: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

[http://www.horizon.ac.uk/project/affective-computing/]

Page 70: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 71: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Synthesizing Affect in Machines

[http://www.macs.hw.ac.uk/~an22/images/]

Page 72: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 73: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 74: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Kismet

[Cynthia Brazeal, MIT, late 1990s]

Page 75: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Kismet

[Cynthia Brazeal, MIT, late 1990s]

Page 76: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

Leonardo

Page 77: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism
Page 78: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism

THE END

Page 79: CS 378: Autonomous Intelligent Roboticsjsinapov/teaching/cs378/slides/29_Affective_Computing.pdfUncanny Valley “Emotional response of human subjects is plotted against anthropomorphism