47
Exploring the Magicof Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019 MIMS Final Presentation

Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Exploring the “Magic” of Algorithmic Predictions

Joyce Lee Sejal PopatSoravis Prakkamakul

UC Berkeley School of Information2019 MIMS Final Presentation

Page 2: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Why do we think oftechnology as magic?

Page 3: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

"Any sufficiently advanced technology is indistinguishable from magic."

Clarke, A. (1999) [1st pub. 1962, rev. 1973, 1984, 1999]. Profiles of the Future: An Inquiry Into the Limits of the Possible. New York, NY: Holt, Rinehart & Wilson.

Page 4: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Clarke, A. (1999) [1st pub. 1962, rev. 1973, 1984, 1999]. Profiles of the Future: An Inquiry Into the Limits of the Possible. New York, NY: Holt, Rinehart & Wilson.

"Any sufficiently advanced technology is indistinguishable from magic."

Page 5: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

What underlies algorithmic “magic”?

1

Proprietary concerns

2

Technical illiteracy

Burrell, J. (2016). How the Machine ‘Thinks’: Understanding Opacity in Machine Learning Algorithms. Big Data & Society. https://doi.org/10.1177/2053951715622512.

Page 6: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

AstrologyAura ReadingMediumshipNumerologyPalm ReadingPhysiognomyPhrenologyPsychometryTarot Card Reading

But attempting to predict is nothing new…

Page 7: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

ObjectiveCan reframing algorithmic predictions with the deliberately mystical lens of divination lead people to reconsider its sense of “magic”?

Page 8: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

ApproachWithin the traditions of reflective & speculative design, we develop an interactive installation that enables technology-mediated tarot-card readings.

Page 9: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Research Questions

1 Will people question how algorithmic prediction works in the context of divination?

2

Will people resist sharing personal data for the purpose of “algorithmic divination”?

Page 10: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

System Design

Page 12: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Interaction flow

Conversational Interface

Text Analysis & Visualization

Personality Prediction

Tarot Card Reading

Page 13: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Topic Visualization

Interior Lamp

BlackCurtains

Card DispensingSlot

Page 14: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Tarot CardPrinter

Monitor

Laptop

Microphone Array

Page 15: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Tarot CardPrinter

Monitor

Laptop

Microphone Array

Page 16: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019
Page 17: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Tarot CardPrinter

Monitor

Laptop

Microphone Array

Page 18: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Tarot CardPrinter

Monitor

Laptop

Microphone Array

Page 19: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Future Prediction

Past Prediction

Present Prediction

Page 20: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Raw Speech

SpeechRecognition

Intent Recognition

Topic Analysis(Empath)

Sentiment Analysis

MBTI PersonalityAnalysis (SpaCy)

Future Prediction

Past Prediction

Present Prediction

Basic Interactions:Skip, Repeat, etc.

Page 21: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Raw Speech

SpeechRecognition

Intent Recognition

Topic Analysis(Empath)

Sentiment Analysis

MBTI PersonalityAnalysis (SpaCy)

Future Prediction

Past Prediction

Present Prediction

Basic Interactions:Skip, Repeat, etc.

Page 22: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Raw Speech

SpeechRecognition

Intent Recognition

Topic Analysis(Empath)

Sentiment Analysis

MBTI PersonalityAnalysis (SpaCy)

Future Prediction

Past Prediction

Present Prediction

Basic Interactions:Skip, Repeat, etc.

Page 23: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Tarot CardPrinter

Monitor

Laptop

Microphone Array

Page 24: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Tarot CardPrinter

Monitor

Laptop

Microphone Array

Page 25: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019
Page 26: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Research Approach

Page 27: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

10 ParticipantsAges 25-40 50% female

Sample Recruited via Email

Self-Guided Tarot Reading

Follow-Up Interview

Page 28: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

ResultingThemes

1 Questioning whether or not to share personal data

2

Interrogating underlying technology

Page 29: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

ResultingThemes

1 Questioning whether or not to share personal data

2

Interrogating underlying technology

Page 30: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Difficult questions

“The questions got . . . pretty personal. ”

Page 31: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Presence of a camera

“I remembered that it was being recorded, like there’s a video. So I wondered, ‘Should I be giving all this information out? ”

Page 32: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Speaking vs. writing

“There is a sense in opening your own mouth to say things that you’re handing over more information… There’s something about talking that makes it feel different”

Page 33: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

ResultingThemes

1 Questioning whether or not to share personal data

2

Interrogating underlying technology

Page 34: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

ResultingThemes

1 Questioning whether or not to share personal data

2

Interrogating underlying technology

Page 35: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Reflection vs. inception

“I wasn’t sure whether I was being reflected or lead”

Page 36: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019
Page 37: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Contesting classification…

“If I see I’m kind of pigeon holed… I either reassess myself, or question what the algorithm is latching onto”

Page 38: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

… or being unable to exercise agency

“There’s no real agency to clarify what you mean”

Page 39: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

General sense of opacity

“Its mysterious. I mean we assume they’re working. A lot of prediction is business oriented and we don’t know what’s being maximized. ”

Page 40: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Research Questions, Revisited

1 Will people question how algorithmic prediction works in the context of divination?

2

Will people resist sharing personal data for the purpose of “algorithmic divination”?

Page 41: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Insights 1

Participants were most interested in the process of generating predictions, rather than the outcomes themselves

Page 42: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Insights 2

Participants felt they had very little agency to control how they were “seen” by the system; many wondered if they were being reflected or led

Page 43: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Implications 1

The magical, optimistic presentation of algorithmic predictions may be doing more harm than good

Page 44: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Implications 2

We see a need for transparent communication of technology’s inner workings, even if this requires purposeful ambiguity and room for interpretation

Page 45: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Why do we think oftechnology as magic?

Page 46: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Many Thanks To . . .

Our advisor, Kimiko Ryokai

Our research participants

Our I School professors & department staff

Our friends & family (that’s you!)

Page 47: Exploring the Magic of Algorithmic Predictions...Exploring the “Magic” of Algorithmic Predictions Joyce Lee Sejal Popat Soravis Prakkamakul UC Berkeley School of Information 2019

Exploring the “Magic” of Algorithmic Predictions

Joyce Lee Sejal PopatSoravis Prakkamakul

UC Berkeley School of Information2019 MIMS Final Presentation