47
Role of Interaction Design & Data Science in Crisis Response Karri-Pekka Laakso Lead Designer (Interaction), Reaktor Antti Honkela Associate Professor at the Department of Computer Science, University of Helsinki and Coordinator of Research Programme in Privacy-preserving and Secure AI, Finnish Center for Artificial Intelligence (FCAI) June 11, 2020 CS-E4002: Human-Centred Research and Design in Crisis Aalto University

Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Role of Interaction Design & Data Science in Crisis Response

Karri-Pekka LaaksoLead Designer (Interaction), Reaktor

Antti HonkelaAssociate Professor at the Department of Computer Science, University of Helsinki and Coordinator of Research Programme in Privacy-preserving and Secure AI, Finnish Center for Artificial Intelligence (FCAI)

June 11, 2020

CS-E4002: Human-Centred Research and Design in Crisis

Aalto University

Page 2: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Designing the Ketju Contact Tracing App:Interaction Design, Technology and Privacy Implications

11.6.2020

Karri-Pekka Laakso, Reaktor

Page 3: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

● Officially started on Mon 23rd March, 2020● 6 designers

● 3 from Reaktor (UX, graphic, UX) <= me● 3 from Futurice (UX, graphic, UX)

In cooperation with

ketjusovellus.fi

Page 4: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Karri-Pekka Laakso

M.Sc. (eng), Helsinki University of Technology

#UX #interaction_design #field_studies #visualizations

#scala #js #java #html_css #node #bash

#public_speaking #teaching

#family #gymnastics #acrobatics #orienteering #piano

Page 5: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Social Distance

Susan AnnBret MikeLisa Xavier Yvonnespouse friend same workplace next in metro, shop, …

Page 6: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Who can Susan recall / name?

Susan AnnBret MikeLisa Xavier Yvonnespouse friend same workplace next in metro, shop, …

Page 7: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Who would Susan share with?

Susan AnnBret MikeLisa Xavier Yvonnespouse friend same workplace next in metro, shop, …

Page 8: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Who knows Susan by name?

Susan AnnBret MikeLisa Xavier Yvonnespouse friend same workplace next in metro, shop, …

Page 9: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Technology and privacy● Location

Page 10: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Technology and privacy● Location● Bluetooth contacts

“Susan” “Lisa”

Page 11: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Technology and privacy● Location● Bluetooth contacts● Anonymous Bluetooth contacts

“0x00a78” “0x81eaa”

Page 12: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Technology and privacy● Location● Bluetooth contacts● Anonymous Bluetooth contacts● Anonymous Bluetooth contacts

changing in time (DP^3T, Google Apple Exposure Notification API)

“0x00a78” “0x81eaa”“0xb2312”“0x9124a”

15 min15 min

15 min

… …

“0xa292f”“0x93d51”

Page 13: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Technology and privacy

I have met9:05 - 9:12 “0x00a78”9:12 - 9:17 “0xb2312”

“0x00a78”“0xb2312”“0x9124a”

Page 14: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Centralized model● Authorities know the exposed

immediately● Gather names & phone numbers

=> call, interview, quarantine

● Privacy?

Page 15: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

1) Citizens load the Ketju app from the App Store and put it on every time they leave home.

2) When users A and B meet, their phones register a contact when are close enough for time long enough (for example <5 m, >15 min).

C is too far away to register a contact.

4) A has symptoms and the doctor order a test. 3) The app stores the

contact totally anonymously: no personal or location information is stored.

5) The doctor calls to tell that the test result is positive and asks, if A uses the Ketju App.

6) The doctor gives A a PIN code, which A enters to the Ketju app. The app informs the central server that A has been infected.

7) The app of B notices that one of its contacts has reported a positive test result. The app tells B about the exposure and that she should contact the local health center.

C has had no contact with A and thus nothing happens.

Distributed model

8) Only the user knows about the possible infection, since the data at the server and at the phone in anonymous.

Page 16: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Distributed model● Susan tells the system that she is

sick (voluntary)● Lisa gets a notification

=> take a test (voluntary)=> self-quarantine (voluntary)

● Verification of exposure?● Granularity of exposure time?● Contact tracing?

You have been exposed yesterday

Page 17: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Distributed modelAuthorities can only give the release code

=> no help for contact tracing=> no official quarantine (≠ self quanrantine)

Page 18: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Hybrid models• People voluntarily release information

to authorities, e.g.• contacts with a sick person• exposures of a sick person• their contact info• …

• Legal issues• Privacy issues• Gapple API issues

Page 19: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Iterations

Page 20: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Chaotic surroundings

politics

law

bluetooth

design

communications

media

protocols databases

contract tracing

infectious diseases

doctors

users

visualizations

Page 21: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

produce 330 screenshots for users

participate in writing the reportorganize 250 database files

Do what is needed

Page 22: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

The power of realistic cases

Susan

Everything is easier: talking, deducing, …

Page 23: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Cost / benefit

x% install * y% use * z% contact noticed * i% user notices * j% contacts the authority * …

vs. cost of implementation & maintenance?

Page 24: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Questions?

@kplaakso

[email protected]

Page 25: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Privacy-preserving contact statistics collection using COVID-19contact tracing apps

Antti Honkela1 and Tejas Kulkarni2

Finnish Center for Artificial Intelligence FCAI1 University of Helsinki

2 Aalto University

Human-Centred Research and Design in Crisis11 June 2020

Page 26: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Outline

A cartoon of an epidemic

Contact tracing apps

Privacy-preserving collection of contact statistics

Page 27: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Disclaimer: while I talk about mathematical epidemic models, I am not anepidemiologist. Listeners beware.

Page 28: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

A cartoon of an epidemic

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Population divided to classes of individuals based on infection status

I Infection spreads when S has sufficiently strong contact with I

I Current growth rate of the epidemic measured by reproductive numberRe ≈ ratio of new infections over recoveries

Page 29: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

A cartoon of an epidemic

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

0 50 100 150 200 250Days

0.0

0.5

1.0

Frac

tion

of p

opul

atio

n

Page 30: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

A cartoon of an epidemic

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Modelling by fitting the curve to observed confirmed cases / hospitalisations /deaths / ...

I Estimation delay: changes in infection rate only show in tests and hospitalisationsafter a week or more

Page 31: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

A cartoon of an epidemic

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

Data

I Modelling by fitting the curve to observed confirmed cases / hospitalisations /deaths / ...

I Estimation delay: changes in infection rate only show in tests and hospitalisationsafter a week or more

Page 32: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Managing an epidemic

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Epidemic management activities aim at limiting contacts between S and II Social distancing limits all contactsI Contact tracing aims to quarantine exposed individuals before they become infective

Page 33: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Managing an epidemic

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Epidemic management activities aim at limiting contacts between S and II Social distancing limits all contactsI Contact tracing aims to quarantine exposed individuals before they become infective

Page 34: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Contact tracing and mobile apps

I Classical contact tracing works remarkably well, but is very labour intensive

I Many countries are developing mobile apps to assist the activity

I Privacy is an absolute requirementI Typical mode of operation (e.g. DP-3T, Google/Apple):

I No location data gathered (low utility, bad privacy)I Use Bluetooth to record random identifiers broadcast by nearby devicesI Identifiers change relatively frequentlyI Recorded recent contacts shared only when user is diagnosed positive

I Discussion to decide between decentralised vs. centralised mode of operation

Page 35: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Contact tracing app theory

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Assuming 50% of population use the app and all detected exposed individuals areperfectly quarantined, we prevent 25% of potential future infections

I E.g. reduce Re = 1.2→ Re = 0.9

I Over 70% users needed for theoretical 50% efficiencyI E.g. reduce Re = 1.8→ Re = 0.9

Page 36: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Contact tracing app theory

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Assuming 50% of population use the app and all detected exposed individuals areperfectly quarantined, we prevent 25% of potential future infections

I E.g. reduce Re = 1.2→ Re = 0.9

I Over 70% users needed for theoretical 50% efficiencyI E.g. reduce Re = 1.8→ Re = 0.9

Page 37: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Contact tracing app theory

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

QuarantinedQ

I Assuming 50% of population use the app and all detected exposed individuals areperfectly quarantined, we prevent 25% of potential future infections

I E.g. reduce Re = 1.2→ Re = 0.9

I Over 70% users needed for theoretical 50% efficiencyI E.g. reduce Re = 1.8→ Re = 0.9

Page 38: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Opportunity

I Contact tracing apps collect data of close contacts in the population

I Collecting statistical information of contact frequencies would provide data forepidemic modelling as well as monitoring and planning other interventions (e.g.school and business closures)

I While such statistical information is not very sensitive, strong privacy protection isstill necessary; collection should be opt-in

I Such data likely to be useful with fewer users: even at 30% use we would expectto see 30% of contacts of each user and can correct that from known rate of users

Page 39: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Asking sensitive questions: Randomised response (Warner, 1965)

Assume respondents are instructed to answer a potentially sensitive query (e.g. wereyou in contact with more than 10 individuals yesterday?) as follows:

1. Flip a coin in secret.

2. If tails, then respond truthfully.

3. If heads, then flip a second coin and respond “Yes” if heads and “No” if tails.

I Outcome: the answer is flipped with probability 14

I Everyone gets plausible deniability: “It was just the coins”

I Statistics can be estimated from population responses by compensating for thenoise

I Probabilistic loss of privacy: “Yes” response makes it more likely your trueresponse was “Yes”

Page 40: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Differential privacy (DP; Dwork et al., 2006)

I Provides protection against adversaries with side information

I Degrades gracefully under repeated use

I Invariant to post-processing

Page 41: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Proposal: Locally DP collection of contact statistics

I Using local DP (LDP) to collect population histogram of number of contacts

I Data are anonymised before they leave the user device

I Privacy guarantee: even if you see a user’s report knowing it came from her, youcan only guess what she answered

I Rapidly changing identifiers make collection of full daily statistics difficultI Collect e.g. maximum number of contacts over 30 min period each day instead

I Observed data fed to a Bayesian model for denoising, integrating responses frommultiple days in a probabilistic model

I Produces real-time data on behaviour changes and effects of changes tointerventions and guidelines

Page 42: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Extended data collection

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

Data

Page 43: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Extended data collection

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

Data

Page 44: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

More about privacy

I Caveat: theoretical privacy guarantees will degrade over repeated data collectionI Using fresh data for each report mitigates the impactI Ethical review of costs vs. benefits still needed

I Introducing secure shuffling to eliminate linking reports to individuals tightens theprivacy guarantee by approximately factor

√n for n users

I Basically eliminates privacy concerns even after repeated collectionI NB: even breaking the shuffler would not completely compromise the privacy

Page 45: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Preliminary simulation results

0.1 0.3 0.5 0.7 0.9 1.1 1.2

0.00

0.05

0.10

0.15

0.20

0.25

0.30

0.35

Mea

n de

viat

ion

in e

xpec

ted

valu

e of

rec

over

ed h

isto

gram

=2.0, N=1000000, D=16

0.1 0.3 0.5 0.7 0.9 1.1 1.20.00

0.25

0.50

0.75

1.00

1.25

1.50

1.75

2.00

Mea

n de

viat

ion

in e

xpec

ted

valu

e of

rec

over

ed h

isto

gram

=2.0, N=1000000, D=32

Error in estimating the mean of a simulated population using LDP histogramestimation with D bins. Simulated using geometric distribution with true mean 2.0.Bars show MAE of 10 repeats, error bars show std over the repeats.

Page 46: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Conclusion

SusceptibleS

ExposedE

InfectiousI

RecoveredR

DeadD

Data

I COVID-19 pandemic has just started, still long way to vaccine or herd immunity

I Daily contact statistics observed by contact tracing apps could provide directmeasures of the most important spreading mechanism, enabling more timelymodelling

I Differential privacy provides the means to collect these data under strong privacyguarantees to the users

Page 47: Role of Interaction Design & Data Science in Crisis Response · 2020. 6. 12. · • Gapple API issues. Iterations. Chaotic surroundings politics law bluetooth design communications

Next Tuesday:Why Contact Tracing is Neither Secure or Privacy-Preserving

Janne Lindqvist, Prof. at the Department of Computer Science, Aalto University