77
MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical & Data Sciences Smith College

MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

  • Upload
    others

  • View
    10

  • Download
    1

Embed Size (px)

Citation preview

Page 1: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

MassMutual DSDP 2017:

INTRODUCTION TO DATA VISUALIZATIONJune 8, 2017

R. Jordan Crouser & Amelia McNamaraStatistical & Data SciencesSmith College

Page 2: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 3: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 4: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Housekeeping

jcrouser.github.io/datavis

Page 5: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 6: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

What is visualization?

Page 7: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

What is visualization?

Page 8: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Perhaps a more helpful question:

What are some ways a “visualization” can be useful?

Page 9: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 10: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 11: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Does it tell a story?

Hans Rosling’s 200 Countries, 200 Years, 4 Minutes – The Joy of Stats – BBC Fourhttps://www.youtube.com/watch?v=jbkSRLYSojo

Page 12: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 13: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Wait… what is “data”?

Page 14: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Data: a definition

Data is a set of variables that capture various aspects of the world:

Tuition rates, enrollment numbers,public vs. private, etc.

Page 15: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 16: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 17: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 18: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 19: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Why is this important?

• Data have dimensions

• Visualizations have dimensions, too

• To build visualizations, we need to map data dimensions to visual dimensions

Page 20: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Key question for this courseWhich data dimension should be mapped

to which visual dimension?

Page 21: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 22: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

A quick history lesson…

Page 23: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 24: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 25: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 26: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

(Incomplete) History of Visualization: 1980s

• Scientific visualization, physical phenomena• Starting to think about: photorealism, entertainment

Page 27: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

(Incomplete) History of Visualization: 1990s

• Information visualization, storytelling• Starting to think about: online spaces, interaction

Page 28: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

(Incomplete) History of Visualization: 2000s

• Coordination across multiple views, interaction• Starting to think about: sensemaking, provenance

Page 29: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 30: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 31: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Information overload

• We are exposed to huge amounts of information all the time

• So much, in fact, that we can’t process it all fast enough

Page 32: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 33: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 34: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 35: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

2. Mental models form quickly, & update slowly

Page 36: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 37: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 38: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

The good, the bad, and the ugly…

The good:- Well-tuned mental models let us process information quickly- Frees up more processing power to synthesize information

The bad:- People (esp. experts) tend not to notice information that

contradicts their mental model- A “fresh pair of eyes” can be beneficial

The ugly:- Mental models are unavoidable: everyone has them, and

they’re all different- Key: be aware of how mental models form, how they shape

perception, and how to support (or challenge) them

Page 39: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 40: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 41: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 42: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 43: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 44: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Visual dimension: color

• Encode information using the hue of the mark• Examples:

Page 45: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Visual dimension: orientation

• Encode information using how the mark is rotated• Examples:

Page 46: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Visual dimension: shape

• Encode information using how the mark is shaped• Examples:

Page 47: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Discussion

What makes a good encoding?

Page 48: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 49: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 50: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Principle 2: consistency

• Use consistent axes when comparing charts

Raina SZ, et al. (2005) Evolution of base-substitution gradientsin primate mitochondrial genomes. Genome Res 15: 665-673.

M. Krzwinski, behind every great visualization is a designprinciple, 2012

Page 51: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 52: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 53: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 54: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 55: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 56: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 57: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Familiar example

Page 58: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Discussion

• What do you think of the data-ink ratio?• Consider ways to maximize it…

Page 59: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 60: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 61: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 62: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 63: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 64: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Lab 1: Deconstructing Data Graphics

• Break into groups of 2-3 people, and go to:jcrouser.github.io/datavis/lab1.html

• During this lab, we’ll critique some professionally-made visualizations using these principles

• Try to think about the following questions:- What is the first thing you notice about this visualization?- What point is this visualization trying to make?- Who is the intended audience?- What is the visualization doing well?- What problems do you see with the visualization design?- Why do you think the designer made those choices?

Page 65: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 66: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 67: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 68: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 69: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 70: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 71: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 72: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 73: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 74: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 75: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 76: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &
Page 77: MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION · MassMutual DSDP 2017: INTRODUCTION TO DATA VISUALIZATION June 8, 2017 R. Jordan Crouser & Amelia McNamara Statistical &

Coming up next

• Grammar of graphics• Introduction to ggplot2

• Lab: Make a Scatterplot