90
Working with #opendata Tony Hirst @psychemedia

Open edudatawrangling

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Open edudatawrangling

Working with #opendata

Tony Hirst@psychemedia

Page 2: Open edudatawrangling

DATAU

SERS

EducatorsLearners

PlannersMarketers

PolicymakersResearchers

PressNGOs

“DEVELOPERS”

Page 3: Open edudatawrangling

A tools and issues

based view

Page 4: Open edudatawrangling

DATA

TOOLS

USERS

PROBLEMS

Page 5: Open edudatawrangling

Access/obtain data

Make sense of data

Ask specific questions of data

Communicate in a data-centric way

Page 6: Open edudatawrangling

Load dataClean data

Merge/enrich data

Page 7: Open edudatawrangling

DATA

Issues

TOOLS

Page 8: Open edudatawrangling

DATA

OtherTOOLS

Issues

TOOLS

Page 9: Open edudatawrangling

A barrier to access (for the tool user) is

data format

Page 10: Open edudatawrangling
Page 11: Open edudatawrangling
Page 12: Open edudatawrangling

JSON XMLCSVXLS

TSV

.dbHTML

PDF DOCTXT

Page 13: Open edudatawrangling

GLUE LOGIC(Glue code)

Page 14: Open edudatawrangling

=importHTML(URL, “table”, N)

HTML

QUERYABLE DATA

Page 15: Open edudatawrangling

=importHTML(URL, “table”, N)

HTML

INTERACTIVEDASHBOARD

Google Charts

Page 16: Open edudatawrangling
Page 17: Open edudatawrangling
Page 18: Open edudatawrangling
Page 19: Open edudatawrangling
Page 20: Open edudatawrangling
Page 21: Open edudatawrangling
Page 22: Open edudatawrangling
Page 23: Open edudatawrangling

A barrier to access (for the tool user) is

data shape

nother

Page 24: Open edudatawrangling
Page 25: Open edudatawrangling
Page 26: Open edudatawrangling
Page 27: Open edudatawrangling
Page 28: Open edudatawrangling
Page 29: Open edudatawrangling
Page 30: Open edudatawrangling
Page 31: Open edudatawrangling
Page 32: Open edudatawrangling

A barrier to access (for the tool user) is

data cleanliness

nother

Yet

Page 33: Open edudatawrangling
Page 34: Open edudatawrangling
Page 35: Open edudatawrangling

Clear to read?

Page 36: Open edudatawrangling
Page 37: Open edudatawrangling
Page 38: Open edudatawrangling
Page 39: Open edudatawrangling
Page 40: Open edudatawrangling
Page 41: Open edudatawrangling
Page 42: Open edudatawrangling
Page 43: Open edudatawrangling
Page 44: Open edudatawrangling

Questions of identity

Page 45: Open edudatawrangling

The Open UniversityOpen University

OUOpen Uni

Open University, UK

NORMALISATION/RECONCILIATION

Page 46: Open edudatawrangling
Page 47: Open edudatawrangling

Reconciliation to a canonical name

and/or to a unique identifier

Page 48: Open edudatawrangling
Page 49: Open edudatawrangling
Page 50: Open edudatawrangling
Page 51: Open edudatawrangling
Page 52: Open edudatawrangling
Page 53: Open edudatawrangling
Page 54: Open edudatawrangling
Page 55: Open edudatawrangling
Page 56: Open edudatawrangling

A stumbling block (for the data user) is data enrichment

Page 57: Open edudatawrangling
Page 58: Open edudatawrangling
Page 59: Open edudatawrangling
Page 60: Open edudatawrangling
Page 61: Open edudatawrangling
Page 62: Open edudatawrangling
Page 63: Open edudatawrangling
Page 64: Open edudatawrangling

A stumbling block (for the data user) is joining datasets

nother

Page 65: Open edudatawrangling

A stumbling block (for the data user) is joining partially

matched data

huge

Page 66: Open edudatawrangling

Rolling your own interactive data

exploration tools

Page 67: Open edudatawrangling

Google Visualisation

API

Page 68: Open edudatawrangling
Page 69: Open edudatawrangling
Page 70: Open edudatawrangling
Page 71: Open edudatawrangling

googleVis (R)

Page 72: Open edudatawrangling
Page 73: Open edudatawrangling

R Shiny Apps

Page 74: Open edudatawrangling
Page 75: Open edudatawrangling
Page 76: Open edudatawrangling

ui.R server.R

Page 77: Open edudatawrangling
Page 78: Open edudatawrangling
Page 79: Open edudatawrangling
Page 80: Open edudatawrangling
Page 81: Open edudatawrangling
Page 82: Open edudatawrangling
Page 83: Open edudatawrangling

RCharts

Page 84: Open edudatawrangling
Page 85: Open edudatawrangling
Page 86: Open edudatawrangling
Page 87: Open edudatawrangling

Many chart tools do the work for

you if the data is in the right shape

Page 88: Open edudatawrangling

DATA

TOOLS

USERS PROBLEMS

Page 89: Open edudatawrangling
Page 90: Open edudatawrangling

blog.ouseful.info

@psychemedia