Open Data: presentation to NTT Data seminar

Open Data

Andrew Stott

UK Transparency Board

formerly Director, data.gov.uk

Edinburgh

19 July 2013 0.1

@dirdigeng

andrew.stott@dirdigeng.com

2

3

4

What is Open Data?

5

Open data is

data

that can be

freely

used,

reused

and redistributed

by anyone

for any purpose.

6

7

8

9

10

11

12

estate

agents/

realtors

Financial

services

builders and

other local

services

13

14

Economic Value of Open Data

Open Gov Data in EU would increase

business activity by up to €40 bn/year

EU Direct & indirect benefits up to €140

bn/year (0.7% of GDP)

Spanish study found ~€600m of business from

open data with >5000 jobs

Australian study: ~500% ROI from open data

Deloitte found open data was reused 10x-100x

more than charged-for data

15

All economic analysis and case studies

point the same way

Open Data as a Transport Investment

16

TFL Open Data

ROI = 58:1

HS2

ROI = 1.4:1

(if we’re lucky)

17

EU “Open Government Data” Directive

18

19

20

National Information Infrastructure

Global Positioning System data now has

$122bn/yr benefits to US economy alone

UK National Mapping Agency data supports

£100bn/yr of GDP activity

Open Weather Data in US has created 400

companies employing 4000 people

Open addressing data in Denmark now gives

€14m/yr benefits and 70:1 ROI

21

Government can be an Open Data user too

22

23

Performance of individual schools

24

Performance of individual hospitals

25

12+ Weeks

MRSA-free

Good C-Diff

record Low

Mortality

2 recent

MRSA

Blood

clots

Patient

ratings

1000 less heart surgery deaths each year

26

Performance of local police and courts

27

28

29

Citizen-sourced data

30

#uksnow TN13 4/10

Open Data improving public services

Publishing the UK’s 240 cardiac surgeons’ individual

clinical outcomes reduced deaths by 1000 a year

1000s of apps delivering public transport information

in the United States – 68 in New York alone

UK released data on location of 300,000 bus-stops;

OpenStreetMap corrected 18,000 of them, improving

official data accuracy.

Sharing Open Data within public agencies in

Manchester (city of 2.6m people) saves US$14m/yr

Open Data on public agency purchasing has allowed

a “whole of government” view to get best prices and

performance from key suppliers

31

32

Transparent and Accountable Government

33

Is My Money Being Spent Well?

34

35

Organisational Transparency

36

Where the person

is in the structure

Pay

Responsibilities

Contact details

International Corporate Transparency

37

Open Data for Accountability

Open Data exposed CAN$3.2bn misuse of charitable

status in tax code in Canada

Publishing UK Senior Civil Servants’ expenses

reduced claims by ~40-50%

Open Data exposed racial discrimination in water

supply in Zanesville, United States – victims won

$10.9m compensation

UK civil service pay data exposed people paid twice

as much as the Head of the Civil Service and three

times as much as the Prime Minister

38

Some Challenges

39

Everyone thinks that they are an exception

It’s held separately by n different organisations, and we can’t join it up

It will make people angry and scared without helping them

It is technically impossible

We do not own the data

The data is just too large to be published and used

Our website cannot hold files this large

We know the data is wrong

We know the data is wrong, and people will tell us where it is wrong

We know the data is wrong, and we will waste valuable resources

inputting the corrections people send us

People will draw superficial conclusions from the data without

understanding the wider picture

People will construct league tables from it

It will generate more Freedom of Information requests

It will cost too much to put it into a standard format

It will distort the market

Our IT suppliers will charge us a fortune to do an ad hoc extract

40

Release data people want

41

Ensuring reusability as well as accessibility

42

When Open is not Open

43

“You shall not use the data made

available through the GC Open Data

Portal in any way which, in the opinion

of Canada, may bring disrepute to or

prejudice the reputation of Canada.”

Common standard for common things

44

Patchy across borders

45

Citadel Project

Sense location

Locate data repository

Search for required data

Obtain metadata

Build strategy and tool

chain to use the data

Access data, convert,

and display it

Now over to the user

Privacy

47

End

48

49