Data Deluge and Data Sharing Platform

Preview:

Citation preview

Data Deluge and Data Sharing Platform

Vincenzo PatrunoISTAT

Michelangelo, the deluge

IMAODBC 2011Óbidos 19-23 Sept

data deluge

“the sheer volume of new data being generated is overwhelming the capacity of institutions to manage it and researchers to make use of it”.

IMAODBC 2011Óbidos 19-23 Sept

data dissemination

Data Producers Data Consumers

IMAODBC 2011Óbidos 19-23 Sept

who are data producers?

National Statistical Offices

IMAODBC 2011Óbidos 19-23 Sept

who are data producers?

National Statistical Offices

Government Agencies

IMAODBC 2011Óbidos 19-23 Sept

who are data producers?

National Statistical Offices

Government Agencies

Regions

IMAODBC 2011Óbidos 19-23 Sept

who are data producers?

National Statistical Offices

Government Agencies

Regions

Municipalities

IMAODBC 2011Óbidos 19-23 Sept

who are data producers?

National Statistical Offices

Government Agencies

Regions

Municipalities………………

IMAODBC 2011Óbidos 19-23 Sept

opendata and datagov initiatives

Datagov initiatives are rising all over in the world

IMAODBC 2011Óbidos 19-23 Sept

set the data free

Open data initiatives drive Public Sector to set the data free

IMAODBC 2011Óbidos 19-23 Sept

the risk is to put data in jailIMAODBC 2011

Óbidos 19-23 Sept

the data huntingIMAODBC 2011

Óbidos 19-23 Sept

time consuming

=

IMAODBC 2011Óbidos 19-23 Sept

open data and datagov initiatives

Data Catalogs

IMAODBC 2011Óbidos 19-23 Sept

open data and datagov initiativesIMAODBC 2011

Óbidos 19-23 Sept

unstructured data

the growth of data deluge

the growth of unstructured data

IMAODBC 2011Óbidos 19-23 Sept

structured dataIMAODBC 2011

Óbidos 19-23 Sept

structured dataIMAODBC 2011

Óbidos 19-23 Sept

metadataIMAODBC 2011

Óbidos 19-23 Sept

metadataIMAODBC 2011

Óbidos 19-23 Sept

The data Sharing PlatformIMAODBC 2011

Óbidos 19-23 Sept

Upload dataset

+unstructured

metadata(descriptions)

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

country area time value

US Wyoming Year 2008

1065336

US Wisconsin Year 2008 11255934

US West Virginia

Year2008

3628936

Resident population

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

data metadata

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

country area time value

US Wyoming Year 2008

1065336

US Wisconsin Year 2008 11255934

US West Virginia

Year2008

3628936

Resident population

001 US 001 Wyoming 001 Year 2008

metadatabase

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

country area time value

US Wyoming Year 2008

1065336

US Wisconsin Year 2008 11255934

US West Virginia

Year2008

3628936

Resident population

001 US 001 Wyoming 001 Year 2008

metadatabase

… Level of detail

Time from

Time to Area code

Category Dataset

… Regional 2008 2008 US Population Resident Population

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

Upload dataset data

metadataMatching1

2

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

Public matadata Private metadata

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

public matadata

private metadata

data

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

Upload dataset dati

metadatiMatching

Json

Web GUI

SPARQL

SDMX Query Builder

IMAODBC 2011Óbidos 19-23 Sept

The data Sharing Platform

the vision

data on the web

data in the Web

IMAODBC 2011Óbidos 19-23 Sept

the end of data deluge

Thank you!vincenzo.patruno@istat.it

patrunomeister@gmail.com

http://www.vincenzopatruno.orghttp://www.segnalazionit.org

IMAODBC 2011Óbidos 19-23 Sept

Recommended