Embed Size (px)
Citation preview
Data Deluge and Data Sharing Platform
Vincenzo PatrunoISTAT
Michelangelo, the deluge
IMAODBC 2011Óbidos 19-23 Sept
data deluge
“the sheer volume of new data being generated is overwhelming the capacity of institutions to manage it and researchers to make use of it”.
IMAODBC 2011Óbidos 19-23 Sept
data dissemination
Data Producers Data Consumers
IMAODBC 2011Óbidos 19-23 Sept
who are data producers?
National Statistical Offices
IMAODBC 2011Óbidos 19-23 Sept
who are data producers?
National Statistical Offices
Government Agencies
IMAODBC 2011Óbidos 19-23 Sept
who are data producers?
National Statistical Offices
Government Agencies
Regions
IMAODBC 2011Óbidos 19-23 Sept
who are data producers?
National Statistical Offices
Government Agencies
Regions
Municipalities
IMAODBC 2011Óbidos 19-23 Sept
who are data producers?
National Statistical Offices
Government Agencies
Regions
Municipalities………………
IMAODBC 2011Óbidos 19-23 Sept
opendata and datagov initiatives
Datagov initiatives are rising all over in the world
IMAODBC 2011Óbidos 19-23 Sept
set the data free
Open data initiatives drive Public Sector to set the data free
IMAODBC 2011Óbidos 19-23 Sept
the risk is to put data in jailIMAODBC 2011
Óbidos 19-23 Sept
the data huntingIMAODBC 2011
Óbidos 19-23 Sept
time consuming
=
IMAODBC 2011Óbidos 19-23 Sept
open data and datagov initiatives
Data Catalogs
IMAODBC 2011Óbidos 19-23 Sept
open data and datagov initiativesIMAODBC 2011
Óbidos 19-23 Sept
datamarket platforms
…
IMAODBC 2011Óbidos 19-23 Sept
unstructured data
the growth of data deluge
the growth of unstructured data
IMAODBC 2011Óbidos 19-23 Sept
structured dataIMAODBC 2011
Óbidos 19-23 Sept
structured dataIMAODBC 2011
Óbidos 19-23 Sept
metadataIMAODBC 2011
Óbidos 19-23 Sept
metadataIMAODBC 2011
Óbidos 19-23 Sept
The data Sharing PlatformIMAODBC 2011
Óbidos 19-23 Sept
Upload dataset
+unstructured
metadata(descriptions)
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
country area time value
US Wyoming Year 2008
1065336
US Wisconsin Year 2008 11255934
US West Virginia
Year2008
3628936
Resident population
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
data metadata
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
country area time value
US Wyoming Year 2008
1065336
US Wisconsin Year 2008 11255934
US West Virginia
Year2008
3628936
Resident population
001 US 001 Wyoming 001 Year 2008
metadatabase
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
country area time value
US Wyoming Year 2008
1065336
US Wisconsin Year 2008 11255934
US West Virginia
Year2008
3628936
Resident population
001 US 001 Wyoming 001 Year 2008
metadatabase
… Level of detail
Time from
Time to Area code
Category Dataset
… Regional 2008 2008 US Population Resident Population
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
Upload dataset data
metadataMatching1
2
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
Public matadata Private metadata
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
public matadata
private metadata
data
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
Upload dataset dati
metadatiMatching
Json
Web GUI
SPARQL
SDMX Query Builder
IMAODBC 2011Óbidos 19-23 Sept
The data Sharing Platform
the vision
data on the web
data in the Web
IMAODBC 2011Óbidos 19-23 Sept
the end of data deluge
Thank [email protected]
http://www.vincenzopatruno.orghttp://www.segnalazionit.org
IMAODBC 2011Óbidos 19-23 Sept
