GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
• Strong Understanding of systems (homogeneous description, primary product viewing), Opendap/Thredds delivery technology together with NetCDF/CF (a GODAE standard) lot of good tools available and underwork for data access
• Weak ocean catalogues of reference user guidance operationality & quality proof user feedback analysis volume handling on internet education on data management issues
Report on Product & Data servers Strengths & Weaknesses
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
Catalogue
Embedded GODAE catalogues (// Seadatanet): systems – products – services
(action 27 done template for catalogue of systems)
Master ocean data cataloguesIdentified firstPush interdependenciesRecord product (inventory level)
into relevant master catalogue
Report on Product & Data servers Outcome 1
Collaborative Environment
SEADATANET GCMD
EO Portal
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
Spatial Representation
Metadata Contact
Data Identification Info
Content Information
Extension Information
Portrayal Catalog Info
Application Schema Info
Metadata Constraints
Metadata Maintenance
Distribution Info
Reference System
Data Quality InfoMetadata
Online Source
Responsible Party
Citation
Required
Conditionalor Optional
LanguageCharacter SetHierarchyStandard Name,Version Date
ISO 19115Organization
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
Data server report
Do we want to revise report format ?
Report made available on the public web (‘cms’ format prefered)
KPI ? (action 28)
Report on Product & Data servers Outcome 2
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ?What we know !
• KPI stands for Key Performance Indicators.
The main goal of the KPIs is the provision of needed information to measure & evidence the end to end performance of GODAE.
KPIs are Quantifiable, Synthetic, Accurate,
Targeted.
Among others, KPIs are also good tools to point out strengths and weaknesses.
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
• 3 profiles of KPI users:
– the GODAE Board to report to the GODAE Patrons on feasibility & utility
– the GODAE Operators to report on implementation & usefulness,
– the GODAE Users to ensure that products are visible, accessible and useable, and have feedback on products use and needs
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
• 3 key issues identified so far:
– KP1: Quality of organisation (& efficiency)“Do the systems do what they say they will do?”
– KP2: Quality of production (& consistency) “Have the productions reached the operational and qualified level?”
– KP3: Use performance “How well the products meet user needs?”
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ?What we know !
KP1: Quality of organisation (& efficiency)Where are we in implementation?
Number of regional and global demonstrationsClear visibility & understanding of systemsHow many systems are operational or suited for reanalysis?Can we evaluate the gain in implementation (faster or delayed)?Long-term technical coordination solutions?Other?
Commitment of systems to the data sharing plan?MetadataVocabularyFormatAccess ToolsReference fields
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
KP1: Quality of organisation (& efficiency)Has this ease product access?
Availability of productsConfidence in productsAny integrated application ….Other ?
For what they are used?Countries & visitors (evolution curve)Range of applications, and number per yearRange of services (ocean catalogues, operational applications)
Following on KPI action
What do we want to know ?What we know !
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
KP2: Quality of production (& consistency)How far in operationality?
System status clear(research & development, reanalysis mode, demonstration, pre-operational, operational, stopped)
Dissemination/accessibility status clear(production OK, dissemination OK, timeliness, be it for real time or historical data, services failure)
Track of changes and key data streams clear (cf. synchronised observations)Long term issues (time series context & consistency)
Back-up scenario
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
KP2: Quality of production (& consistency)How far in qualification?
(report with a qualification status, may depend on system type - reanalysis, operational forecast, observations -)
agreement on metrics productsproduction set uproutine production
How is shown qualification?Report with a qualification status
(research & development, periodic/operational assessment)Qualification data (random or regular validation report, ocean
resolution achieved, forecast skill computation, model errors)Dissemination & availability of the qualification indication
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
KP2: Quality of production (& consistency) Is the products well defined & described
(coherent and meaningful)? Use of common vocabularyCoherency in system descriptionGuidance for accessGuidance for useGuidance for qualification
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
KP3: Use performanceHow the user is aware of products?
(visibility of key data streams) In GoogleFederated cataloguesList of available systems (with user guidance)List of products servers (with user guidance)List of integrated services (with user guidance)
How simple to access the products? (effective distributed dissemination system)
Registration process Interoperable use (pull) versus push systemAdvanced tools (extractors) Internet capacityDistribution services capacity (volume/needs)
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
What do we want to know ? What we know !
KP3: Use performanceHow they are used?
Datasets usedParameters selectedSpace and time windowHow oftenPreferred services (catalogue, access, advanced tools)
Any user feedback? Is the product well understood?
Strengths and drawbacks, ComplaintsShowcases and age of showcaseNumber of distributed working group and size of the groupNumber of projects or collaborations liaised to GODAEBenefit? Other ?
Following on KPI action
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
Data server report
Do we want to revise report format ?
Report made available on the public web (‘cms’ format prefered)
KPI ?
Report on Product & Data servers Outcome 2
Does GODAE need a quantitative measurement system ?
What indicator is worth to be maintained and monitored in time?
Is the context, clear enough to get coherent & useful indicators ?
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
OGC standards (action 30)
See Keith Haines & Jon Blower paper
– Web Coverage Service (WCS) Opendap serve gridded data in continuous “coverages”
– Web Map Service (WMS): serve 2D Geospatial maps for GIS applications.
– Web Feature Service (WFS): to serve Geospatial feature data like terrestrial limits, river positions, ARGO float locations, satellite/ship track.
Report on Product & Data servers Outcome 3
Oil spill detection processor
ERS SAR online data access
Ship detection processor
ERS SAR online data access
ERS SAR catalogue
Envisat ASAR catalogue
RadarSat catalogue
Wave height & direction model
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
Application cases
– DEWS (UKMO), ATOLL-MOTU (CLS) serve NetCDF data
– Godiva2, Argonautica serve Google Maps
What’s next ?
– Cf. presentation (Stefano Nativi, [email protected])
Report on Product & Data servers Outcome 3
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
A common interoperability architecture
• A service view– Data Observation & Measurement services– Data Storage, Management & Processing services– Data Inventory & Access services– Data Discovery & Query services– Data Browsing and Evaluation Services– Data Portrayal and Visualization services– Data Download services– Data Security services
SOCIETY
INFRASTRUCTURES,
PLATFORMS
and SYSTEMS
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
The GI community architecture
Data Inventory, Access &
Download Services
CS-W
(ISO profiles)
WFS
WMS
Data
Visualization
Services
WCS
Data Access & Inventory Tiers Data Presentation Tier
SHP
GeoTIFF
Others...
..
netCDF
Data Tier
Data storage. Management &
processing Services
Viewservices
WMS
Viewservices
ISO GF
DataModel
ISO 1911519119
(Profiles)
Data Catalog Tier
Data discovery
& query
Services
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
The netCDF-Community architecture
Data storage. Management &
processing Services
THREDDS
Data
Server
HTTP
OPeNDAP
Data
Visualization
Services
WCS
Data Presentation Tier
GRIB
HDF
Others...
..
netCDF
NetCDF &the
Common DataModel
Data Tier
Data Access & Inventory Tiers
Data Inventory, Access &
Download Services
19115
ISO profiles
DatasetInventoryCatalogModel
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
GRIB
HDF
Others...
..
netCDF
Data Access & Inv. Tiers Data Presentation TierData Tier
THREDDS
Catalog
Service
HTTP
OPeNDAP
WCS
SHP
GeoTIFF
Others...
..
netCDF
WFS
WMS
WCS
Viewservices
WMS
Viewservices
Mediation &
Brokering
service
NetCDF &the
Common DataModel
ISO GF
DataModel
Data Catalog Tiers
CS-W (ISO
profile)
CDI service
Other ISOCompliantservices
ISO 19115ISO 19119
ProfileModels
DatasetInventoryCatalogModel
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
Data model harmonization
ISO 19123Data Model
netCDFData Model
CFMetadata
Data Models Mediation
GISInformationCommunity
Earth SciencesInformationCommunity
ncML-GML
Encoding Model
ncML-GML
Encoding ModelncML
EncodingModel
ncMLEncoding
Model
GML 3.xEncoding
Model
GML 3.xEncoding
Model
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
ncML-GML
• Mediation Markup Language• An extension of ncML (netCDF Markup Language) based on GML
(Geography Markup Language) grammar
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
And now merging possible with other type of data
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
GODAE August 2007Contribution from F. Blancfor IGST, August 2007
http://www.GODAE.org
GIS service for system assessment ?
Report on Product & Data servers Outcome 3