Transcript
Page 1: ICS Data & Products Preservation EPOS-IP WP10: services and data · 2017. 4. 11. · EPOS-IP WP10: services and data provision for the GNSS community GNSS Data Gateway (CNRS) GNSS

EPOS-IPWP10:servicesanddataprovisionfortheGNSScommunity

GNSSDataGateway(CNRS)

GNSSdatanode

GNSSdatanode

EUREFPermanentNetwork

GNSSdata

GNSSProducts

GNSSProductGateway(UBI/C4G)

GNSSProductnode

GNSSProductnode

ICS Data&ProductsPreservation

GNSSdatanode

GNSSProductnode

ABSTRACTThe EPOS-IP WP10 – “GNSS Data & Products” is the Working Package of the EPOS-IP project in charge of implementing the necessary services in order that the geo-sciences community can access the existing Pan-European Geodetic Infrastructures. The WP10is formed by representatives of the participating institutions (10) but it is also open to the entire geodetic community. In fact, WP10 also includes members from other institutions/countries that formally are not participating in the EPOS-IP.During the EPOS-IP project, the geodetic component of EPOS (WP10) is dealing essentially with Research Infrastructures focused on continuous operating GNSS (cGNSS). The option of concentrating the efforts on the presently most generalized geodetic toolsupporting research on Solid Earth was decided in order to optimize the existing resources. Furthermore, although the focus is on Solid Earth applications, other research and technical applications (e.g., reference frames, meteorology, space weather) can alsobenefit from the efforts of WP10 towards the optimization of the geodetic resources in Europe.We present and discuss the plans for the implementation of the thematic and core services (TCS) for GNSS data within EPOS and the related business plan. We will focus on strategies towards the implementation of the best solutions that will permit to theend-users, and in particular geo-scientists, to access the geodetic data, derived solutions, and associated metadata using transparent and uniform processes. The collaboration with EUREF is also an essential component of the implementation plan.

TASKS10.1Strategicactivitiesandgovernance10.2CoordinationandInteractionwiththeGNSSCommunity10.3InteroperabilitywithEPOSICSandtesting10.4GNSSDataDissemination10.5GNSSDataGateway10.6GNSSProducts10.7GNSSProductsGateway

TASK 1EPOS-GNSS LONG-TERMMISSIONEPOS-GNSS supports Solid Earth Sciences in Europe throughthe European Plate Observing System (EPOS). Its goals are

- to facilitate access, through the European Plate ObservingSystem (EPOS), to relevant GNSS data, meta-data, and dataproducts

- to coordinate the archiving of relevant GNSS data, metadataand data products

- to promote best practice for GNSS station operation, dataquality control and data management

- to maintain and distribute open source software for GNSSdata and metadata discoverability

- to maintain and develop GNSS data products

These efforts are done in close partnership with EUREF, the IAG(International Association of Geodesy) sub-commission for theEuropean Reference Frame.

SCHEDULE FOR SETTING UP GOVERNANCEM6 (March 2016): List of DDSS (data, data products, serviceand software) that will be delivered + which agency willprovide themM6-M12: Prepare draft Consortium Agreement (CA) andcirculate it amongst the legal departments of the differentpartnersM12 (Sept 2016): Consortium agreement readyM12-18: Circulate consortium agreement for signatureM18 (March 2017): Consortium agreement signed by allpartnersM18-M24: Populate boards (governance, executive, advisory)and have first meeting of Governance BoardM24 (Sept 2017): Governance in place (people names andboard meetings held)M36: ERIC functioningM36-M??: set up of service agreements between ERIC and TCS

TASK 3

METADATAcatalogue

WP10APITheGlassGeodetic

Package

ProductRepository

DataRepository

Metadata:CERIFDefinitionofcommunity,standard-based metadata

APIsDefinitionofAPIsfordatadiscoveryandfordataaccess/retrieval

Groups• NearFaultObservatories• Vucanology• Anthropogenic

DataRepository

MultiDisciplinary• GeoHazards• GeoResources

Modelling• Numerical• Analogical

AAAStandardProceduresforAuthentication,Authorization,Auditing

API/WebService.AAA

EPOSICS

EUREF

TASK 4 TASK 5Task 4 deals with the development of a new concept of GNSS datamanagement integrating as many as existing research infrastructures inEurope. Namely, we aim at supporting both data users and providers withan interactive station metadata inventory, an easy interactive and non-interactive site selection and corresponding file downloads, a feedback ondata quality and availability. The work in the Task 4 consists in:• Definition of metadata standards and data quality metrics including the

design of relevant database structure and stored procedures withinterfaces to data providers and users.

• Development of GLASS – an integrated package to be installed at alllevels of a single/multi-level GNSS infrastructure. This package isconstituted by several components that are being developed:• A common database scheme (including data & products);• Web Services (GSAC-like) for queries and data mining on the data andmetadata;

• QC tools;• Submission and Validation of metadata;• Tools to guarantee synchronization and consistency of the databases;• Tools to guarantee redundancy and uniqueness of data andmetadata.

• Implementation of the dissemination prototype including the datagateway, metadata submission centre, data monitoring centre and ahierarchical structure over selected repositories.

• Testing and assessment of the dissemination prototype and itsfunctionality for specified use cases.

This task will coordinate activitiesin order to guarantee theinteroperability between the GNSSservices (and more specifically thedata and products gateways) andthe ICS. It will also work with otherTCS to promote multi-disciplinaryinteroperability, with special focuson Seismology, Volcanology, NearFault Observatories andAnthropogenic Seismicity. TheEPOS GNSS data preservationpolicy and identification oftechnical solutions to datapreservation will be carried out inthis task. Finally, the task isresponsible for coordinatingvalidation and testing phases.

TASK 2

TCSGNSS

PartnersCommercial&

Researchnetworks

National&Scientificanalysiscenters

ServicesCoordinationBoard(EPOS)RepresentativesfromCoreServices

(TCS- ICScoordination)

SolidEarthCommunity

CoordinationInteraction with potential data and product providers

Outreach & Interaction

Establishing communicationchannels for the interaction withthe whole GNSS community andcontribute in supporting EPOScommunication strategy. Thistask is also coordinating theactivities for measuring theimpact of the provided servicesand data provision. It will also bein charge of communicationamong partners, interact withexternal organizations,coordinate the organization ofpresentations to the externalcommunity and identify andmanage the formal interactionwith additional data & productproviders.

The European EPOS GNSS data gateway is the gatewayfor accessing data and metadata of the 2000 stationsfrom different local data centers.The GNSS data gateway is located at Geoazur/OCA,France, and maintained by CNRS.This uppermost node of the EPOS GNSS data flowarchitecture is running the GLASS software packagedeveloped in Task 4 without related data repository,unlike the lower nodes that are most often associatedto data repositories. The GNSS data gateway also hoststhe centralized T1 metadata data base. The currentrequest estimate on this central data gateway envisionsabout 500 queries per day.Related to the central T1 metadata base is the T1submission center that will be used by all data providersin Europe as a unique point to enter and update the T1metadata. This submission center will be managed andlocated at ROB, Belgium.

The scheme on the left shows an example of thenetwork architecture of GLASS nodes relating EPN (Pan-European Network for EUREF), RGP and RENAG (twoFrench networks), RENEP and SERVIR (two Portuguesenetworks) as examples for national intermediate nodes,the DGW and the ICS. Rectangles are the GLASS nodes,diamonds are the data bases, cylinders are the datarepositories.

TASK 6 TASK 7This task is responsible for:i) development of Guidelines for processing, implementing

massive processing at 2 EPOS processing centers (CNRS &INGV) to obtain European-scale solution, and harmonizeddistributed processing at National Analysis Centers;

ii) combination of daily/weekly solutions to obtainhomogeneous station time-series and velocities (FOMI) andcombination of solutions at the velocity level (large-scaleEuropean solutions, EPN densification product, and solutionsfrom National processing centers);

iii) derivation of strain rate maps;iv) testing and validation of the combination products and

testing of alternative combination strategies.

−70˚ −60˚ −50˚ −40˚ −30˚ −20˚ −10˚ 0˚ 10˚ 20˚ 30˚ 40˚

30˚

40˚

50˚

60˚

70˚

80˚

−70˚ −60˚ −50˚ −40˚ −30˚ −20˚ −10˚ 0˚ 10˚ 20˚ 30˚ 40˚

30˚

40˚

50˚

60˚

70˚

80˚

Selected network that will be initially processed to validate procedures.

The European EPOS GNSS product gateway is the gateway forthe official EPOS Products (Coordinate Time-Series, Velocitiesand Strain Rates).The GNSS Product gateway is located at SEGAL (UBI/IDL),Portugal, and maintained by C4G.

[email protected]

−90−75−60−45−30−15

0153045

2006 2008 2010 2012 2014 2016

trend = −0.45 _+ 0.12 mm/yr

year

vert

ical

(mm

)

0306090

120150180210240270300

2006 2008 2010 2012 2014 2016

trend = 21.69 _+ 0.07 mm/yr

year

long

itude

(mm

)

−60−30

0306090

120150180210

2006 2008 2010 2012 2014 2016

trend = 16.98 _+ 0.10 mm/yr

year

site AQUI

latit

ude

(mm

)

Example of the analysis of acoordinate time-series to estimatethe secular motion together withseasonal signals plus co-seismicdisplacements

Site: l'AquilaEarthquake: 6 April 2009

Task 4: GNSS data dissemination

GLASS node (gateway)

GLASS nodes (networks)

GSAC nodes (networks)

GLASS nodes (networks)

GNSS repositories

Metadata interface

GNSS repositories

Metadata interface

GNSS repositories

GNSS data gateway (DGW) And central database of metadata Type 1

Physical repositories (existing) Local generation of metadata Type 2 and 3

Integration level (virtual)

Physical level (file repositories)

Metadata & interface (virtualization)

Standard tools (for handling data and meta-data)

Metadata interface

Monitoring centre Data quality and availability, metadata consistency

PARTNERS:UBI/C4G(PT),ROB(BE),CNRS(FR),INGV(IT),NOA(GR),GOP(CZ),IMO(IS),FOMI(HU),KOERI(TK),INCDP-RA(RO)