Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
S.Simoncelli, M.Tonani
WP10First release of Aggregated dataset
and Future Work Plan
5th STCOM Lucca, 22 September 2013
S.Simoncelli, M.Tonani and WP10 Regional Coordinators
[email protected] – www.seadatanet.org
OUTLINE
• Introduction� last year actions
• Quality Control (QC) analysis by Regional Coordinators (RCs)
• Results
• Future Plans
• Statistical Products due next year
• Some answers for the Advisory Board
• Conclusions
[email protected] – www.seadatanet.org
• Jan: RCs (SDN WP10) received the TS collections
• Guidelines for a first basic QC analysis in ODV and acommon template for the QC report have been defined
• Feb: 1990-2012 sub sets of data have been extracted and
released to MyO In-situ TAC in order to collaborate on the QC
process
• Mar: reports on the entire data collection have been prepared and
presented to SDN StComm
• 10 Apr: RCs WEBEX Meeting on QUALITY ASSESSMENT
• 15 Apr: 2nd SDN-MyO Joint Meeting on data quality assessment
• May: MyO sent to SDN feedback on the quality of regional TS
collections
• 27 Jun: WEBEX on the AGGREGATION PROCEDURE
QC Process
[email protected] – www.seadatanet.org
QC analysis by RCs
QC analysis considered all Qflags in order to identify anomalies andpossible solutions and results were included in short reports
1.Data distribution and data density map
2.Histograms of annual and seasonal data distribution
3.TS scatter plots of the entire dataset� highlighted the necessity of applyinga gross range check
4.TS scatter plot after the range check
5.TS scatter plots of: Qflags=1(good),2(probably good) and Qflags=0(nocheck)
6.Statistics about Qflags
7.Visual control of scatter-plots to identify wrong profiles (outliers)
8.Visual check of spikes
9.Identification of stations falling on land, of wrong or missing data
Outliers have been saved in text files in order to report to both MyO andNODCs
[email protected] – www.seadatanet.org
SDN QC Results
Some data center probably inverted Qflag 1 and 0 � obs flagged as
good (1,2) presented values out of range while most of the obs
flagged 0 were reasonable! � we asked for checking
•RCs do not modify any data or Qflag
•RCs define procedures and priority actions to report on the quality to
data providers to facilitates the update process and the progressive
improvement of the overall quality of the infrastructure.
•STCOMM nominated a responsible person to coordinate the
comunication between NODC - RCs - MyO INSTAC� Christine
Coatanon (Ifremer)
•RCs decided to improve the strategy for future QC analysis through
specific sub-regional QC (areas & depth) and stability check on
density
•RCs will finalize with an harmonized approach the Reports on
Quality Assessment
[email protected] – www.seadatanet.org
Conclusions (1)
• RCs were all active and collaborative in QC
assessment and reporting (to MyO, to NODC, to
users next)
• WP10 acted fostering collaborations andcommunication between
1. partners (WEBEX conf)
2. WPs (WEBEX conf)
3. projects (2 Joint Meetings)
• WP10 will contribute and participate actively totraining activities on data next year
[email protected] – www.seadatanet.org
• Data aggregation and quality assessment procedurewas an extensive and fruitful exercise involving manypeople and institutions. It allowed to ameliorate andrefine each technical phase of the procedure, butmainly to highly improve the quality of SDNinfrastructure content.
• Collaboration between SDN and MyO was crucialduring the data quality assessment and allowed toidentify and correct lots of data anomalies
• Since the quality of historical data collections would behighly improved by an update before the officialrelease, we decided to repeat the aggregationprocedure and repeat the QC assessment
Conclusions (2)
[email protected] – www.seadatanet.org
Future Work
A new aggregation exercise would allow to
1.deliver the best aggregated data sets which mirror the true
infrastructure content (otherwise the TS collection would have a
lower quality than in reality)
2.retrieve also restricted data that have to be used for the
products computation ***
3.the future SDN products (climatologies, maps, profiles) based
on these data collections will be higher quality
*** we kindly ask data provider to allow restricted data retrivalapproving fast data requests� they will be use for internal use
ONLY!!!
[email protected] – www.seadatanet.org
CDICDI
TS aggregated datasetfree-acces, under SDN
licence, + restricted (new!)
TS aggregated datasetfree-acces, under SDN
licence, + restricted (new!)
Arctic
North Sea Baltic Sea Med Sea
Black Sea
1900-2012 COMPLETE
internal use for products
1990-2012SUB-SET MyOcean
1900-2012 UNRESTRICTED
for external release
Noth Atlantic
Future Work
[email protected] – www.seadatanet.org
Work PlanMyO2
Sept 2014Release of DATA PRODUCTSgridded fields, climatological profiles and relative stds
Feb2014 second QC feedback
3°°°°Joint Meeting SDN-MyO ?
END MyO (?)
V1 AGGREGATED DATASET Sept2013POSTPONED !!!!
1. reply to MyO alerts � Sept
2. second QC � Nov
3. second QC feedback to MyO � Dec
Apr 2014 Release of historical data (MyO V4)
Official Release of SDN-MyO Joint Product
second feedback to NODCs
Mar2014
Dec2013
[email protected] – www.seadatanet.org
Statistical Products due M36
OBJECTIVEs:1.to show and synthesize the SDN database content
2. to implement new common QC analysis in synergy with MyOcean INS TAC
based on the new computed climatologies, climatologycal profiles and relative
standard deviation
3.to deliver good quality products to the external users for both data analysis
and modeling purposes
�T and S monthly climatologies (corresponding error field) for allregional seas on the IODE standard vertical levels�Vertical resolution could be higher in some shallow regions
�Horizontal resolution at least equal to SDN1 climatology (refined if data
density allows it)
�Collections of Observations will be integrated with restricted data andexternal data sources
Other parameters could be taken into consideration later in the project
(nutrients, oxygen and chlorophyll) if the data density permits it
[email protected] – www.seadatanet.org
• We will refine our QC procedures
• We will strengthen the collaboration with MyO
in order to deliver them statistical products which
will improve their RT QC procedures, crucial for
modeling purposes (initialization, assimilation,
validation)
• We will deliver useful product to the scientific
community that will show SDN Infrastructure
content
• We need to define product format to meet at best
user requiriments
Conclusions (3)
[email protected] – www.seadatanet.org
VISION:
INTEGRATED MONITORING AND PREDICTION SYSTEM
REAL TIME OCEAN
ASSESSMENT(forecast)
LONG TERM ANALYSIS
(reanalysis)
initializationcalibrationvalidation
[email protected] – www.seadatanet.org
Reply to the Advisory Board
SDN-MyO In situ TAC collaboration
[email protected] – www.seadatanet.org
Reply to the Advisory Board
SDN-MyO In situ TAC collaboration
[email protected] – www.seadatanet.org
SDN-MyO In situ TAC collaboration: data usage example
Reply to the Advisory Board
• Objective: historical data collections in MyO will serve MyO
WP18 dedicated to the REANALYS production
[email protected] – www.seadatanet.org
DATA USAGE EXAMPLES
• OBJECTIVE: historical data collections in MyO will serve MyO WP18dedicated to the REANALYSIS production
• SDN data will be used for data assimilation and reanalysis validation
• EXPAMPLE1: Mediterranean Reanalysis that will be released next yearis assimilating SDN data and used SDN data to compute the initialcondition (SDN climatology)� upcoming pubblication
• EXAMPLE2: upcoming pubblication S. Dobricic, I. Pujol, S. Simoncelli,N. Pinardi 2013 Geosat observations of sea level anomaly improvehistorical estimates of the ocean state in the second half of the eighties
• EXAMPLE3: collabotation with Ozgur Gurses (PhD student) and EminOzoy (METU) on the Maramara Sea model implementation� SDN datafor climatology computation
• EXAMPLE4: Karina VonSchuckmann (Ifremer) used Med climatology+collaboration to use SDN data and compute heat content in the Med
[email protected] – www.seadatanet.org
• SDN TS historical data collections will be delivered at the
end of the year and Quality Assessment Reports will be
finalized by RCs in order to help the users
• D10.2 � postponed from Sep to Dec13
• SDN-MyO Joint Product will be available hopefully in
May2014
• We have to advertise our activities and promote
collaborations on the external usage of SDN products
• We foresee publications for the next year: TS historical data
collections and products delivery will increase exponentially
SDN acknowledgments
• OUR Scientific Pubblication?
!!! web page with instructions for scientific publications
Conclusions (4)
[email protected] – www.seadatanet.org
Thanks to
C. Coatanoan (Ifremer), O. Bäck (SMHI), H. Sagen
(IMR), S. Scory (MUMM), Devrim Tezcan(METU),
Marina Tonani (INGV)
Sylvie Puliquen and all the IN situ TAC of
MyOcean