WMO

New Climate Databases Management Systems

(CDMSs)EXPERT MEETING ON METEOROLOGICAL INFORMATION FOR

LOCUST CONTROL18-20 October 2004, Geneva

Hama Kontongomde

WMO

(The CLICOM Project )• Main Achievements

– Provision of hardware and commercial software,– Improvement of computerized literacy of the local staff in

developing countries was improved..– Improvement of expertise of computerized climate data

processing (data entry, data quality control, data archiving and retrieval)

• Main deficiencies– Still in DOS– Cannot use different Database Management Systems, – Not a Client / Server System , Internet Connections etc. – No link to Geographical Information Systems (GIS)

WMO

System Name and Software Release Information

Czech Republic

France Jordan Russian Federation

Tunisia Zimbabwe

CLIDATA

CLISYS

JCDMS

CliWare

SDCLIM

CLIMSOFT

21.16.13

1.1

1.1

1.1

1.0

1.0

WMO

New CDMSs

Countries CDMS RDBMS

1 Czech Republic CLIDATA ORACLE

2 France CLISYS ORACLE and OTHERS

3 Jordan JCDMS ORACLE

4 Russian Fed CLIWARE ORACLE and OTHERS

5 Tunisia SDCLIM ORACLE

6 Zimbabwe CLIMSOFT ACCESS

WMO

Metadata

• Elements in the metadata

• Possibility to add more elements

• Possibility of supporting graphical elements

• Information on equipment and instruments

WMO

Metadata •  Station name • station number/identifier • date or date range• latitude/longitude• elevation• country• climate element (temperature, etc)• Maps, photos etc..• other

WMO

Import of Digital Data

• Messages that can be imported (TEMP, METAR, SYNOP, CLIMAT…)

• Importation of multiples data files for one station

• Importation of multiples data files for multiple stations

• Import data from CLICOM

WMO

Validation and Quality Controls

• Quality control flags

• Are QC results stored

• System offers replacement estimates for fail QC

• QC validation

• Method of defining ranges values for comparison

• Spatial coherence

WMO

Data Extraction

• Training time for data extraction (1 hour, 1 day, more than a day..)

• GUI to enter data extraction parameters

• Examples for command line queries

WMO

Type of variables

• Hourly data• Daily data• 10-day data• Other (specify in Annex) • Daily summary• 10-day, monthly, annual summaries• Extreme values

WMO

Output Products• Tabulated data (hourly, daily, …)• Tabular summary of statistical analysis• Typical types of statistical analyses (means,

std, frequency analyses..)• Graphical products (time series, Upper air

sounding, contour analyses..)• Output formats supported (ASCII, HTML,

PDF, XML, CSV…)• WMO messages (CLIMAT, CLIMAT TEMP, ..)

WMO

CLIDATA(Czech Republic)

• Build around the ORACLE RDBMS and associated management and data discovery tools

• professionally designed • scalable for use in all sizes of climate data

organizations • provides multi-language support and

flexible specification of quality control procedures.

WMO

CLISYS(France)

• CLISYS package is built using, primarily, open source software packages

• Major components: Linux operating system, Oracle RDBMS, ZOPE application server, and python scripting language capability.

• Plans are underway to test and evaluate use of the PostgreSQL RDBMS as an alternative to ORACLE an to develop a “light version” of Clisys.

• Stand-alone data entry module (ELIAD) that allows for off-line data entry without requiring a direct connection to the database.

WMO

CLIWARE(Russian Federation)

• CliWare is the most technologically advanced of the systems reviewed

• It uses a client-server model that can access data locally or over a network connection to a remote database through an http socket

• Communicates with the database uses JDBC calls that allow for different database engines to be utilized for the underlying data store (Oracle, SAP DB, PostgreSQL RDBMS ...)

WMO

Real-time data collecting

ReceivingSelectingDecodingQC controlWriting in DB

RelationalDBMS

Omega subsystem

SynopShipUpper airCLIMATBathyTesakBuoysCoastalGribMetarSpeciTaf

WMO GTS Mecom

WMO

Cliware :Non real-time data collecting

CliWare

RelationalDBMS

Applications to load data

Internet

User

WMO

Cliware : Data dissemination

• To disseminate data system uses TCP/IP public network Internet and provides two type of data access: Bach Client (Application) and User. Both types use HTTP protocol to data access. The data and products can be present in formats: MeteoXml, HTML, text tabulated data, graph images, Geo images, FM codes

WMO

J C D M S (Jordan)

• System specifically, to manage data collected from the network of climate data stations in Jordan

• Data tables and attribute definitions are tailored Addition of different observation types and reporting intervals would require modification to the data system which is based on an ORACLE RDBMS

• It has been designed as a replacement system for CLICOM and generally follows the look and feel aspects of CLICOM.

WMO

SDCLIM(Tunisia)

• System designed to specifically to manage data collection for the Tunisia climate data stations

• Screen navigation is difficult to follow at times. The metadata structure was sound (Structured around station information) however the data entry and modification is complex.

• Data output is based on SQL scripts. It is planned to start developing standard output reports using Oracle Reports

WMO

CLIMSOFT(Zimbabwe)

• Climsoft was the only system that is based, entirely, on MicroSoft software and utilizes the MicroSoft Access RDBMS as the core of the system.

• Design based on the utilization of readily available software that would lower the cost of ownership and personnel required to manage and maintain the system.

• Targeted to small meteorological services (The data capacity is currently limited to 2 Gb of data imposed by limits of MS Access.

• The system was extremely slow access time in comparison with other systems evaluated.

CDMS Implementations: completed; planned; under

development

RA I by end 2004Burkina FasoCape VerdeChadGambiaGuinea BissauMaliMauritaniaNigerSenegalLibyaSao Tome & Princ.

RA IV by end 2004BarbadosCubaDominican RepGuyanaHaitiJamaicaTrinidad & TobagoAntigua & Barbuda

System under development in Solomon IslandsAGRHYMET (Niger)

GhanaMadagascarRwanda

CIMH Barbados

EstoniaLatviaLithuaniaMacedoniaKazakhstan

Syria

WMO

Results

• URL : Results of the evaluation :

• http://www.wmo.ch/web/wcp/wcdmp/cdmsfuture/htm/evaluation.html