15
Capacity building at the National Meteorological Institute: Training personnel to apply quality control tools. National Meteorological Institute José Luis Araya López. P.O. Box 5583-1000 San José, Costa Rica Tel. (506) 22225616 E-mail: [email protected]

Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Capacity building at the National Meteorological Institute: Training personnel to apply quality control 

tools.

National Meteorological Institute José Luis Araya López.

P.O. Box 5583­1000 San José, Costa RicaTel. (506) 22225616

E­mail: [email protected]

Page 2: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

As part of an  initiative  to  improve  the quality control procedures at  the costarican meteorological  Institute, new operational  tools  to  check  large amounts  of  data  were  developed.  These  tools  rely  on  open  software technology.  In  order  to  allow  this  scientific  computing  software  to  be properly used by technicians, a capacity building effort was undertaken. 

Page 3: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Goals

1)  Generate  capacity  building  on  the  most  well­known  quality  control techniques, as well  as    computing  tools  that  facilitate  their application  in an operational context.

2) Develop operational tools that can deal with large amounts of data.

3) Generate confidence on the effectiveness of these quality control tools.

4)  Develop  quality  control  tools  that  can  be  applied  by  data  network personnel, so that their capacity   to   detect   anomalous   information   is   enhanced. 

Page 4: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

NMI data network distribution

Page 5: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Training personnel on

basic programming

and use of quality control

tools

Isolating atypical values. Validating

and flagging outliers detected.

E-learning , development of quality control

tools

Application of quality control

scripts

1

23

4

Page 6: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Equipment ­  3 PCs­  Scientific computing software

Personnel responsible for development and training:­  1 technicians­  2 Meteorologists

Trained personnel:l ­  4 technicians

Page 7: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

E-learning Scientific computing

software

http://www.python.org/

http://www.scilab.org/

Scilab

http://www.scipy.org/

http://matplotlib.sourceforge.net/

Python

Scientific papersTechnical

documentation

http://journals.ametsoc.org/

Page 8: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Methods for transfering knowledge to technicians:

1) Training on basic programming of scientific computing software.

2) Development of tutorials for application of quality control tools.

Page 9: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Surface air temperature

Meteorological parameters that can be checked using the new QC programs

Meteorological parameter Qc script developed? What was measured?

Relative humidity

Radiance

Precipitation

Wind

Surface atmospheric pressure

Yes Yes

Hourly

Yes Yes

Yes NGD (*)

Yes NGD

Yes NGD

Yes NGD

Mx Mn Av/Tot

Yes Yes Yes

Yes Yes Yes

Yes Yes Yes

NGD NGD Yes

NGD NGD Yes

YesNGD NGD

(*) Data are not calculated and stored in the data base.

Daily

Page 10: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Quality control script is executed

Plots are generated

Reports for validation of atypical data are generated

Atipical data are isolated. Quality control flags are included 

in  the final data set.

Quality control script is executed

Quality control algorithms are applied  

Data are stored in  data base

Page 11: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Scilab Quality control script for checking wind speed, and direction. This kind of programs include diverse quality control, plots and reports that isolate suspicious data for further investigation. 

Page 12: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Python Quality control script for checking radiance data sets. This script includes quality control algorithms, plots and reports that isolate suspicious data for further investigation. 

Page 13: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

New quality control tools have allowed the personnel to improve their ability to detect anomalous situations in meteorological data. 

Page 14: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Challenges to tackle in the near future:

   1) Follow­up   of   quality   control   operational   research.

   2) Development of a real­time quality control protocol.

   3) Improvement of quality control tools.

Page 15: Capacity building at the National Meteorological Institute ...projects.knmi.nl/geoss/wmo/TECO2010/ppt/session_4/4(02)_araya.pdf · In order to allow this scientific computing software

Thanks for your attention!