Upload
stephany-james
View
225
Download
0
Tags:
Embed Size (px)
Citation preview
Progress of CMA TIGGE Archive Data center
(updated)
Bian Xiaofeng ,Li Xiang ,Sun Jing
(National Meteorological Information Centre,CMA)
Chen Jing Hu Jiangkai,
(National Meteorological Centre,CMA)
22 - 24 February, 2010, Geneva,Swiss
Archive Centre
Current Data Provider
NCAR NCEP
CMC
UKMO
ECMWFMeteoFrance
JMAKMA
CMA
BOMCPTEC
IDD/LDM
HTTP
FTP
Archive Centre
Current Data Provider
NCAR NCEP
CMC
UKMO
ECMWFMeteoFrance
JMAKMA
CMA
BOMCPTEC
IDD/LDM
HTTP
FTP
TIGGE Archive Centers and data providers
Courtesy of Steve Worley, NCAR
UPDATE: TC CXML Providers:• CMA – yes ECMWF – yes Met Office - yes• JMA - yes NCEP – yes CMC - yes (via
NCEP)• KMA - yes
CMA hosts Asia TIGGE Center
3
Platform (Hardware & Software)
• Linux Cluster (named “Purple Haze”)
• 7 Nodes (IBM X series)• 1 node for Management• 3 node for exchanging data with ECMWF, NCAR,
CPTEC, CMC via LDM• 1 node for data processing • 1 node for MARS server (testing), 1 node for
MARS client• 2 node for ftp server• Connected via GB Ethernet
• Storage: Disk Array• Physical Capacity: < 30 TB• Interface: 4GB-FC
• GPFS:• installed on each node • configured for sharing data within the cluster
TIGGE Platform Update since 2009
• Apr.2009 Increasing EMS Memory of Nodes,– LDM ---32GB,– Others ---- 16GB
• Jun.2009 : the real-time updates of the TIGGE information on monitoring and requests.
• Jan.2010: expanding 15TB disk array
CenterForecast Length
(Hour, Day) Members Le vel time Start dateGB/Day
Total(GB)
egrr(UKMO) 0000-0360, 15 24 pl, pt, pv, sl 2(00,12 11/2006 24 28,464
babj(CMA) 0000-0240, 10 15 pl, sl 2(00,12) 02/2007 28 30,660
ecmf(ECMWF) 0000-0360, 15 51 pl, pt, pv, sl 2(00,12)03/200701/2010
150332
157,130
kwbc(NCEP) 0000-0384, 16 21 pl, pt, pv, sl 4 (00,06,12,18) 04/2007 12 12,764
rjtd(JMA) 0000-0216, 9 51 pl, sl 1(12) 05/2007 7 6,990
ammc(BoM) 0000-0240,10 33 pl, sl 2(00,12) 05/2007 8 8,048
cwao(CMC) 0000-0384,16 21 pl, sl 2(00,12) 10/2007 7.5 6,220
lfpw(Meteo France) 0000-0060, 2.5 11 pl, pv, sl1(18)
2(06, 18)10/200712/2009
0.22
286
rksl(KMA) 0000-0240,10 17 pl, sl 2(00,12) 01/2008 5 3,659
sbsj(CPTEC) 0000-0360, 15 15 pl, sl 2(00,12) 02/2008 12 9,340
total 437 260,560
TIGGE Data at CMA : 260TB until 15 Nov.2009
Note:PL = Pressure Level, PT = 320K θ Level, PV = ± 2 Potential Vorticity Level, SL = Single/Surface Leveln
Update of TIGGE data provider :
• LFPW(Meteo France) : since 8 Dec. 2009 , increasing 29274 fields at 06Z and 35152 fields at 18UTC
• RKSL(KMA) : since 18 Dec 2009, increasing 3009 fields at 00Z and 12UTC
• ECMWF: increasing model resolution from N200 to N320, data up to 330GB/day
CMA portal offers services:
- Access to online & offline data
- Aggregation along any axis (date, level, parameter, origin, ensemble, …)
- Product Generation on Webpage
- Request Monitoring and Query
- User Management and Access Control
- Sub-area selection
- Reduces volumes to be downloaded by many order of magnitude ( Divided into more small tar files )
Access control– Administrator: access the whole system and all services
– Common users
• Super Member: access both Data Catalogue and Product Catalogue
• Data Member: access Data Catalogue
• Product Member: access Product Catalogue
Common users are denied access to the User Admin component, and can only monitor or query the status of their own requests.
User Admin Data Product Request Monitoring/Query
Product Member partial
Data Member partial
Super Member partial
Administrator all
10
TIGGE Data Service by Dec. 2009Supporting 2008 Beijing Olympic Gameweather
serviceTwo trainings for TIGGE users from chinese
research institutes, universities, national and regional meteorological center in 2009
User accessing:Online: data for the last one month.
Offline : data for one month ago
Produce special dataset for research projects
– For example, service dataset during flood seasons in 2007-2008 ( include ecmf 、 kwbc 、 babj 、 rjtd, et al )
– 40 TB data services until 12 2009 for researchers in China
– To reorganize the list and put on the website
TC CXML data Receiving status at CMA TIGGE Archive Center
centerCentercode
AccessingLagged hours
CMC cwao FTP 11.5h
CMA babj FTP 8.5h
ECMWF ecmf FTP00Z: 7h12Z: 16h
JMA rjtdDSS of
NCAR00Z: 12h12Z: 24h
KMA rksl FTP 8h
UKMO egrr FTP 8.5h
NCEP kwbc FTP 7.5h