Embed Size (px)
Citation preview
1
WAMIS Grid Portal under WIS
a Pilot Project from CAgM
WAMIS Grid Portal under WIS
a Pilot Project from CAgM
June. 11. 2008June. 11. 2008
Byong-Lyol LeeKorea Meteorological Administration
Byong-Lyol LeeKorea Meteorological Administration
Commission for Agricultural Meteorology(CAgM)
2
Agricultural Managements
Farm management system
Resource Management
Productivity, stability, quality, sustainability
soil, water, biome, infrastructure, human resource, etc.
Emergence response system
Risk Management
Early-warning, advisory, forecast, outlook, prediction, prognosis, projection
natural hazards, human-induced risks, etc.
Nature : Resource or Hazards ?Up to us !
Nature :Nature : ResourceResource oror Hazards ?Hazards ?Up to us !Up to us !
Decision-Making Support System
System requirementsKnowledge, Monitoring / Warning, Communication, Capability,With Experience, Willingness, Strategy, Resources, Infrastructure, etc.
Model requirementsInformation : initial, boundary, parameters, …Resources : computer, communication, human
Implementation of DMSS : Sharing of I/R using ITAmong users
among institutionsamong member countries
among regions
World AgroMet Information Service
Information Sharing System
Implementation strategyKey componentsService ArchitectureDB requirements
AgMet Model - AMBER
NWP Model – MM5Data & Information Required Short-term forecasts
NWP Model – GCM
Data & Information Required Long-term Predictions
Implementation of WAMIS
Web Portal information sharing
XML-based service : standard schema developmentMachine translation : multi-lingual interfacesOperational applications based on Web service architectureTutorial interfaces for real practices
GRID Portal Resource sharing
Forecast-based AgMet Services for researcher / extensionBenchmarking on AMBER (DWD), expanding with DSATNCAR (GDAS, MM5), DWD (GME, LM) as NWPsSuper ensemble of Seasonal Forecasts (APCC / KMA, etc.)GISC / vDCPC dedicated to WAMIS will be established (NCAR, DWD)LIS (NASA) as a framework for LSM (GDS / LAS + GRID)
[ ET 1.3 pilot project uCAgM project WAMIS grid portalFWIS pilot project WIS pilot project ]
WIS - DCPC – WAMIS – WIGOS - GEOSS
ES2
Earth System
WISWISDCPCDCPCData/ProductionRDF/OWL
G/RG/R--ServerServerWAMISWAMISGrid PortalGrid PortalWeb ServiceWeb Service
GISCGISCMETASERVERRDF/OWL
WIS Pilot Project
GEO CenterDCPC-WAMIS
Impact Assessment氣象/氣候 環境影響評價
Emergence Response國家/地域 非常對應體系
NCAM
WISWIS
WISWIS
WISWIS
WISWIS
WISWIS
WISWIS
WISWIS
WIGOSWMO Integrated GOS
(V) GISC(V) GISC
SIMDATSIMDAT
GISCGISC
UNIDATUNIDAT
Data BrokerData Broker
GDSGDSLASLAS
GTS/WISGTS/WIS
APCCAPCC
GEOSSGEOSS DataData
ArchitectureArchitecture
NetworkNetwork
OBSOBS ProcessProcess Earth SystemEarth System
UserUserInterfaceInterface
DCPCDCPC NCARNCARNCDCNCDCTIGGETIGGE
WAMISWAMIS
Climate ProjectionClimate Projection
SIPSIP
GDAPS / GMEGDAPS / GME
RDAPS / GME : WRFRDAPS / GME : WRF
MesoscaleMesoscale modelmodel
NowcastingNowcasting
Historical (Legacy) dataHistorical (Legacy) data
NonNon--Meteorological DataMeteorological Data
Surface FluxSurface FluxVegetationVegetationSoil ProfileSoil Profile
GRIDGRIDComputing Computing •• Data Data •• AccessAccess
Computation Computation •• ResearchResearchKMA/KISTIKMA/KISTI
WAMIS Grid PortalWAMIS Grid Portal
AMBERAMBERDSSATDSSAT
GIS RSGIS RS
User InterfaceUser InterfaceGridSphereGridSphere
ENDEND--USERSUSERS
K*GRIDK*GRIDeScienceeScience
LDAS/LISLDAS/LISFlux, GHGFlux, GHG
FeedBackFeedBackDecisionDecision--MakingMaking
Impact Impact AssessmentAssessment
Data GridData Grid
MMEMME
AppliedAppliedMeteorologyMeteorology
Pilot ProjectsPilot ProjectsSIMDATSIMDATWAMISWAMISUNIDATUNIDAT
..
..
..
..
WISWIS--WAMISWAMIS
WAMISPortal
ESES22
Earth System Earth System eScienceeScienceKoreaKorea
WIGOSWIGOSWMO Integrated GOSWMO Integrated GOS
RAII - WIGOS/WISRAII RAII -- WIGOS/WISWIGOS/WIS
Standardization
In‐situWIGOS
WMO Integrated GOS
GEONETCast
G lobal Earth O bservation System of System s
WIS
Tall Tower Observation
National level
W eather O bservation Netw ork : e.g. W W W /G O S, AM DAR, ASAP etc.
Atm ospheric com position observing netw ork : e.g. G AW etc.
Radiation observing netw orks : e.g. BSRN
M arine m eteorological netw orks and arrays : e.g. VO S, ARG O , etc.
Hydrological observing netw orks : e.g. com ponents of W HYCO S etc.
Clim ate com ponents of atm os-, oceano-, terres-observing system s : Flux
Integration
Remote sensing
Climate Change Monitoring
Climate Change Landmark
Water Cycle Monitoring
Boundary Layor Monitoring
GHG Background Monitoring
Regional level
Global W
IGOS
Reference
Site - Data standardization at global scale
- GEOSS supporting hub- WIGOS regional center- GEOSS demonstration site
Outcomes
GEO 2007 Work Plan MASTER
Agriculture Task AG-06-07
Task Number Training Modules for Agriculture
AG-06-07
Initiate the design of training modules to demonstrate
the usage of Earth observation data and products for
the agricultural sectors in Africa, Asia, Latin America,
Central and , and in Small Island States.
Area
Agriculture
Relevant
Committee
CBC
18
Multilingual Translation (Language)GRID Resources (ICT)Field Server (AWS)uCAgM pilot project
WAMIS Grid PortalFocal Point for MetadataXML standards for AgMetCollaborations with NARC/JapanCollaborations for DCPC/CAgMFuture RMTC for ICT
Multilingual Translation
2.1 Multilingual translation
- currently 2600 AgMet terms in Japanese, English, Chinese, Korean
- additional 5600 terms of Meteorology in the above languages- under review by China, reviewed by Japanese expert- delivered to experts for preliminary test on automatic
translation(APAN)- needs bulletins in XML format for enhanced service via
WAMIS
Enquiry
Answer
言語と文字
AG(agriculture）-Grid
Info-Broker
Multi-Lingual- Ontology- Translation system- Dictionary/Thesaurus
User
Diversity: Language/Character/Culture Different: Structure/Data set/DB system
Sharing
Anywhere
臺灣萬歳
Korean
JapaneseSimplified Chinese
English
Automated Localizing
GRID Resources (ICT)
2.2 Grid resources – KISTI
- needs request letters to KISTI (Korea Supercomputer Center)- KMA can provide partial resources in the future- MAFFIN/Japan can provide virtual storage- Grid portal has been developed at NCAM/KMA- Operational applications are being ported to grid portal
Computational Grid resourcesComputational Grid resources
• High Performance Network • High Performance Computing • Distributed Storage
uMeteouMeteo--K K testbedtestbed
KISTI ClusterKISTI Cluster
KT KT ClusterCluster
Requiredmore storage!
PKNU Storage
SNU Storage
KOREN
TEIN
KISTI ClusterKISTI Cluster
KT Cluster
KISTI Cluster
Field Server (AWS)
2.3 Field server – Thai, Japan
- AGM should join APAN with a requesting letter for donation by Thai
- needs pilot sites to demonstrate the feasibility of FS at operational level
- ubiquitous sensor network should be considered in the future- promising candidates may come from African or Central
Asian countries
uCAgM pilot project
2.4 uCAgM pilot projects- fundamental technologies are well prepared, eg Grid,
resources, interfaces- needs continued and wide support from ESGII/METGRID- needs long-term commitments from KMA (announce during
recent CBS) - Field Server, PCS, etc should be integrated at operational
level
1
Develop a dictionary of languages to be used for multi-lingual translation of bulletins and advisories in WAMIS
2
Implement feasible components of AussieGrass project in a centralized web-based server system for easy-accessible Internet retrieval of user requirements
3
Demonstration project in Korea/Japan to illustrate feasibility of mobile phone technology for early-warning system
4
Implementation of WAMIS to host Web-based National AgrometeorologicalServices
5
Strengthening Regional collaborations for crop monitoring and early warning by mobilizing remote computing resources available from HPN
6
Forecast-based crop productivity prediction based on GCM/RCM/ISPM at global scale by integrating with Crop models
7Toolkits for Agrometeorological data analysis implemented in WAMIS
8
Establishment of Regional virtual venue(VV) for video conferenceswithin/between ICT/ET members of CAgM
9
Ubiquitous communciation of Agrometeorological information using Field server and PCS-based hydrological monitoring through WAMIS at Core AgroMeteorological Stations
2.5 WAMIS implementations as a grid portal- cyber tutorials on IT applications to AgroMeteorology are on-going - dedicated computer resources should be mobilized- bulletins currently available on WAMIS need to change in XML format- XML schema and interfaces for bulletins should be developed- expected to open a prototype early this year- more diverse products/applications should be prepared (AMBER, DSSAT)
- Steering committee meeting will be necessary in this year together with MG
- MG should consider/approve future orientation of WAMIS
WAMIS Grid Portal
Integrated ICT Framework is essential
Products/ApplicationsProducts/Applications
MonitoringMonitoring CommunicationsCommunications
User InterfaceUser Interface
Focal Point for Metadata
2.6 Focal point for Metadata- needs wide range of expertise in IT, agmet, agronomy, etc.- few experts can take care of potential user requirements- try to identify the most promising experts in the field of agmet
2.7 XML standards for AgMet Information- urgent to open discussions within CAgM regarding XML standards
- fortunately Dr. Byong Lee is invited to the discussion among EU/Japan scientists on XML standards
- WMO metadata core profile will be on the table during the meeting- working as a focal point to FWIS-ICCG from CAgM
6 Nov. – 8 Nov. 2006, TECO-WIS, CBSext,
Seoul KOREA
CAgM MetaData Management
Prototypes of Extended WMO Metadata Core Profile Keywords
6 Nov. – 8 Nov. 2006, TECO-WIS, CBSext,
Seoul KOREA
Hierarchy of weather elements RDF/OWL presentation
Collaborations with NARC/Japan
2.8 Collaborations with NARC/Japanjoint efforts to support uCAgM for Ontology in MetBroker(Feb.-Mar., 2005)mainly to implement WAMIS to strengthen and diversify service contentspreliminary discussions on XML standards for agmetinformation with EU expertsuser interfaces, resource brokers, field server, machine translation, etc.
6 Nov. – 8 Nov. 2006, TECO-WIS, CBSext,
Seoul KOREA
Prototype of Ontology using extended keywords
Present Coverage of MetBroker
Mobile Data Collection and On-site Decision Support
•Mobile Phone with Internet connection•On-site Field Data collection
•Farm record journal/field data acquisition•On-site Decision support
•e.g. Pesticide management,
GEO 2007 Work PlanAgriculture Task AG-06-07
Type Representing Organisation Name EmailAddress
Task POC Government of Johnson Owaro [email protected]
Contributor CEOS EUMETSAT [email protected]
Contributor of Sensing Applications, of Sciences Meng Qingyan [email protected]
Contributor Bundesanstalt für Geowissenschaften und
Rohstoffe
Michael Kosinowski [email protected]
Contributor IEEE Wilbur Ottichilo [email protected]
Contributor IGOS-P Richard Lawford [email protected]
Contributor IAO - Overseas Agronomic Institute Luca Ongaro [email protected]
Contrib
utor
NARO:National Agricultural
Research Organization
Seishi Ninomiya [email protected]
Contributor ITC Kees de Bie [email protected]
Contributor Issoufou Wata [email protected]
Contributor Norwegian Institute for Water Research Dominique Durand [email protected]
Contributor [email protected]
Collaborations for DCPC/CAgM
2.9 Collaborations for DCPC/CAgM – NCAR, DWD
potential donors for computing resources to support uCAgMfor the time being, a kind of symbolic contributionif acceptable, KMA will play a leading role of establishing DCPC/GISC dedicated to CAgMfurther discussion is required for detailed implementation plans
Dear Byong Lee,
The ICG-WIS will hold a session in Brasilia, 14-17 July 2008. You have participated in several previous sessions and have been an eloquent supporter of WAMIS and its interaction in/ contribution to WIS; I also
understand that KMA is keen to develop and implement the required functions and facilities of a WIS centre with international responsibilities (e.g. a DCPC for WAMIS). In this regard, I noted with appreciation that KMA has responded to our invitation to participate in the ad-hoc information day on the RA VI VGISC-DCPC project (EUMETSAT HQ, Darmstadt, 10 June) with the participation of MM Ok-Ki Lee and Seong-Jin Kim.
I would be grateful if you could confirm your availability to participate in and contribute to the forthcoming ICG-WIS as a CAgM-WAMIS expert, or to propose a relevant expert.
information on the ICG-WIS session under: http://www.wmo.int/pages/prog/www/ISS/Meetings/ICG-WIS_Brasilia2008/documents.html
Best regards,
DCPC-WAMIS
Dear Byong,
Nice to hear from you after a couple of years, and it would be a pleasure to meet you at the forthcoming ICG-WIS, and a real opportunity to discuss about inserting WAMIS in the framework of WIS and addressing what is necessary for the forthcoming GISC in Europe (early 2009) for harvesting the meta data from WAMIS and therefore expanding WAMIS visibility and use.
With respect to supporting your participation, our funding resources are rather limited as you know with the zero nominal growth and more activities to organize; Furthermore the appeal from the Secretary General for extra-budgetary resources in the WIS Trust Fund has had a limited response; as a special effort, I may be able to assist with the per diem if it may facilitate your obtaining that KMA bear the flight cost; I would of course be highly welcome if KMA could bear all the costs.
I look forward to your response
Best regards,
Jean-Michel RainerActing Director of WMO Information System Branch (WIS)
Observations and Information Systems Department (OBS)World Meteorological Organization
Future RMTC for ICT
2.10 Hosting future RMTC for IT (AgMet)final goal is to establish a training center in ICTstarting from training on agmet IT, extended to met ITtraining course on ICT in Meteorology is being provided from 2006, KMA bears all the costsdomestic or foreign institutions showed willingness to collaborateexisting training/education course will jointly managed (e.g. forecaster course)
In 2006, as it changed the subject of the course from weather forecasting for operational meteorologists into the information and communication technologies (ICT) for meteorological services, KMA shifted the target audience of the training course from the forecasters into engineers or observation experts, aiming to increase the abilities to use WMO basic IT technologies and the state-of-the-art IT technologies applied to WMO pilot projects; to understand various ICT for the provision of weather information, including NWP products; to understand and gain the techniques for agrometeorologicalinformation, including the use of the World Agro-Meteorological Information Service (WAMIS); an to gain the techniques for the establishment and management of the Automatic Weather Station (AWS) Network, including real-time data collection
Upon successful training in IT applications in Agrometeorology, the participants can be able to extend their understanding on fundamental Internet-based operational services including agrometeorological models, collection of initial input with parameters, GIS applications, and operational service via remote computer resources.
43
Key Contents
AgroMeteorological Services> Current applications> Perspectives
Implementation Strategies> Metadata/Ontology> Web Service/Grid ServiceCurrent Implementations for WIS> CAgM/WIS> WIS/KMA
Sponsors> Domestic : KMA / KISTI> International : NARC /DWD / NCAR
Demonstration> GISC / DCPC> WAMIS Grid Portal
Requirements> Dedicated DCPC/GISC> Bridge to GEOSS
44
WIS Demonstration
Byong-Lyol Lee, Dong-ll Lee & Euinam Huh
Korea Meteorological AdministrationKyounghee University
Status
Implementation of DCPC on OGSA-DAIEstablishment of own FTP Data Service
Establishment of OGSA-DAI linked with Globus
GDPS & Ensemble Data transmission though FTP
Status
Establishment of UNIDART on PortalOracle
Link to Portal
Timeseries metadata
Searching service for GTS Data
Status
Establishment of SIMDAT on PortalVMC (Catalog node or GISC)
Data Repository (DCPC)
> Synchronization> Harvesting (wee service-OAI)
> Web Service for Data Product> KMATimeseriesService> KMAEnbService> KMAGdpsService
Status
SIMDAT & Portal establishmentsGDPS / Ensemble metadata construction
User interface to link with data service on Ensemble FTP
User interface to link with data service on GDPS FTP
Establishment of V-GISC Portal prototype
Status
WAMIS implementationsEstablishment of Workflow GUI Tool
Development of Web-based Workflow Engine
OGSA-DAI Service on WAMIS (AMBER)
Data production for AMBER initialization
WINDOW & LINUX File System links
Demonstration
•Data Type : Timeseries
( Synops Data Base – kr.go.kma.FFDX.0095)
•Portal : Directory Browse / Search Meteo Data
• Architenture : OGSA-DAI based UNIDART access
SIMDAT(x.x.x.15)
UNDIART(x.x.x.14)
request
reply
1. SIMDAT – UNIDART link service
Demonstration
2. GISC – DCPC 서비스
• Data Type : GDPS / Ensemble Data
• Portal : Request Metadata / Data Move to FTP Server(210.x.x.15)->KHU server(163.180.x.x)
• Search : Map ( Africa) / Directory Browsing
• Architecture : OGSA-DAI
Demonstration
3. WAMIS 실행 서비스
• WorkFlow GUI 프로그램 실행 후 작업흐름 모델링 생성
• WorkFlow 모델 XML 파일 저장 / 열기
• 모델 Submit / 모니터링
• MM5 구동 및 AMBER를 이용한 분석 REPORT 결과물 저장 및 조회
• 작동환경 : 클러스터(Server) / 윈도우(Client)
3. WAMIS execution service
• WorkFlow GUI & prodesses generation
• WorkFlow Saving/Reopening in XML format
• Model Submission and Monitoring of operation
• MM5 operation, AMBER output archiving and search
• OS : Linux Cluster(Server) / Windows(Client)
Demonstration
4. Retrieval of AMBER outputs
Search and retrieval of AMBER outputkr.go.kma.wamis.amber
OGSA-DAI Service for data search
54
Thank You !Thank You !
Commission for Agricultural Meteorology(CAgM)
