1

National Weather Service

Ronla HenryRonla Henry

Office of Science and TechnologyOffice of Science and Technology

AWIPS EvolutionAWIPS Evolution

GIS WorkshopGIS WorkshopJuly 17-19, 2007July 17-19, 2007

2

OverviewOverview

• Why AWIPS Evolution?Why AWIPS Evolution?

• What is it?What is it?

• Outcomes and ObjectivesOutcomes and Objectives

• Re-architecture ApproachRe-architecture Approach

• RoadmapRoadmap

• What does AWIPS II mean to you?What does AWIPS II mean to you?

• SummarySummary

3

WHY?WHY?

• Case for change briefed to NWS Corporate Board – Nov 2004Case for change briefed to NWS Corporate Board – Nov 2004• AWIPS Present State SummaryAWIPS Present State Summary

• HardwareHardware– AWIPS hardware was in good shapeAWIPS hardware was in good shape

• Communications InfrastructureCommunications Infrastructure– AWIPS communications infrastructure was in OK shapeAWIPS communications infrastructure was in OK shape

• DataData– AWIPS Data was in need of improvementsAWIPS Data was in need of improvements

• SoftwareSoftware– AWIPS software was in critical need of improvementsAWIPS software was in critical need of improvements– Costly software development, maintenance and inability to meet NWS and customer Costly software development, maintenance and inability to meet NWS and customer

needsneeds

• Corporate board direction to focus on addressing software shortcomingsCorporate board direction to focus on addressing software shortcomings• Plan and requirements developed Plan and requirements developed • Shaped portions of the AWIPS O&M re-compete activityShaped portions of the AWIPS O&M re-compete activity

4

What is AWIPS Evolution?What is AWIPS Evolution?

• AWIPS EvolutionAWIPS Evolution• A long-term project which delivers a modern, robust software infrastructure A long-term project which delivers a modern, robust software infrastructure

that provides the foundation for future system level enhancementsthat provides the foundation for future system level enhancements• AWIPS IIAWIPS II

• Implements a modern Services Oriented Architecture (SOA) infrastructureImplements a modern Services Oriented Architecture (SOA) infrastructure• First output of AWIPS Evolution and provides the foundation for all First output of AWIPS Evolution and provides the foundation for all

subsequent improvementssubsequent improvements• AWIPS Evolution System ImprovementsAWIPS Evolution System Improvements

• Integration of “orphan” systems (e.g., Weather Event Simulator)Integration of “orphan” systems (e.g., Weather Event Simulator)• Migration of N-AWIPS into the SOA to create a seamless weather enterprise Migration of N-AWIPS into the SOA to create a seamless weather enterprise

that supports all levels of NWS operations from National Centers to WSOsthat supports all levels of NWS operations from National Centers to WSOs• Data Delivery EnhancementsData Delivery Enhancements

– ““Smart push-smart pull” data accessSmart push-smart pull” data access– Katrina satellite WAN back upKatrina satellite WAN back up

• Integrated visual collaborationIntegrated visual collaboration– Graphical collaboration at all levels of the weather enterprise extending to trusted external Graphical collaboration at all levels of the weather enterprise extending to trusted external

partnerspartners• Visualization EnhancementsVisualization Enhancements• Information Generation EnhancementsInformation Generation Enhancements

– Re-architecture of the generation of all NWS products and servicesRe-architecture of the generation of all NWS products and services

5

AWIPS EvolutionAWIPS EvolutionObjectivesObjectives

• Establish Service Oriented Architecture for AWIPS and NAWIPSEstablish Service Oriented Architecture for AWIPS and NAWIPS• Create a seamless weather enterprise that supports all levels of NWS Create a seamless weather enterprise that supports all levels of NWS

operations from National Centers to WSOsoperations from National Centers to WSOs• Build a common development environment that will be used by all Build a common development environment that will be used by all

developersdevelopers• Establish infrastructure for GIS integration Establish infrastructure for GIS integration

• Enable access to data independent of its location, i.e., provide Enable access to data independent of its location, i.e., provide access to data not resident locally at the WFO or RFC.access to data not resident locally at the WFO or RFC.

• Provide infrastructure for real time graphical collaboration Provide infrastructure for real time graphical collaboration betweenbetween• WFOs, RFCs and Centers for enhanced internal collaborationWFOs, RFCs and Centers for enhanced internal collaboration• Other NOAA entities andOther NOAA entities and• Trusted partners, e.g., Emergency ManagersTrusted partners, e.g., Emergency Managers

• Implement a Common AWIPS visualization environment (CAVE) Implement a Common AWIPS visualization environment (CAVE) used by all applicationsused by all applications

• Standardize generation of NWS products and servicesStandardize generation of NWS products and services

6

AWIPS EvolutionAWIPS EvolutionOutcomesOutcomes

• Short-term (1-3 years)Short-term (1-3 years)• Shorten transition of research to operationsShorten transition of research to operations

• Improve software O&M and technology refreshImprove software O&M and technology refresh– Fewer DRs and TTsFewer DRs and TTs

– Focus on hardening and productionizing for life cycle supportFocus on hardening and productionizing for life cycle support

• Minimize adverse impacts on operations from software and Minimize adverse impacts on operations from software and hardware upgradeshardware upgrades

• Long-term (3-10 years)Long-term (3-10 years)• Increase integration of AWIPS and National Center AWIPSIncrease integration of AWIPS and National Center AWIPS

• Improve performance and functionality of AWIPSImprove performance and functionality of AWIPS

• Improve collaboration at all levels of NWS operationsImprove collaboration at all levels of NWS operations

• Increase access to all environmental data for decision makingIncrease access to all environmental data for decision making

7

AWIPS IIAWIPS IIRe-Architecture ApproachRe-Architecture Approach

• Perform “black-box” conversionPerform “black-box” conversion• Preserve existing functionality, look and feel on top of new Preserve existing functionality, look and feel on top of new

infrastructureinfrastructure

• Thorough field validation and acceptance before Thorough field validation and acceptance before deploymentdeployment

• No loss of functionalityNo loss of functionality• Deployed system current with deployed AWIPS capability (i.e., OB9)Deployed system current with deployed AWIPS capability (i.e., OB9)

• Use open source projects - No proprietary codeUse open source projects - No proprietary code• JAVA and open source projects enable AWIPS II to be platform and JAVA and open source projects enable AWIPS II to be platform and

OS independentOS independent– No plans to move from LinuxNo plans to move from Linux

• Objective is to make AWIPS II available for collaborative Objective is to make AWIPS II available for collaborative developmentdevelopment• OS, Platform independence allows non-Linux based research to be OS, Platform independence allows non-Linux based research to be

easily integrated into AWIPS IIeasily integrated into AWIPS II

8

AWIPS II AWIPS II FeaturesFeatures

• AWIPS Development Environment (ADE)AWIPS Development Environment (ADE)• Used by all AWIPS developers (National, Regional, & Local)Used by all AWIPS developers (National, Regional, & Local)

• Developers concentrate on new capabilities, not re-implementing existing ones (i.e. Developers concentrate on new capabilities, not re-implementing existing ones (i.e. screen I/O, communications protocols, data access routines, logging routines, or screen I/O, communications protocols, data access routines, logging routines, or other previously developed capabilities)other previously developed capabilities)

• Software can be developed on a variety of platforms Software can be developed on a variety of platforms • Robust infrastructure for improved software O&MRobust infrastructure for improved software O&M

• Use of plug-ins: visualization extensions; new data types and transformsUse of plug-ins: visualization extensions; new data types and transforms

• System level, remediation, core services reduce system complexitySystem level, remediation, core services reduce system complexity

• Improved support for local requirements (e.g., local apps, scripts, plug-ins)Improved support for local requirements (e.g., local apps, scripts, plug-ins)• Common AWIPS Visualization Environment (CAVE)Common AWIPS Visualization Environment (CAVE)

• Provides a common development and execution environment for AWIPS GUIs (e.g. Provides a common development and execution environment for AWIPS GUIs (e.g. D2D, NMAP, GFE, etc.)D2D, NMAP, GFE, etc.)

• Ability to pan/zoom large data sets (Raster & Vector) with flexibility over data Ability to pan/zoom large data sets (Raster & Vector) with flexibility over data renderingrendering

• GIS toolsGIS tools• Thin Client (Web Browser) enabledThin Client (Web Browser) enabled

• Dynamic Load balancingDynamic Load balancing• Processing dynamically allocated among available CPUsProcessing dynamically allocated among available CPUs

9

AWIPS IIAWIPS IIRoadmapRoadmap Migration

Strategy

2007 2008 201020092006

SW CTR (AWIPS II)

AE OSIP Gates 2 3 4a 4b

= Fiscal Year

= Calendar Year

MPLS Meshed Topology

06/22/07

OBx 7 8 9 10

PIP

Analysis

Migration Planning

RTS IRAD ADE Development

“User” Functional Tests

Baseline Application Migration

8 8.3

ADE Training

Field Ops Training-- ITO, ESA

DeploymentOTE

C & A

Deployment Planning

Local App Migration

ADE Local App Training

New Release Paradigm

O & M Transition

NWS New Capability Development in ADE

OB 9 Dev & Test Deployment

O & M Transition Prep & Coordination

ADE Training Development

OTE / Deployment Support

AWIPS II 1.0

Note: Task bar colors are For speaker reference only

10

2007 2008 2009 2010 2011 2012 2013 2014

AWIPS EvolutionAWIPS EvolutionRoadmapRoadmap

SOAEnhancements

= Fiscal Year

= Calendar Year

OTE / Deployment

AWIPS II

AWIPS II

Baseline Application Migration

Governance Model

NAWIPS Migration

Thin Client

WES Integration

AWIPS IIEnhancements

Data Delivery IOC FOC

Phase 1 Collaboration Phase 2 Phase 3

Information Generation IOC FOC

Visualization IOC

11

AWIPS EvolutionAWIPS EvolutionGovernance ModelGovernance Model

• What is it?What is it?• Governance model controls the development, test, integration, Governance model controls the development, test, integration,

configuration management, deployment and support of the new configuration management, deployment and support of the new system -- both hardware and softwaresystem -- both hardware and software

• Why?Why?• AWIPS II offers new levels of flexibility and extensibilityAWIPS II offers new levels of flexibility and extensibility• New rules needed to take advantage of system capabilities and New rules needed to take advantage of system capabilities and

also define limitsalso define limits• Tension between unlimited modifications and ability to support Tension between unlimited modifications and ability to support

the systemthe system

• Sample issues for considerationSample issues for consideration• Monolithic configurations no longer required -- how do we Monolithic configurations no longer required -- how do we

manage site specific configurationsmanage site specific configurations• Plug ins down loaded and installed on demandPlug ins down loaded and installed on demand• Scripting that modifies AWIPS menus, functionsScripting that modifies AWIPS menus, functions

12

AWIPS IIAWIPS IIWhat gets us excited so far…What gets us excited so far…

• Dynamic load balancingDynamic load balancing• Failover handled automaticallyFailover handled automatically• Enables consideration of tailored hardware configurationsEnables consideration of tailored hardware configurations

• Mathematically intensive calculations handed off to the graphics cardMathematically intensive calculations handed off to the graphics card• Significant performance improvementsSignificant performance improvements

• Progressive disclosure of all dataProgressive disclosure of all data• Imagery via quad tree tiling, grids and observationsImagery via quad tree tiling, grids and observations

• Integrated thin clientIntegrated thin client• Allows baseline solution to be extended to CWSUs, WSOs, and IMETsAllows baseline solution to be extended to CWSUs, WSOs, and IMETs

• Integrated drawing and graphical collaborationIntegrated drawing and graphical collaboration• Tools built into the infrastructure, implemented in 2011Tools built into the infrastructure, implemented in 2011

• Built in GIS via geotools libraryBuilt in GIS via geotools library• Scripting level access to practically all system level services and Scripting level access to practically all system level services and

functionsfunctions• LESS CODE LESS CODE

• Potential order of magnitude reduction in amount of software with increase in Potential order of magnitude reduction in amount of software with increase in functionalityfunctionality

13

AWIPS IIAWIPS IIWhat does it mean to you?What does it mean to you?

• Transition (Mid 2009 - mid 2010)Transition (Mid 2009 - mid 2010)• Limited changes during transitionLimited changes during transition

• Only minor updates to products and servicesOnly minor updates to products and services

• AWIPS II – 2010AWIPS II – 2010• More robust infrastructureMore robust infrastructure

• Faster software installations – less downtime while Faster software installations – less downtime while delivering new softwaredelivering new software

14

AWIPS EvolutionAWIPS Evolution What does it mean to you?What does it mean to you?

• AWIPS II – 2011AWIPS II – 2011• Thin client supportThin client support

– Integrates CWSUs, WSOs and Incident MeteorologistsIntegrates CWSUs, WSOs and Incident Meteorologists

• NAWIPS migrated to SOANAWIPS migrated to SOA– One infrastructure for meteorological applications spanning One infrastructure for meteorological applications spanning

operations from National Centers to WSOsoperations from National Centers to WSOs

• Improved satellite back up for terrestrial networkImproved satellite back up for terrestrial network– Improves continuity of operations during Katrina-like eventsImproves continuity of operations during Katrina-like events

• Smart push-smart pull data deliverySmart push-smart pull data delivery– Improved access to broader sets of data than is currently Improved access to broader sets of data than is currently

delivered over the SBNdelivered over the SBN

• Integrated graphical collaborationIntegrated graphical collaboration– Improved coordination at all levels of NWS weather enterpriseImproved coordination at all levels of NWS weather enterprise

15

AWIPS EvolutionAWIPS Evolution What does it mean to you?What does it mean to you?

• AWIPS II – 2012-2014AWIPS II – 2012-2014• Extend graphical collaborationExtend graphical collaboration

– NOAA officesNOAA offices

– Trusted external partners, e.g., DHS and Emergency ManagersTrusted external partners, e.g., DHS and Emergency Managers

• Smart push-smart pull data deliverySmart push-smart pull data delivery– Extend data services to other NWS services for product Extend data services to other NWS services for product

deliverydelivery

• Re-architect generation of products and servicesRe-architect generation of products and services– More responsive to customer requests, e.g. CAPMore responsive to customer requests, e.g. CAP

– Streamline process so developers and meteorologists focus on Streamline process so developers and meteorologists focus on content vice formatcontent vice format

16

AWIPS IIAWIPS IIOperationalOperational ImpactsImpacts

• Forecaster• Little to no impact anticipated

– Look & Feel preserved• ESA/ITO

• New architecture drives changes to:– Release Installations (projected to be easier & shorter in duration)– System Maintenance– System Troubleshooting

• Application Focal Point• Definition of application changes under new architecture• Application configuration likely to change

– Do not know by how much at this time. Better idea around end of calendar year (2007)• Local Application Developer

• Local applications need to be migrated to new infrastructure– Migration path needs to be determined for each local app

• New development accomplished within ADE/SDK– Will need to learn new concepts - object oriented programming, SOA prinicples– Will need to learn new languages -- JAVA script and potentially JAVA -- still defining

requirements

17

AWIPS IIAWIPS IILocal ApplicationsLocal Applications

• Survey, to be released shortly, to determine• Number of local applications and developers

• Skill and knowledge level of developers

• Migration plan to address approach based on survey results• Training requirements and approach to be refined based on

survey

• Raytheon to provide sample migration and code samples for approach

• Level of effort required uncertain• Raytheon estimate that 80% of local apps will be able to be

rewritten in Javascript, without extensive programming in the ADE

18

AWIPS IIAWIPS IIGIS CapabilitiesGIS Capabilities

• GIS functionality integrated into AWIPS II architecture via GIS functionality integrated into AWIPS II architecture via GeoTools GeoTools

• GeoToolsGeoTools • Open Source Java code libraryOpen Source Java code library• Provides OGC compliant methods for manipulation of geospatial dataProvides OGC compliant methods for manipulation of geospatial data

• AWIPS II will support JavaScript access to GeoTools AWIPS II will support JavaScript access to GeoTools librarylibrary• ADE 1.0 supports limited accessADE 1.0 supports limited access

– Read, write shape filesRead, write shape files– Create GeoTiffsCreate GeoTiffs– Spatial queries of ingested dataSpatial queries of ingested data

• Task Order 10 will deliver full JavaScript accessTask Order 10 will deliver full JavaScript access• Reference:Reference:

• GeoTools home:GeoTools home:

http://geotools.codehaus.orghttp://geotools.codehaus.org• GeoTools & Eclipse: GeoTools & Eclipse:

http://docs.codehaus.org/display/GEOT/Eclipse+Developers+Guidehttp://docs.codehaus.org/display/GEOT/Eclipse+Developers+Guide

19

SummarySummary

• AWIPS Evolution underway!!AWIPS Evolution underway!!• ADE/SDK 1.0 delivered June 14, 2007ADE/SDK 1.0 delivered June 14, 2007

• WFO/RFC Application migration underwayWFO/RFC Application migration underway• Migration Plan delivered June 2007Migration Plan delivered June 2007• AWIPS baseline migration to be completed FY09AWIPS baseline migration to be completed FY09

• WFO/RFC Deployment complete FY10WFO/RFC Deployment complete FY10• NAWIPS Migration FY09/FY10 NAWIPS Migration FY09/FY10 • AWIPS II will deliver capabilities that enable AWIPS II will deliver capabilities that enable

NWS to be more responsive to emerging NWS to be more responsive to emerging requirementsrequirements

20

National Weather Service

Back UpBack Up

21

AWIPS EvolutionAWIPS EvolutionData DeliveryData Delivery

• OSIP Project 05-040OSIP Project 05-040• Enables “smart push - smart pull” data deliveryEnables “smart push - smart pull” data delivery

• Access to data not available localAccess to data not available local• Freedom from the tyranny of the SBNFreedom from the tyranny of the SBN• Enables consideration of new data delivery architectureEnables consideration of new data delivery architecture

– What data to you broadcast over SBN?What data to you broadcast over SBN?– What data do you make available on servers? What data do you make available on servers?

• ScheduleSchedule• IWT starting Q4 2007 to define concept of operations and IWT starting Q4 2007 to define concept of operations and

operational requirementsoperational requirements• IOC - 2011 - software implementation for remote data accessIOC - 2011 - software implementation for remote data access• FOC 2012 - enterprise configuration (servers, comms, etc.) FOC 2012 - enterprise configuration (servers, comms, etc.)

that enables remote data accessthat enables remote data access

22

AWIPS EvolutionAWIPS EvolutionCollaborationCollaboration

• OSIP Project 05-041OSIP Project 05-041• ObjectiveObjective

• Integrated graphical collaboration throughout the NWS Integrated graphical collaboration throughout the NWS Weather Enterprise and beyondWeather Enterprise and beyond

• Phase 1 - Integrated collaboration between all levels of NWS Phase 1 - Integrated collaboration between all levels of NWS operationsoperations

• Phase 2 - Collaboration between NWS offices and other NOAA Phase 2 - Collaboration between NWS offices and other NOAA entitiesentities

• Phase 3 -Collaboration between NWS offices and trusted Phase 3 -Collaboration between NWS offices and trusted external partners, e.g., Emergency Managersexternal partners, e.g., Emergency Managers

• ScheduleSchedule• Phase 1 IOC - 2011Phase 1 IOC - 2011• Phase 2 IOC - 2012Phase 2 IOC - 2012• Phase 2 IOC - 2013Phase 2 IOC - 2013

23

AWIPS EvolutionAWIPS EvolutionInformation Generation & VisualizationInformation Generation & Visualization

• OSIP Projects 05-042 (IG) and 05-021 (Vis)OSIP Projects 05-042 (IG) and 05-021 (Vis)• Information Generation objectiveInformation Generation objective

• Re-architect generation of all NWS products and servicesRe-architect generation of all NWS products and services• Separation of content generation from formatting and Separation of content generation from formatting and

disseminationdissemination• Enable faster response to emerging customer demandsEnable faster response to emerging customer demands

• Visualization objectiveVisualization objective• Common user interface - standardize User Interfaces across Common user interface - standardize User Interfaces across

applicationsapplications• 3-D visualization3-D visualization• Improve user interfaces based on latest principles and Improve user interfaces based on latest principles and

researchresearch

24

AWIPS IIAWIPS IITrainingTraining

• Strategic Training Plan being developedStrategic Training Plan being developed• Training targeted for the following groups:Training targeted for the following groups:

• ESAsESAs• ITOsITOs• AWIPS and application focal pointsAWIPS and application focal points• Developers (both baseline and local)Developers (both baseline and local)• NCFNCF• SSTSST

• Training Organizations involved in planning, Training Organizations involved in planning, developing and implementing coursesdeveloping and implementing courses

25

AWIPS IIAWIPS IIRisks and ChallengesRisks and Challenges

• Performance• Supporting the short fuse warning mission• Handling large global data sets

• Schedule• Completing the migration and testing

• Migration of local applications• Local applications outside the baseline and not a

Raytheon responsibility