GFESuite Training Workshop

GFESuite Training WorkshopGFESuite Training Workshop

Sept. 24-27 2002

ForecastSystems

Laboratory

Sept. 24-27, 2002 GFESuite Training Workshop 2

LogisticsLogistics

Restrooms Classroom/Lab Locations Agenda and Breaks, Assigned Tracks Restaurants - Cafeteria Get together – Lazy Dog Saloon Staff Introduction / Guest Introduction Questionnaire


What’s this course about?What’s this course about?

This is not a knobology course. This course covers advanced concepts of

GFESuite and focuses on GFE, not IFPS. Fine print: Region expects you to become regional experts and

help others.

The software we are teaching, is to be deployed soon to all WFOs, so what you are learning is timely.


Targeting all WFOs…Targeting all WFOs…

The field is screaming for TRAINING. GFE Topics taught have not been taught in detail at

NWSTC Trying to reach ALL WFOs in series of 3

workshops: Nov 2001 – 46 attendees Apr 2002 – 56+ attendees Sept 2002 – 58 attendees

FSL developed the GFESuite. We want to teach you the advanced concepts.


This workshop…This workshop…

Covers GFESuite portion of IFPS only.

Is Intense… There is a lot of material to cover

in 3 ½ days. Is Interactive…

We want participation. We get as much out of it than you do.


This workshop…This workshop…

May have you looking like this by Friday!


AgendaAgenda

Demos, Lectures, and Discussions: ifpIMAGE and Other Programs What’s New with GFESuite? GFESuite Configuration

Joint Discussions Track “A” and “B” together


AgendaAgenda

Labs: Numerical Python Smart Tools Smart Initialization GFE Configuration and

ifpIMAGE Intersite Coordination


Computers in the LabsComputers in the Labs

You are assigned a machine and a site. Your “HOME” WFO is configured for you.

Sometimes you have your own machines, sometimes you will share with another.


AcknowledgmentsAcknowledgments

LeRoy Spayd, NWS Training Manager Rental of computers

Guest Speakers Lynn Maximuk, EAX MIC Carl McCalla, MDL

GFESuite, IFPS, GFESuite, IFPS, AWIPS, RAP, RPP, AWIPS, RAP, RPP, NDFD, IOC ?????NDFD, IOC ?????

Mark Mathewson

Carl McCalla


GFESuiteGFESuite

Software written by FSL Part of formal IFPS deployment Consists of:

Database Derivation Algorithms (a.k.a. Smart Initialization) Graphical Forecast Editor Product Generation programs – text, graphics, grids Supplemental Programs


Components of GFESuiteComponents of GFESuite

D2DAWIPSModelData

Grids

Text

Image

Smart Initialization

ISC

ifpServer

SpatialEditor

Temporal Editor

Grid Manager

GFE Editors ProductsIngest/DB


IFPSIFPS

Remainder of IFPS developed by MDL MDL portion consists of:

IGR (Matrix Editor) ICS (Combo Selector) Text Product Formatters (e.g., ZFP, CCF, RDF) MOS initialization routines Model Interpretation (a.k.a. Slider Bars) INFORMIX database CRS Formatters, W/W/A


Ingest/DB

Products

IFPS ComponentsIFPS Components

Editors

GFE

ifpServerGrids

Slider

ICS IGR

INFORMIXMatrix

D2DAWIPSModelData

MasterMenuMOS

SensibleWeather

SmartInitialization

Grids

Text

Image

NWR


Historical View of IFPHistorical View of IFP

ICWF – started in the 1980s on AFOS, matrix-based

AFPS (GFESuite) – started in 1990, grid-based Original plan: ICWF deployed to field, replaced

with AFPS two years later MDL provides text formatters FSL provides editors, database

Independent development continued until 1996 when a merge of ICWF and AFPS was called IFPS.


IFPS HistoryIFPS History

IFPS first deployed to AWIPS in Build 5.0 (about two years ago)

Major issues: Development/progress was very slow Inadequate forecaster/developer interaction Few field test sites: just a few ICWF, none GFE

Time Between AWIPS Releases: 6-9 months Time From s/w development to field: 12 months


IFPS HistoryIFPS History

AWIPS uses industry standard practices for deploying mature, operational software to a large installed set of customers.

This process was not adequate for rapid progress and exploratory development, as as what IFPS needed.

IFPS was relatively new, and did not have a solid set of requirements and specifications.


Rapid Prototyping Project Rapid Prototyping Project (RPP)(RPP)

MSD chief’s initiative – Summer 1999 RPP created to address the shortcomings. Goals:

Improve GFE user interface and usability Explore Modernized Products Explore Gridded Forecast Methodology

Currently ~20 sites participating in RPP.


Rapid Prototyping Project Rapid Prototyping Project (RPP)(RPP)

Quick turnaround of software 6-8 week cycle typical (recently weekly cycles)

Frequent interaction with forecasters Workshops Listserver Software evaluations

More progress made in last 3 years, than first 9 years – by far!


GFE in 1996GFE in 1996


GFE in 1999GFE in 1999Prior tostart ofRPP


Prior to RPPPrior to RPP

GFE was a paint-program Interactive tools, such as the bulldozer, made

impressive demos. No meteorology in GFESuite at that time

(except for ifpInit).

User Feedback minimal


Recent GFE Recent GFE (RPP11 – May01)(RPP11 – May01)


Results of RPPResults of RPP

Features developed over the last 3 years Smart Tools Smart Initialization Major U/I Overhaul –modeling the forecast process ifpIMAGE Intersite Coordination of Grids Base/site/user configurability Text Products Infrastructure

Meteorology in the GFE!


Rapid Prototyping and AWIPSRapid Prototyping and AWIPS

RPP

1/00 5/00 9/00 1/01 5/01 9/017/00 11/013/0011/99 11/00 3/01 7/01

1 2 3 4 5 6 7 1312111098

5.1.15.0 5.1.2 5.2.1

AWIPSDevelopment Handoff

14

AWIPS Deployment5.0 5.1.1 5.1.2

5/023/021/02

15 16

10

IFPS10

5.2.1

7/02 9/02

17 18 19

11 12 13

IFPS11


RPP ReleasesRPP Releases


Where do the improvements Where do the improvements come from?come from?

Suggestions for improvements come from two sources: AWIPS Requirements

Usually requires additional details/specificationss Interaction between forecasters and developers

Majority of features start this way

Turnaround time Sometimes a matter of days


About a year ago…About a year ago…

NWSH realized it was time to focus on “IFPS” and decided to really gear up for it.

There have been a huge amount of changes in the IFPS program Goals, targets Change in development process Field Prototyping/Testing plans

NDFD was the first change.


National Digital Forecast DatabaseNational Digital Forecast Database

Contains a seamless mosaic of National Weather Service digital forecasts

Is available to all users and partners – public and private

Allows users and partners to create a wide range of text, graphic, and image products.


NDFD increases the usefulness of Gov’t NDFD increases the usefulness of Gov’t forecasts by:forecasts by:

Providing weather information to drive custom applications developed by partners

Decision support systems that fit the forecast to the problem

Weather information along a path Text generation in more than one language Forecasts for vehicles and hand-held devices with GPS Smart appliances (e.g., heating, cooling, irrigation)

Communicating the forecaster’s mental image of the weather situation in greater detail


The NDFD will contain…The NDFD will contain… Weather, water, and climate forecasts from WFOs,

RFCs, and NCEP Service Centers Elements that support generation of current WFO

products Digital watch, warning, and advisory information Elements that support generation of national

products defined by NDFD Product Development Process

Elements that would attract the private development of graphics and decision tools

The official NWS forecast for each element


NDFD PrototypeNDFD Prototype

Exploration now occurring in the clusters: Weather elements, time requirements Coordination techniques between offices Solving technical issues Methodology issues

3 Clusters – Western, Central, Eastern


NDFD Grids NDFD Grids (a.k.a. National Mosaic Grid)(a.k.a. National Mosaic Grid)

NWS plans to issue national gridded products by Sept 2003NWS plans to issue national gridded products by Sept 2003

FFC


NDFD and Intersite CoordinationNDFD and Intersite Coordination Related – but not the same.

WFO

WFO

WFO

Fcst

Fcst

Fcst

WAN

WAN

WAN

Intersite Coordination Grids

Official

Official

Official

NDFD CentralServer

NDFD

Customers

WAN

WAN

WAN

NDFD Grids


Intersite Coordination GridsIntersite Coordination Grids

PUB

BOU

CYS

PUB

CYS

BOU

Internal NWS Tool to facilitate coordinated forecasts


Intersite Intersite Coordination Coordination

GridsGridsOAX

TOP

TSA

SGF ProbabilityofPrecipitation

(Beforeany coordination)


ISC Grids ISC Grids – coordination improvements– coordination improvementsSame as left image,

But with colorTable changes.


IFPS RoadmapIFPS Roadmap

Accepted Dec 10, 2001 by NWS Operations Committee.

Specific thresholds and “stretch objectives.” A new plateau of NWS service to the

nation. Thresholds of Success


Thresholds for SuccessThresholds for Success

1. Prepare local digital forecast database To 7 days At every WFO Update it as necessary at least twice a day.



2. Prepare existing base forecast products Via IFPS In the format they are today At every CONUS WFO By September 30, 2003

3. OCONUS to be implemented by December 2003



4. Provide external user access to local digital forecast data in GRIB2 format.

5. Provide for required digital product retention.


Existing Base Forecast Existing Base Forecast ProductsProducts

Zone Forecast Product (ZFP) Coded Cities Forecast (CCF) Fire Weather Forecast (FWF) Miscellaneous Fire Weather Prediction (FWM) Coastal Waters Forecast (CWF) Marine Verification coded Forecast (MVF) NearShore Forecast (NHS) Great Lakes Open Lake Forecast (GLF) Service Area Forecast (SAF) Tabular State Forecast (TSF)


IOC (Initial Operating IOC (Initial Operating Capability)Capability)

The preceding list of products defines the Initial Operating Capability (IOC) for IFPS at a WFO.


Rapid Alpha Process (RAP)Rapid Alpha Process (RAP)

NWS/AWIPS response to the IFPS Roadmap

Provides more frequent development, field test, feedback for developers and field.

Generally patterned after Rapid Prototype Process (RPP).

Operates within AWIPS.


Steps in the RAPSteps in the RAP Monthly Conference Calls

Gather feedback from field sites. Set development priorities.

Frequent build/test/release cycles Latest GFESuite bundled into each IFPS release. Formal testing at NWSHQ Field testing at 30 Alpha Test WFOs.

Phase I Phase II

Release to all WFOs.


RAP ScheduleRAP Schedule

RAPAlpha

5/02 9/024/023/02 6/02 7/02 8/02

121110

IFPS10 IFPS11

AWIPS Deployment 5.2.1

10/02

5.2.2

RAP toall WFOs

Schedule for IFPS10/11 fixed, coordinates with B5 responsibilities.Later builds of IFPS12+ will be coordinated with WFOs.


RAP Contents – IFPS 10RAP Contents – IFPS 10

Port to Linux Intersite Coordination of Grids Fire Weather (1st cut) Daily Forecast Critique (1st cut)


RAP Contents – IFPS11RAP Contents – IFPS11

Service Backup Floating-PoP Use of Daylight Savings Time in grid unloader Site-selectable PoP12 Adjustment (MOS ingest)

Thresholds for weather and obstructions to vision GFE Streamline Tool Rate-dependent weather elements, e.g., QPF,

SnowAmt Enhanced Daily Forecast Critique



Snow Levels Fire Weather Formatter Service Backup version control GFE Utility Programs – publishGFE,

sendISC, ifpServerText ISC of Grids – now includes marine areas Move Grid Unloader Thresholds into

INFORMIX database.



Support for non Lambert Conformal projections, and non-square domains.

Support for OCONUS-specific weather elements.

Improved local formatter infrastructure


RAP vs. RPP RAP vs. RPP

Latest GFESuite (RPP) goes into latest RAP.

RPP schedules adjusted to closer fit RAP schedules.

RPP will precede RAP deliveries by about two months. RPP may differ from RAP (schedule, contents)

Customer SupportCustomer Support

Mark Mathewson

Carl McCalla


Customer Support TeamsCustomer Support Teams

Site Support Team (SST) 24x7 Site Support Team (24x7/SST) Customer Support Team (CST)


Site Support TeamSite Support Team Composition

Two MDL staffers (typically s/w developers) Function

Troubleshoot and resolve Operational IFPS problems occurring at baseline

and RAP sites (NCF refers site problems) Installation problems occurring at IFPS baseline

sites


Site Support Team Site Support Team (cont.)(cont.)

Availability Mon-Fri (except holidays) during EST/EDT

normal business hours Resources

The entire IFPS s/w development staff (both MDL and FSL)


24x7 Site Support Team24x7 Site Support Team Composition

Two MDL staffers (typically s/w developers) available for callback overtime.

Function Troubleshoot and resolve

Critical operational IFPS problems occurring at baseline and RAP sites (NCF refers site problems)

Availability Holidays, weekends, and Mon – Fri after

normal business hours


Customer Support TeamCustomer Support Team Composition

Two MDL full-time customer service / customer support staffers

Function Perform pre/post IFPS RAP and baseline site

installation “interviews” Field calls from RAP sites regarding installation

problems Work with IFPS s/w developers to ensure RAP

installation problems are resolved Shield NCF from installation issues.


Customer Support Team Customer Support Team (cont.)(cont.)

Availability Mon – Fri during normal business hours

Resources The entire IFPS development staff – both MDL

and FSL.


FSL Support … FSL Support … a little more informala little more informal

Composition Entire FSL GFESuite development team, as needs

dictate Function

Assist MDL in supporting IFPS Troubleshoot and resolve problems at RPP sites

Availability Normal business hours plus volunteer 24/7 emergency

support. Method of Support

Listservers , [email protected]

Training PlansTraining Plans

Brian Motta


IFPS TrainingIFPS Training

GFESuite workshop materials to be converted to distance learning.

Future IFPS workshops to address best practices and focal point issues.

Boundary Layer workshop to be held at Comet at end of FY03.

Comet and NWSTC adding new hardware and IFPS to classrooms.


IFPS TrainingIFPS Training

Possible teletraining sessions this coming year: ISC Grids / Collaboration Text Formatters Selected smart tools Service Backup Shift Management Forecast Methodology


Are We Ready?Are We Ready?

Sept. 2003 – a year away By IOC, all offices must meet a minimum

standard. Do we need training on IOC Expectations?

NWS will be judged by the least capable office.

Documents

GFESuite Training Workshop