16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer

AMSR-E / AMSR2 Team Lead Science Computing Facility

TLSCF at UAH

Dr. Roy SpencerDr. Danny Braswell

Dr. Elena LoblMr. Don Moss

Ms. Dawn Conway


AMSR-E / AMSR2 TLSCF

TLSCF at UAH

• TLSCF Data Flow• TLSCF Operating Environment• Science Team Software Delivery

Requirements• Current AMSR-E Science Software• Current AMSR2 Science Software• AMSR-E / AMSR2 Schedule



AMSR-E / AMSR2TLSCF

Science Team

GHCCSIPS

NSIDC DAAC

Algorithm, documentation, QA, and ECS metadata updates

Documentation, ESDT’s, user support

Browse images, anomaly resolution, Provenance metadata, LANCE product reviewDelivered Algorithm Package (DAP)

Data Flow



Current AMSR-E(Sunny)

AMSR2 /Future AMSR-E(Gusty)

Operating System RHEL 5 - 32 bit RHEL 6 - 64 bitC compiler gcc gccFortran compiler Lahey, ifort gfortran, ifortHDF 4.2r1 5HDF-EOS 2.14 5

TLSCF Operating Environment


AMSR-E / AMSR2 TLSCFScience Team

Software Delivery Requirements

• Update from the latest DAP• Software

o HDF versiono HDF-EOS Geo fieldso Use current version of input data

• Delivery notes • Include test input / output data



Delivery Notes

• Describes the science software changes, including new requirements

• Lists known issues associated with the release

• Describes the file naming convention• Includes input and output file descriptions• Identifies the required operating system,

compilers, libraries, and third party software

• Lists and describes all routines and ancillary files, identifying the ones that have changed

• Contacts• Operating instructions



Current AMSR-E Science Software Data Product

Current Version Current Status

L2A Tb’s V12 New version soon? L2 Ocean V07 Updates due L2 Land V10 New algorithm delivered to TLSCF L2 Rain V11 Delivered to SIPS L3 Sea Ice V15 Reprocessing completed Jul 2014

Updates for Bootstrap at TLSCF L3 Ocean V05 Updates? L3 Land V07 Updates due following L2 Land L3 Snow V10 Updates due L3 Rain V07 New algorithm; monthly? L3 Sea Ice Drift B03 Updates due



Current AMSR-E Science Software

• All operational software is updated to includeo New ISO metadata, updated ECS metadatao New ESDTo New L2A Readero Digital Object Identifier (DOI)




• L2A Brightness Temperatureso V12 reprocessing completed July 2013 (RSS v07)o Recalibrated Brightness Temperatureso Improved RFI flags; format changes

• L3 Sea Ice V15o Reprocessing completed July 2014• Update Southern Hemisphere sea ice

mask • Update the algorithm to correct

internal land / ocean flag that conflicted with the new sea ice mask

o Minor updates to Bootstrap at TLSCF (received 9-14-15)




• L2 Ocean o Last algorithm updates were in V05, April 2007o Updates expected; will utilize latest TB’s and

record new RFI flags• L3 Ocean

o Last algorithm updates were in V04, May 2010o Updates expected; will utilize the latest RFI flagso Reprocessing after L2 Ocean reprocessing




• L2 Land o At TLSCF, I&T has beguno Combined Single Channel Algorithm (SCA) and

Normalized Polarization Difference (NPD) algorithm

o New formato Unified ancillary files

• L3 Land o Updates expected after L2 Land deliveryo Reprocessing after L2 Land reprocessing




• L2 Raino GPROF 2010 currently at SIPS for reprocessingo Next update?

• L3 Raino New algorithm; derived from L2 Rain (GPROF

2010)o Monthly; 0.25 degree resolution




• L3 Snow o Last algorithm update B05, November 2005o Updates?

• L3 Sea Ice Drift o Last algorithm update B03, October 2013o Replacement algorithm expected from science

teamo Validated?



AMSR2 Science Software

• Integration at TLSCF equivalent to AMSR-Eo Update the metadata, QA, and operational codeo Update Provenance metadatao Integrate and testo Compare outputo Prepare DAPo Provide documentation to NSIDCo Update the ESDTo Provide support to the SIPS to resolve processing

issues



AMSR2 Science Software

• JAXA L1Ro Reader written and tested by Bruce Beaumont of

the SIPS (LANCE) and available to science team now

o Data available from SIPS• Version B01 of AMSR2 Standard Products

Ready for I&T at TLSCFo L3 Sea Ice o L2 Land o L2 Rain / Ocean (GPROF)



AMSR-E Schedule2014 2015 2016 2017

Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4

All Alg to TLSCF TLSCF Integration & Testing

Algorithm

Updates due TLSCF I&T*

Final updates

to TLSCF TLSCF I&T*

• Dec 2016: FINAL End of Mission algorithm updates due to TLSCF

AMSR-E Senior Review Feb 1, 2016 *AMSR-E extension due to Terra-Aqua ROSES ?



Tentative AMSR2 Schedule

2014 2015 2016 2017Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4

Beta version Transitional version Validated versionUnified Mask

Algorithms to TLSCF TLSCF I&T





Overview of Tasks

• Support Science Team• Integrate and test science software• Maintain metadata, QA software, and

ESDT’s• Prepare all software for operations

environment• Deliver DAP to the SIPS• Support the SIPS in resolving processing

anomalies• Support NSIDC (user inquiries and

documentation)• Documentation and web pages


AMSR-E / AMSR2 TLSCFDelivered Algorithm Package

• A package containing software and documentation sufficient to allow a user to recreate the associated standard product

• 1 DAP per science software delivery• DAP version = file version• Delivered and installed at SIPS for

processing• Available to users from NSIDC



Science Software Integration & Test Procedures

• Update the metadata, QA, and operational codeo Document changeso Integrate the science software o Compile and run the completed software

packageo Compare output

• Update Provenance metadata• Provide documentation to NSIDC• Update the ESDT


AMSR-E / AMSR2 TLSCFScience Software

Integration & Test Procedures

• Review each science team delivery o Begin with current DAP?o Document changes in software and ancillary files?o Output file meets ECS requirements?o Known issues, bug fixes

• Compile and run the science softwareo Document changes necessary to compile at TLSCFo Compare output with that provided by the

scientist



Science Software Integration & Test Procedures

• Deliver DAP to the SIPSo Science, metadata, & QA softwareo Makefile and wrapper scriptso Delivery noteso Static ancillary fileso Checksums

• Support SIPS in resolving processing anomalies

Documents

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy