22
PPS Operations Adam Dybbroe

PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

PPS Operations

Adam Dybbroe

Page 2: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Outline

The PPS reference station The new setup at SMHI Performance

Page 3: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Direct Readout station - Norrköping

X/L-band 2.4 meter SCISYS

Page 4: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Direct Readout

~45 passes per day Terra/Aqua, NOAA 19/18/15, Metop-A/B

and Suomi NPP Smart scheduling (pytroll schedule)

Page 5: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Direct Readout – data acquisition

AVHRR: AAPP (7.6)

VIIRS: RT-STPS 5.1 patch DB6 (streaming mode) CSPP 2.0.1 patch (October 2014)

MODIS: DRL Modis level-1b SPA version 1.6 Destriping algorithm not yet implemented

Page 6: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Data acquisition - navigation

AVHRR: ANA TLE's updated twice a day

...needs to be improved

VIIRS: LUT tables attempt updated several times a

day Always using latest CSPP

Page 7: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Processing environment

Raw data acquisition (Nimbus): SCISYS 2met! running on dedicated Linux

server (RHEL 6) RT-STPS

Page 8: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Processing environment

lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz 0.5 Tb SAN disk Running PPS, CSPP, AAPP, Modis lvl1b SPA +

image composites with

Page 9: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

PPS Processing environment

Hirlam C11

Page 10: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

PPS Processing environment

Processing on AVHRR/VIIRS swath

Remapping end products to local areas

Page 11: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

The PPS Task Manager is no more

R.I.P.

This is an ex Task Manager This Task Manager is no more This is a late Task Manager It is stone dead

Page 12: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

The new setup at SMHI

Using messages to trigger processing Pytroll Supervisor

Pytroll: http://pytroll.org/

Supervisor: http://supervisord.org/

Page 13: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

The SMHI setup

Page 14: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

The SMHI setup

Page 15: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

The SMHI setup

Page 16: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

The SMHI setup

Page 17: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Performance - AVHRRCloud Mask

Page 18: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Performance - AVHRRCPP

Page 19: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Performance - VIIRSCloud Mask

Page 20: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz

Performance - VIIRSCPP

Page 21: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz
Page 22: PPS Operations - NWC SAF · Processing environment lvl-0 to lvl-2 processing (PPS) CISCO Blade server CPU: 4x Hex-Core Intel Xeon 2400 MHz RAM: 48 Gb = 6 x 8 Gb DIMM, Speed 1333 MHz