10
Nov 26 2012 Nov 26 2012 JWST Data Management Systems Gretchen Greene

JWST Data Management Systems

  • Upload
    shona

  • View
    59

  • Download
    1

Embed Size (px)

DESCRIPTION

JWST Data Management Systems. Gretchen Greene. JWST Mission Hierarchy for DMS. DMS Estimated Archived Data Volumes – Baseline. JWST DMS Interface Context. S&OC. Project Level Agreements will be defined ~L-24mo. JWST vs. HST DMS…. - PowerPoint PPT Presentation

Citation preview

Page 1: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

JWST Data Management Systems

Gretchen Greene

Page 2: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

JWST Mission Hierarchy for DMS

Page 3: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

DMS Estimated Archived Data Volumes – Baseline

Data Per Yr (TB)

5.5 yr Mission (TB)

10 yr Mission (TB)

Recorded engineering

0.3 1.6 3.0

Level-0 20.9 115.0 209.0

Level-1a 20.9 115.0 209.0

Level-1b 20.9 115.0 209.0

Level-2a (compressed 2:1)

1.0 5.6 10.2

Level-2b (compressed 2:1)

1.0 5.6 10.2

Level-3 (compressed 2:1)

1.0 5.6 10.2

WSS Archive package (compressed 2:1)

0.05 0.25 0.5

Total 66.1 363.7 661.1

Page 4: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

JWST DMS Interface Context

Project Level Agreements will be defined ~L-24mo

Dec 6-7. 2012

Page 5: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

JWST vs. HST DMS…Many Similarities, systems reuse (DADS, MAST), and

lessons learned, however there are…• Key Basic Differences:

– Order of magnitude increase in computational and I/O DMS throughputs

– Flight Operations System interfaces to DMS will support direct transfer at STScI of DSN telemetry data and require priority data processing for Wavefront Sensing and Control

• Functional Decisions:– As a result of Trade Studies, BOTH HST and JWST will be moving

toward scalable distributed architecture• Data Processing Workflow Management system (OWL-CONDOR)• Dynamic Reprocessing of Data Products with CRDS• Online Data Product File CACHE

– Higher Level data product generation assumed fundamental– Service based architecture to support multi-mission DMS

Page 6: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

MAST + JWST

• STScI Archive Access systems include the intersection between the JWST mission operations & MAST– Distribution Services– Archive User Interface (MAST Portal)– User Authentication– Archive Catalog (CAOM)– Online Data Product Cache

Page 7: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

Multi mission Functional Architecture Overview – SDR1

Page 8: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

JWST SOC DMSRequirements and Design Phases

• Completed formal Systems Level 4 Requirements– ~ 650 requirements for I&T verification

• Beginning DMS I&T for internal Build 1• Currently in year 2+ of design and development

– Systems Design Review 2 – Dec 6-7, ’12

• Designing for Launch Readiness Data (LRD) 2018 with 95% level of current STScI DMS capability

Page 9: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

S&OC Science Systems Engineering, Flight Operations, and Systems Development Timeline for a JWST 2018 LRD

Page 10: JWST Data Management Systems

Nov 26 2012

Nov 26 2012

Nov 26 2012

Nov 26 2012

DMS Build PlanBuild Name

Build Description

Components enabled Supported Systems

TargetedDelivery

Status

0 Internal Build Workflow Manager, Minimal Ramp Processing Pipeline, SID

DMS Design & Development

Dec-11 Completed

1 DMS Level 1 Internal I&T

DMS Workflow, Baseline Level-2a Pipeline, Baseline Level-2b Imaging Pipeline, CRDS, SID, Baseline SDP-1a

DMS, ISIM CV1RR

Sept-12 In Test

2 DMS I&T

ISIM Cryo 2 (OSIM)

DMS SDP WFS&C, Baseline WSS Pipeline, Baseline Level-2b Spectrographic Pipeline, SID , Baseline SDP-1b

DMS, ISIM Cryo 2

Sept-13 In Dev

3 DMS I&T

ISIM Cryo 3 (OSIM)

DMS - All SIs SDP, Baseline Operations Archive, Baseline Level-3 Imaging Pipeline, SID

DMS, ISIM Cryo 3 (?)

Sept-14

4DMS I&T SOC

Integration

DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic

SOC with DMS internal

Sept-15

5 DMS I&TJSC/OTIS

DMS, CAL, SDP, EDP, CRDS, Baseline Archive Access, Baseline Level-3 Spectrographic Pipeline, SID

SOC1,DMS, JSC/OTIS Testing

June-16

6 DMS CST2&3

+ Flight Release Fully Functional DMS SOC2,DMS

Flight Release Feb-17 (test cycle

+L-12)

6.1DMS Pre-Flight

UpdatesFully Functional DMS Updates SOC Pre-Flight

UpdatesJan-18