NASA Earth Science Data Systems Program

Martha Maiden Program Executive, Earth Science Data Systems Earth Science Subcommittee November 28, 2012

NASA’s Earth Observing System Data and

Information System

Manages data from several types of sources – satellite missions, aircraft investigations, PI-led dataset generation efforts Initiated in 1990 • In operation since 1994 with mature metadata for “heritage” datasets • In operation since 1997 supporting EOS instrument datasets starting

with the Tropical Rainfall Measuring Mission A petabyte-scale archive of environmental data that supports global climate change research Designed to receive, process, distribute and archive several terabytes of science data per day Provides a distributed information framework supporting a broad user community Open Data Policy – Data are openly available to all and free of charge except where governed by international agreements

• Consistent with Circular A-130 By having open application layers to the EOSDIS framework, we allow many other value-added services to access NASA’s vast Earth Science Collection Interoperates with data archives of other agencies and countries

2

Earth Science Measurements

Acrimsat • 12/99

Solar Output ACRIM

Terra • 12/99

Energy Budget CERES

Albedo, Aerosols, Vegetation

MISR

Lower Atmospheric

Chemistry MOPITT

Surface Imaging MODIS, ASTER

TRMM • 11/97 Rainfall

CERES, TMI VIRS, PR, LIS

Temperature Moisture

Sea Surface Winds

Ecosystem Dynamics

SORCE • 1/03 Solar

Irradiance TIM, SIM, XPS

Solstice

Aura • 7/04 Atmospheric Composition

HIRDLS, MLS, OMI

Trace\ Gases TES

Rain

Sea Ice

TROPOSPHERE O3, Precursor

Gases, Aerosols

Ocean Biology

Ocean Surface Topography

STRATOSPHERE O3, CIO, BrO, OH,

Trace Gases, Aerosols

MESOSPHERE Aqua • 5/02

Surface Imaging MODIS

Energy Budget CERES

Atmospheric Sounders AMSR-E

AIRS/AMSU/ HSB

Land Ice and Snow Cover

Ocean Circulation

Evaporation H2O

Fire Occurrence

Land Biology

Rain

CloudSat • 4/06 Cloud

Properties CPR

CALIPSO • 4/06 Cloud, Aerosol

Properties CALIOP

Jason • 12/01 Ocean

Altimetry Poseidon 2/ JMR/DORIS

OSTM • 6/08 Ocean Altimetry

Poseidon 3/ AMR/DORIS

Ice Bridge • 10/09 Ice

Topography and Altimetry

ATM

Volcanology

GRACE • 3/02

Gravity Field GPS, KBR

National Aeronautics and Space Administration

www.nasa.gov

Earth Science Measurements

Applied

Discipline-oriented Data Centers ASF SDC

SAR Products, Sea Ice,

Polar Processes, Geophysics

PO.DAAC Gravity, Sea Surface Temperature, Ocean Winds, Topography,

Circulation & Currents

NSIDC DAAC Snow and Ice, Cryosphere, Climate Inter-

actions, Sea Ice

LP DAAC Surface

Reflectance, Land Cover,

Vegetation Indices

SEDAC Human Interactions,

Land Use, Environmental Sustainability,

Geospatial Data

GES DISC Global Precipitation,

Solar Irradiance, Atmospheric Composition

and Dynamics, Global Modeling

CDDIS Space Geodesy,

Solid Earth

OBPG Ocean Biology,

Sea Surface Temperature

MODAPS/ LAADS

MODIS Level-1 and Atmosphere Data Products

LaRC ASDC Radiation Budget, Clouds, Aerosols,

Tropospheric Chemistry

GHRC DAAC Hydrologic Cycle,

Severe Weather Inter- actions, Lightning,

Atmospheric Convection ORNL DAAC

Biogeochemical Dynamics,

Ecological Data, Environmental

Processes

ECHO Architecture

ECHO is NASA’s middleware layer between Earth science data and users via a service-oriented architecture. Designed to improve the discovery and access of NASA data.

Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their data holdings and other Earth science-related data holdings. User-defined specialized “clients” can be easily developed to give science data users of their community access to data and services using ECHO’s open APIs.

Developed as a part of NASA’s

core data systems but

fully adaptable to the

needs/requirements of science

communities.

6

0

50

100

150

200

250

300

350

400

450

500

550

600

650

700

FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 to date Sep

Millions

EOSDIS Key Metrics

7

ESDIS Project Supports Science System Elements

Data Centers 12

SIPS 14

Interfaces Interface Control Documents 22

Partnerships US 10 International 6

Missions

Science Data Processing 10

Archiving and Distribution 37

Instruments Supported 87

More information: EOSDIS: http://earthdata.nasa.gov

EOSDIS Products Delivered (Millions) ~635,000,000 products in 2012

>120X increase over 2000

Preliminary EOSDIS FY2012 Metrics

Unique Data Products 6,986

Distinct Users of EOSDIS Data and Services 1.49 M

Web Site Visits of 1 Minute or more 1.97 M

Average Daily Archive Growth 5.3 TB/day

Total Archive Volume 6.4 PB

End User Distribution Products 635 M

End User Average Daily Distribution Volume 14.8 TB/day

Evolution of EOSDIS Elements and Continuous Evolution

EOSDIS underwent a concerted process for “Evolution” in the 2005-2008 timeframe. •Led by EOSDIS Project Manager Esfandiari, OES Program Executive Martha Maiden •Recommendations by External Advisory Panel, led by Moshe Pniel •Effort under Terms of Reference signed by Ghassem Asrar, with Implementation Plan concurred by Mary Cleave

Resultant system reduced costs 30%, Information Technology currency, closer to science needs, with capability to continuously evolve. Continuous evolution investments about 10% of Multi-Mission Ops budget, and include system and data product/quality investments. ESS reviewed the EOSDIS System at their January 2008 meeting, reserving one hour on the agenda. ESS letter February 6, 2008 was complimentary (from NASA website). • “We were impressed by the success and clear sense of direction of that

program.” • “We are a long way from the EOSDIS problems of less than a decade ago!”

8

2015 Vision Goals Addressed

Vision Tenet Vision 2015 Goals

Archive Management NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit.

EOS Data Interoperability

Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other

relevant data and systems. Processing and data are mobile.

Future Data Access and Processing

Data access latency is no longer an impediment. Physical location of data storage is transparent. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed.

Data Pedigree Mechanisms to collect and preserve the pedigree of derived data products are readily available.

Cost Control Data systems evolve into components that allow a fine-grained control over cost drivers.

User Community Support

Expert knowledge is readily accessible to enable researchers to understand and use the data.

Community feedback directly to those responsible for a given system element.

IT Currency Access to all EOS data through services at least as rich as any contemporary science information system.

Feb 3, 2005 EEE

2015 Vision Goals Addressed

Vision Tenet Vision 2015 Goals

Archive Management NASA will ensure safe stewardship of the data through its lifetime. The EOS archive holdings are regularly peer reviewed for scientific merit.

EOS Data Interoperability

Multiple data and metadata streams can be seamlessly combined. Research and value added communities use EOS data interoperably with other

relevant data and systems. Processing and data are mobile.

Future Data Access and Processing

Data access latency is no longer an impediment. Physical location of data storage is transparent. Finding data is based on common search engines. Services invoked by machine-machine interfaces. Custom processing provides only the data needed, the way needed. Open interfaces and best practice standard protocols universally employed.

Data Pedigree Mechanisms to collect and preserve the pedigree of derived data products are readily available.

Cost Control Data systems evolve into components that allow a fine-grained control over cost drivers.

User Community Support

Expert knowledge is readily accessible to enable researchers to understand and use the data.

Community feedback directly to those responsible for a given system element.

IT Currency Access to all EOS data through services at least as rich as any contemporary science information system.

+

+

+ In Progress EEE As of 2012

+