Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)

Observing System Observing System Monitoring Center (OSMC)Monitoring Center (OSMC)

Status UpdateStatus UpdateApril 2005April 2005

Steve Hankin – PMEL (co-PI)Steve Hankin – PMEL (co-PI)Kevin Kern – NDBC (co-PI)Kevin Kern – NDBC (co-PI)

… … to provide a system view of to provide a system view of global ocean climate observationsglobal ocean climate observations

A partnership …A partnership …

• PMELPMELUser interface logic & toolsUser interface logic & tools

• NDBCNDBCData assembly & operationsData assembly & operations

& assistance from Todd Pearce (OCO)& assistance from Todd Pearce (OCO)User interface layoutUser interface layout

OSMC (meta)databaseOSMC (meta)database

What is the “climate data record”?What is the “climate data record”?

•Current (meta)data Current (meta)data (“realtime”)(“realtime”)

– GTS -- primary sourceGTS -- primary source

•Historical (meta)dataHistorical (meta)data– poorly integratedpoorly integrated– need “DMAC” integrationneed “DMAC” integration– for now … use a GTS archivefor now … use a GTS archive

(misses e.g. NOAA research cruises)(misses e.g. NOAA research cruises)

OSMC (meta)database at NDBCOSMC (meta)database at NDBC

• Met and Ocean surface data are Met and Ocean surface data are updated daily with GODAE “T-files”updated daily with GODAE “T-files”(06, 12, 18, 24) from the previous day (06, 12, 18, 24) from the previous day ~350 MB of data per day~350 MB of data per dayURL=URL=http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Zhttp://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z

• Updates applied to NDBC-hosted time Updates applied to NDBC-hosted time series metadata from NDBC systemseries metadata from NDBC system

• Ship call sign info from the WMO Pub Ship call sign info from the WMO Pub 4747

http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z


• Profiling float data from US GODAE Profiling float data from US GODAE ServerServer

• Float updates from JCOMMOPSFloat updates from JCOMMOPSURL = URL = ftp://ftp.jcommops.org/Argo/Status/status.txtftp://ftp.jcommops.org/Argo/Status/status.txt

• Country information is assigned Country information is assigned based on WMO allocation tablebased on WMO allocation tableURL = URL = http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htmhttp://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm

ftp://ftp.jcommops.org/Argo/Status/status.txt

http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm


• Met and surface ocean database back to June Met and surface ocean database back to June ‘04‘04• Profile data back to January ‘04Profile data back to January ‘04

Platform TypePlatform Type # # ObservationsObservations

ARGO FLOAT 5,4326

CMAN 794,262

DRIFTING BUOY

4,447,127

MOORED BUOY

2,066,686

SHIP 682,757

NOT DEFINED 934,451

Platform_ID Last_Report Type Description Organization URL Country XML

OSMC_Platform

ID Name Abbrev

OCMC_Country

ID Name Country URL Contact_Name Contact_Email

OSMC_Organization

Platform_ID Ob_Date Latitude Longitude SLP SST ATMP DEWPOINT WINDSPD WINDDIR CLOUDS XML

OSMC_Observation

OS

MC

Data

base –

En

tity

D

iag

ram

Country is based on ISO 3166, which defines unique 2-character identifiers for each country

Organization identifies an agency, institute, university, or private company that owns or operates a reporting platform

Platform identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data

Observation records the instance of a marine observation for a reporting date and time.

OSMC Database OSMC Database EnvironmentEnvironment

• Dell PowerEdge 2650Dell PowerEdge 2650– Dual Processor 3.06 GHz/1MB CacheDual Processor 3.06 GHz/1MB Cache– Five 146 GB HarddriveFive 146 GB Harddrive– Red Hat Enterprise Linux ES v3Red Hat Enterprise Linux ES v3

• Oracle DatabaseOracle Database

OSMC (meta)databaseOSMC (meta)database

• Gridded filesGridded filesObservation metadata are Observation metadata are summarized into 1X1 degree gridded summarized into 1X1 degree gridded files (netCDF) to support evaluation files (netCDF) to support evaluation operationsoperations

OSMC must provide:OSMC must provide:

•Overview (where are the obs?)Overview (where are the obs?)

•Drill-down (what are the obs?)Drill-down (what are the obs?)

•Evaluation (are the obs adequate?)Evaluation (are the obs adequate?)

Reports in Time frame

Reports in Time frame

Average of obs

Average of obs

Percentage of Adequate Sampling

Percentage of Adequate Sampling

countrycountry

platformplatform

Parametervalue

Parametervalue

Time sinceLast report

Time sinceLast report

STD deviationfrom

Climatology (future)

STD deviationfrom

Climatology (future)

Observing System Monitoring Center

DOMAIN

Selectglobal, oneocean, orpoint and

drag aregion.

PLATFORMS

Select oneor a set

ALL

SHIPS OFOPPORTUNITY

TROPICALMOORINGS

DRIFTERS

TIDE GAUGES

ARGO

REFERENCESTATIONS

COASTALMOORINGS

GLOBAL

ATLANTICOCEAN

PARAMETERS

Select oneor a set

SST

SEA SURFACEPRESSURE

SEA SURFACEWIND

UPPER OCEANTEMPERATURE

SURFACECURRENTS

SUBSURFACECURRENTS

SEA LEVEL

PRECIPITATION

RADIATION

AIRTEMPERATURE

PCO2

OCEAN CARBON

TOTAL DEPTHTEMPERATURE

SEA SURFACESALINITY

SALINITY ATDEPTH

SAVE

PRINT

BASE MAPMenu bar across top.

Color/symbol key acrossbottom.

UTC clock at upper right.

Any screen orwindow.

PACIFIC OCEAN

INDIAN OCEAN

SELECT AREGION

High-to-low(hot-to-cool)color scale.

CLOCK

UTC

DATA POINTSIf IPRC, filled circle. Ifnot, open circle from

Monterey. If not, crossfrom telemetry.

RESEARCHVESSELS

TRANSPORTARRAYS

UTILITIES

LOCAL TIME INSELECT CITIES

BASE MAPAPPEARANCE

DATA POINTAPPEARANCE

TEXT

DRAW

Zoom

Web toMonterey,

IPRC

Hard Wire toTelemetry

Time FrameTime Frame

Select OneSelect One

ArbitraryRange

ArbitraryRangeConvenience

choices

Convenience choices

TodayToday

yesterdayyesterday

2 days ago2 days ago

This weekThis week

Last weekLast week

This quarterThis quarter

Last quarterLast quarter

othersothers

Data SourceData Source

Select one orboth

Select one orboth

IndividualObs

IndividualObs

Gridded Field

Gridded Field

Color byColor by

otherother

Select OneSelect One Select OneSelect One

1x1 degree1x1 degree




Levitusvariability

(via NVODS)

Levitusvariability

(via NVODS)

Levitus meanValue

(via NVODS)

Levitus meanValue

(via NVODS)

1Major ocean Basins

(N. Atlantic, Trop.

Atlantic,etc.)

1Major ocean Basins

(N. Atlantic, Trop.

Atlantic,etc.)

1Whole globe

1Whole globe

Drill DownDrill Down

Grid cell

Grid cell

Single Observation

Single Observation

Select oneSelect one


Metadata report

Metadata report

Instrument history

Trace map

Instrument history

Trace map

InstrumentMeasurementTime series

InstrumentMeasurementTime series

Plot of profileValues (future)

Plot of profileValues (future)


StatisticsSummary of Obs in grid

Cell

StatisticsSummary of Obs in grid

Cell

Clickable listOf

Individual Reports

Clickable listOf

Individual Reports

1.Gridded fields shown with graticuleoverlay. Click on grid cells for drill down

KEY: Blue = Completed Red = FY05 Work Green = System Navigation Note: Data accumulation will occur over time. Currently the database has data

from 1 June 2004, however, it will be back filled to 1 January 2004

User interface & User interface & tools for tools for

evaluationevaluation

Web-accessible to the Web-accessible to the communitycommunity

Visualization & evaluationVisualization & evaluationOverviewOverview

all platforms reporting today


all platforms reporting air temp. today

all platforms reporting SST today


all platforms reporting SST today colored by age


Drifters reporting SST today


U.S. drifters reporting SST today


U.S. drifters reporting SST this week


U.S. Pacific drifters reporting SST this week


U.S. Pacific drifters reporting SST this month

mouse click for metadata summary

Visualization & evaluationVisualization & evaluationDrill DownDrill Down

mouse click to view data


mouse click to view plot


User interface & tools for User interface & tools for evaluationevaluation

•Overview (where are the obs?)Overview (where are the obs?)

•Drill-down (what are the obs?)Drill-down (what are the obs?)

EvaluationEvaluation(adequacy of the observations)(adequacy of the observations)

Number of platforms per 1x1 degree box reporting SST today

Visualization & evaluationVisualization & evaluation

Number of platforms per 1x1 degree box reporting SST this week


Number of platforms per 1x1 degree box reporting SST this month


Number of platforms per 5x5 degree box reporting SST this month


5x5 degree boxes this month that had one or more SST obs every day


Percentage of days when a 5x5 degree box had at least 5 SST obs


Click for time series record of SST obs in a single 5x5 grid cell


Click for time series record of SST obs in of an ocean basin


Click for global time series of SST obs


OSMC LAS

The OSMC doesn’t look like a Live Access Server …but it is

(Shown is the more traditional LAS user interface)

“Adopt-a-Drifter”is another specialized user interface to the same OSMC server

Ready for integration into NVODS, DMAC, and IOOS

Ocean CO2 data access with LAS

Next stepsNext steps• Wire it together robustlyWire it together robustly

(It is not as mature as it appears)(It is not as mature as it appears)

• Improve performanceImprove performance

• User interface make-overUser interface make-over(w/Todd Pearce(w/Todd Pearce))

• Full support for profile dataFull support for profile data

• Bring NGDC/NOSA GIS efforts into Bring NGDC/NOSA GIS efforts into the partnershipthe partnership

Next steps (database)Next steps (database)

• Improve Meta-data quantity and qualityImprove Meta-data quantity and quality– Eliminate “Not Defined” platformsEliminate “Not Defined” platforms

•Further coordinate with JCOMM OPSFurther coordinate with JCOMM OPS– Add organization URLsAdd organization URLs

• Expand data sourcesExpand data sources – Carbon Data Carbon Data – NOAA High Resolution Ship Data (FSU)NOAA High Resolution Ship Data (FSU)– Repeat Lines, Ocean Reference Stations, …Repeat Lines, Ocean Reference Stations, …

and after that …and after that …

• Other types of dataOther types of data(biochem, fisheries, …)(biochem, fisheries, …)

• IOOS/DMAC integrationIOOS/DMAC integration(satellites, models, GIS, …)(satellites, models, GIS, …)

• Quality control metadataQuality control metadata

• Expanded evaluation metricsExpanded evaluation metrics

to be guided by community input …to be guided by community input …

Suggestions? Questions?Suggestions? Questions?

Documents

Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)