NAVOCEANO & NVODS

10 Sep 2003

James Rigney

NAVOCEANO/NVODS History

NAVOCEANO engaged in NOPP process to establish NVODS Listed as a partner on the winning proposal from URI

Conducted NVODS workshop at SSC in late Oct 2000. At that time committed to host a server.

Established an NVODS regional server at NAVO in late 2000, early 2001.

Original holdings were DBDB and GDEM. Used DODS/LAS, the community protocols for NVODS. “If you build it they will come” – didn’t work. Never

received a single data set from the Gulf community to host on our server.

NAVOCEANO Data Access Server Status - as of 04/09/2001

Data or Program DODS LASNAVOCEANO Public Data Access Server Yes YesNAVOCEANO MEL Server (SUN E450) No NoDBDBV – (Available via NAVO WWW server) No NoDBDB-5 – (Selected Areas) Yes YesWAM* Yes NoMCSST* Yes NoSelected Data form NGLI – (Available via NAVOWWW server)

No No

* Note: WAM and MCSST Netcdf format is currently being modified for LAS compatibility.

NAVOCEANO Data/Product Dissemination

NAVO has a robust Data/Products Dissemination segment. NVODS server is just one part.

Open DataAccess

Open DataAccess

Non-WebProduct

Distribution

Non-WebProduct

DistributionWeb

Products

WebProducts

DODS TEDSDPSLASMELNGLISMWVMVL FTPWIPE

DWH

DBDBV GDEMV

Open Data Access Segment Concept of Operations

• NAVOCEANO White Front Door– Support NAVOCEANO vision to provide oceanographic

expertise to the military and civil community

• Support Operational DOD requirements, and a broad range of Educational/ Research Customers

• Provide a site for access to open access of Meteorology and Oceanography (METOC) products, information, and data.

Open Data Access Segment

• Distributed Oceanographic Data System (DODS) / Open source Project for a Network Data Access Protocol (OPeNDAP)

• Live Access Server (LAS)• Master Environmental Library (MEL)• Northern Gulf of Mexico Littoral Initiative

(NGLI)• Data WareHouse

IndustryK-12

UniversitiesGovernment Agencies

Individuals

WAMGDEMMCSSTNLOMSWAFSMODASCOAMP

NGLIOTISDWH

DBDB-V

DODS/LAS(Sun E450)

DWH(Windows 2000)

MEL(Sun E450)

NGLI(Sun Server)

NAVOCEANO Open Data AccessCustomersData Source Data Servers

Live Access Server

• LAS provides a query and visualization capability for a DODS server.

• LAS enables the Web user to request data subsets in a choice of file formats .

• Hosted on Sun E450 server.

• 2,908 Data Objects/Files Currently Stored on System.

Distributed Oceanographic Data System

• DODS is software that simplifies all aspects of remote data access.

• DODS enables existing software to access remote data transparently.

• Hosted on Sun E450

• WAM, DBDB-V, MCSST, SWAFS, NLOM, GDEM Data

• 3,487 Data Files Containing 37 GB Data

Customer

FTP TransferFrom Remote

Source

NAVO HPC Server

NAVO HPC Storage Silo

N-ODA Disk Storage Resource

NAVOCEANO N-ODA Server

NAVO FTP Server

InternalNAVOCEANO

Data Load

Open Data Access Data Flow

Master Environmental Library

• MEL is a DMSO sponsored, one-stop site for ordering environmental information.

• MEL, users can locate and order environmental information that resides on U.S. military and government sites.

• Data sent to FTP address or picked up at data source.

• Hosted on Sun E450 server.

Open Data Access Product StatusSep 2003

Data or Program DODS LASNAVOCEANO Public Data Access Server Yes YesNAVOCEANO MEL Server No NoDBDBV – (Available via NAVO WWW server) No NoDBDB-5 – (Selected Areas) Yes YesGDEM Yes YesMCSST Yes YesNLOM Yes YesSWAFS Yes YesWAM Yes Yes

METOC Data Standards• The Data Warehouse Catalog physically

implements the metadata requirements contained by the Federal Geographic Data Committee (FGDC) Metadata Content Standard

• The NAVOCEANO Logical Data Model is consistent with the Joint Meteorology and Oceanography Conceptual Data Model (JMCDM)

• On-going data standardization efforts include:– NetCDF– Environmental Data Coding Standard (EDCS)– eXtensible Markup Language (XML)

METOC Data Standards• Cooperative Ocean/Atmosphere Research Data Service (COARDS)

Conventions for the Standardization of NetCDF Files

• NetCDF (Network Common Data Form) is an interface for scientific data access which implements a machine-independent, self-describing, extendible file format. NetCDF was originally developed by Unidata for the storage and exchange of data within the space and earth science communities. It is based on the earlier work on the Common Data Form (CDF). NetCDF software uses the concept of an abstract data type, via a defined set of C library functions. Internal data representations can be changed without affecting the user program.

• The Cooperative Ocean/Atmosphere Research Data Service (COARDS), a NOAA/university cooperative for the sharing and distribution of global atmospheric and oceanographic research data sets, has written a summary of conventions for the standardization of netCDF file headers to provide for greater interoperability.

Open Data Access Server Statistics

1

10

100

1000

10000

100000D

ata

Pag

es

mil 29371 3511 1163 431 1186 35662

navy.mil 29352 3490 1178 430 1304 35754

navo.navy.mil 29346 3470 1172 426 1289 35703

edu 138 169 22 16 57 402

com 23050 1434 802 204 673 26163

.gov 52 813 14 1 6 886

.net 55029 159 74 22 96 55380

WAM MCSST SWAFS NLOM DBDBV Total

Open Data Access Server Statistics

Month UniqueVisitors

Pages Volume Domains Countries .EDUIPs

.MILIPs

NAVY.MIL

.GOVIPs

September '02 1211 159597 564 MB 343 36 75 122 98 31October ‘02 1338 177562 539 MB 399 38 81 122 83 29

November ‘02 1300 88129 287 MB 403 43 62 117 87 27December ‘02 1381 201890 287 MB 392 43 52 144 107 28

January ‘03 1532 81307 289 MB 445 49 68 147 100 35February ‘03 1226 67862 223 MB 380 45 64 135 96 28

March ‘03 1415 107100 1.38 GB 404 43 74 137 100 33April ‘03 1428 87995 279 MB 424 43 98 103 67 20May ‘03 1415 94000 232 MB 411 45 66 129 97 31

June ‘03 1244 89585 379 MB 365 34 100 228 178 58July ‘03 1818 123957 442 MB 500 42 93 142 104 34

August ‘03 1652 143398 336 MB 462 42 61 130 96 28

Note: Bandwidth used for DODS data access is not included in data volume for each month.

NIPRNET - TOP TEN PRODUCTSFY02 (1 Oct 01 - 17 Apr 02)

TOTAL PRODUCT HITS - 3,196,898

• WAM (2,530,073)• OFA (240,890• K10 MCSST (127,763)• DATA MODEL (61,807)• SWAFS (52,437)• PDOM (43,336)• WAVE MODEL (28,067)• SAT VISIBILITY (20,198)• STWAVE (19,610)• WEEKLY MCSST (18,708)• ALL OTHER (54,009)

WAM OFA

K10 MCSST DATA MODEL

SWAFS PDOM

WAVE MODEL SAT VISIBILITY

STWAVE WEEKLY MCSST

ALL OTHER

Task Force Web*

• In April 2001, the Chief of Naval Operations chartered TFW to lead the Navy’s transformation to a web-enabled environment by:– Establishing and maintaining a web architecture.– Providing recommendations on Web Enablement

technologies.– Reviewing Operational Requirements for Web Enablement

opportunities.– Working with major the Navy’s major System Commands to

prioritize and migrate existing systems.

*From: “Web Enabled Navy”, CAPT Skip Hiser, NMCI Industry Sympsiumhttp://www.nmci.navy.mil/Secondary_Areas/Industry_Info/SymposiumDailyNews/Files/Briefings/Tuesday/breakout/TFWebHiser2.ppt

WEN Benefits*• More ubiquitous access to information services• Improved interoperability

– Extensive use of recognized commercial standards – Separation of data from presentation enables support for

multiple display devices

• Improved quality of information– Establish authoritative databases supporting similar services

across multiple locations– Provides ability to aggregate data from multiple sources

• Reduced Total Costs– Software support & hardware costs reduced– Configuration management simplified

*From: “Web Enabled Navy”, CAPT Skip Hiser, NMCI Industry Sympsiumhttp://www.nmci.navy.mil/Secondary_Areas/Industry_Info/SymposiumDailyNews/Files/Briefings/Tuesday/breakout/TFWebHiser2.ppt

Network Centric Warfare Is the Theory.

Net-centric Operations Is the Concept.

FORCEnet Is the Process of Making the Theory and Concept a Reality.

“FORCEnet is the operational construct and architectural framework for Naval Warfare in the Information Age which

integrates Warriors, sensors, networks, command and control, platforms and

weapons into a networked, distributed combat force, scalable across the

spectrum of conflict from seabed to space and sea to land.”*

*CNO’s Strategic Study Group - XXI definition from 22 July 02 CNO Briefing

• FORCEnet Is Not – A Program of Record– A Redundant Effort– A Box or System– Just a Network

What Is FORCEnet?

From: SPAWAR brief by Mr. Leonard Coppenrath

Warfighting in the 21st Century

J O CJ IC

U U V

G P S

S A T C O M

D S PN A T IO N A L

S E N S O R

C S G

E S GS O F

C o n t r o l

E n g a g e

T r a c k ( p r e c is e p o s i t io n a n d t im e )

E n r o u t e G u id a n c e

G P S G u id a n c e

T e r m in a l G u id a n c e

F O R C E n e t2 5 A p r i l 2 0 0 3

D R A F T

L in k 4 /1 1 /1 6 /2 2C E C /V o ic e /D a t a

L in k 4 /1 1 /1 6 /2 2V o ic e /D a t a

C O M M U N IC A T IN G

S E N S I N G

CND

C N DM A G T F

M P F ( F )

I n t r a - T h e a t e r N e t w o r k s

L o c a l P la t f o r mN e t w o r k s

J o in t S e n s o r s

S p a c e S e g m e n tN e t w o r k s

B r o a d c a s t

T a c t ic a l S e n s o r s

C o m m a n d & C o n t r o l

C A S

T a r g e t in g

M in e R e c o n n a i s s a n c e

O u t b o a r dS e n s o r

L in k 1 6 /E P L R SV o ic e /D a t a

T h e a t e r S e n s o r s

D IS N

J F A C C

J F M C C

M in eH u n t in g -

U n d e r W a t e rR e c o n n a i s s a n c e

M C M

A c o u s t icS e a r c h

2 5 A p r i l 2 0 0 3

D R A F T

C O M M U N IC A T IN G

S E N S IN G

A T T A C K IN G

B R O A D C A S T

N O C

T e le p o r t in g

• Exploit Every Source – Leverage What We Have

• Provide Shared Situation Awareness/ Understanding

• Support Dominant Speed of Command

• Permit Precise, Synchronized Execution

• Allow Agility and Flexibility

Dynamic Force CompositionDynamic Force Composition

From: SPAWAR brief by Mr. Leonard Coppenrath

Distributed Services Provides Composeable Capabilities

Transform Warfighting Operations• Composing Capabilities - “Assemble Components on the Fly”• Joint - Agile - Tailorable• Geospatial –Based Shared Awareness and Collaboration• Intuitive Linkage to Information

Transform the Acquisition Process• Sea Enterprise:

- Collaborative Development- Re-usable Components - Spiral Development

• Legacy System Interoperability

• Sea Trial

“Composeable”Joint Organizations

“Composeable”Tactics & Doctrine

“Composeable” Capabilities

Services Services Services Services

STOM

JMF

EnduringFreedom

IraqiFreedom

HomelandDefense

From: SPAWAR brief by Mr. Leonard Coppenrath

Push to a Common Environment

CDL IP TDL

ISR C2

ISRJC2DJC2DCGSNCES

Clients

B2B

Distributed Services

C2 CombatSystems

B2B

B2

C

B2

C

B2

C

B2

C

C2C C2C C2C

GiG JTRS TCIntegrated Networks & CommunicationsGIG-BE

Key Enablers•XML•IP•E2E Information Assurance

B2B = Business to BusinessB2C = Business to ConsumerC2C = Consumer to Consumer(enabling publish/subscribe solutions)

Fn TargetAs - Is

Consumers

Servers Combat Systems

Security Security

Stovepipe Communications

Security

Joint Building Blocks

From: SPAWAR brief by Mr. Leonard Coppenrath

Born Joint and Built on Distributed Services

Distributed Services

C2 Functions

Combat Systems

Functions

ISR Functions

DJC2 – Distributed Joint C2GIG ES – Global Information Grid Enterprise ServicesNCES – Network-Centric Enterprise ServicesNCCT – Network-Centric Collaborative TargetingOA – Open ArchitectureXTCF – eXtensible Tactical C4I Framework From: SPAWAR brief by Mr. Leonard Coppenrath

Web Services; Navy Interoperability• TFW/WEN Architecture

Coordination with Big Navy. We have a Web Services Working Group that is building our

long range WS plans. If NVODS/NOPP wants to play in WS, we will engage If NVODS/NOPP wants to fund WS development, we’re very

interested. DODS/LAS is the closest thing we have to “web services” for

our data. Not the way to go long term – or is it??? We have to go all the way with web services Required by Navy Enterprise Portal policy and FORCEnet. Key to our interest in NVODS in the future

Other misc

• NAVY/NOAA MOA– Defines collaboration btwn NAVOCEANO

and NCDDC– So far: Hosting NGLI assets

• SIS - GIS SW