NAVO’s War-Fighter Image Processing Environment (A Network Centric Image Processing System)

5/25/1999

NAVO’sWar-Fighter Image Processing Environment

(A Network Centric Image Processing System)

Prepared for theNaval Oceanographic Office

May 25, 1999

Dr. Erick MalaretACT Corp.

http://www.actgate.com

5/25/1999

OUTLINE

•NAVO’s WIPE System Overview

•WIPE’s Building Blocks

•Examples with WIPE

•Real-Time WIPE DEMO

•Concluding Remarks

5/25/1999

•WIPE is a network centric system For Geo-Spatial Data: Assimilation, Processing, and Distribution

•WIPE provides Flexible WWW Access to all Data in an Interactive Manner ==> Products and Virtual Products

War-fighter Image Processing Environment

5/25/1999

NAVO/WIPE System

A WIPE (classified) server has been implemented at NAVO to host the following data sets over the SIPRNET

•Acoustic Imagery•Bathymetry•Satellite Imagery•Surface Sediments•Bottom Roughness•Mine-Like Contacts•Ship Location•3d Grid of Ocean Temperatures •3d Grid of Ocean Salinity •Wrecks and Obstructions

5/25/1999

•MSHELL - Image Processing Interpreter Language developed by ACT. The language has a high level syntax similar to Matlab and IDL.

•ProVIEW - Professional Windows Environment for Windows (ProVIEW). ProVIEW has extensive capabilities in image processing, analysis, and map generation.

•WIPE - War-fighter Image Processing Environment. Data Assimilation, Processing, and distribution system with WWW interactive capabilities.

MSHELL provides the computational engine used by ProVIEW & WIPE

ProVIEW provides many of the graphical capabilities used under WIPE

WIPE LEVERAGES IN ACT’s SOFTWARE

5/25/1999

Levels of Mission Critical Support Provided by ACT at the Image Processing Center(s)

LACE/UVPI Clementine I MSTI2 MSTI3 NATO’sRapid Response 96-98

Stardust(laun.98)

NEMO(launch2000)

Quick Look YES YES YES YES YES YES YESGeometry Computations NO YES N/A YES YES YES YES

Long Term Archival YES YES N/A YES YES YES YESIn-flight Calibration YES YES N/A YES N/A YES YESImage Header Type FITS PDS N/A PDS PDS PDS PDS

Level 1 Turn Around Time N/A 48 Hours N/A <24hrs N/A <2Hrs <24hrsLevel 1 Revised N/A <3 Months N/A N/A <2months TBD

Level 2 Turn Around Time 6 months N/A N/A <24hrs N/A <2months 24hrs(level1b)

Level 3 Turn Around Time 6 months 1 week N/A N/A 1hr TBD TBDWWW Remote Access N/A YES N/A YES YES YES YESApprox. # of Images 500,000 2 Million 1000/day 10,000/day Multiple images/day

(7 different sensors)TBD 40

images/day(105Gbytes)

User Community DOD DOD/NASA DOD DOD US NAVY & NATO’sWar-Fighter

NASA DOD &Commercial

Key Software Used MSHELL MSHELL/ProVIEW

MSHELL/ProVIEW

MSHELL/ProVIEW

MSHELL/ProVIEW/

WIPE

MSHELL/ProVIEW

MSHELL/ProVIEW/

WIPE

Mission Critical Support Experience

WIPE and its building blocks (MSHELL and ProVIEW) have been extensively used in many mission critical operations

5/25/1999

•O96 (REA)•SACLANT CENTER - (REA)•NRL’s Naval Center for Space Technology•NEMO •NAVO •NOAA•NRL Stennis & SPAWAR (DEI Project)

WIPE’s KEY USERS

TI

ME

5/25/1999

WIPE’s Data Types, and Models

WIPE supports multiple data types:•Point Data•Vector Data•Gridded Data•Non-gridded Data•Volumetric Data•N-Dimensional Data

WIPE supports key industry data standards:•SQL Relational Data Bases•Vector Product Format•Shapefile (ArcInfo,ArcVIEW)•NetCDF•CEOS (Radarsat, …)•ASCII Tables•PDS (NASA) and FITS• ...

5/25/1999

WIPE’s Output

WIPE supports multiple data output options for both raw data and meta-data •textual output•interactive access to data values•2-D plots and 3-D plots for selected regions•image view of data

•JPEG,GIF •float files, and NetCDF files (good for further analysis)

5/25/1999

WIPE Server #1

WIPE Server #2

WIPE Server #M

HTTP/CGI

CORBA

Client #1• WEB Browser

with swingjar java classes support

Clien #K• WEB Browser

with swingjar java classes

• ProVIEW

Data Provider #1•Satellite Imagery: SAR, LANDSAT, SPOT, AVHRR, ...•mine locations•...

Data Provider #1•Satellite Imagery: SAR, LANDSAT, SPOT, AVHRR, ...•mine locations•...

Data Provider #N•3D Model Data•virtual products from WIPE•in-situ bathymetry•...

Data Provider #N•3D Model Data•virtual products from WIPE•in-situ bathymetry•...

TransferMethod(s)to a WIPE

server

Sample Data Providers

InteractiveMidlewareProtocol(s)

Interactive Clientsrequesting and

recevingvirtual products

Network of WIPE Servers

HostingGeo-Spatial Data

FTP

CORBA

.

.

.

.

.

....

Network Centric High-Level Architecture

.

.

.

.

.

.

Non-WIPE Server

5/25/1999

WIPEData Server/Processing Engine(Windows/NT or UNIX machine)

WIPESensor Data Assimilation

Engine(Windows/NT or UNIX machine)

HIGH Level WIPE Functional Architecture(for a single WIPE System)

Data Provider, e.g.• SAR Satellite• HyperSpectral Satellite• Data From Other Sources

• Updates to Digital Terrain Elevation

• Updates to Known Bathymetry

• Other

Tape Loadingor

FTP transferor...

Queries

Results

Client Using Web Browser• Can Access all Sensor Data in an

interactive manner• With ProVIEW on Client Side:

• Accepts data files with embedded code,e.g PDS and NetCDF

• Allows further data analysis

(Note: Multiple WIPE servers can collaborate in a transparent manner)

5/25/1999

Single WIPE Server Architecture

Proposed Enhancement with “METCAST + DEI/DOI”

ProVIEW WEB AGENTMSHELL (IMAGE PROCESSING INTERPRETER LANGUAGE)•Large Collection of Multi-Dimensional Image Processing Algorithms•User Provided Algorithms: static and dynamic •Midleware Interfaces: based on CGI ( CORBA in the near future)

To Other•WIPE LANs•DEI Sites•OTHER HTTP Servers

To Other•WIPE LANs•DEI Sites•OTHER HTTP Servers

Interactive Users

or applicationsaccess to selected:•source data•products•virtual products•visualization tools

Interactive Users

or applicationsaccess to selected:•source data•products•virtual products•visualization tools

Subscribed Usersor Subscribed Apps

Subscribed Usersor Subscribed Apps

Sample Data Sources:•satellite images•gridded data•non-gridded data•ASCII files•Vector data•volumetric data•ArcInfo filesOther Inputs:•METADATA• ALGORITHMS•Model output•WIPE output product•METADATA w/ LINKS TO REPOSITORY!

.

.

.

High Level Data Finder•Queries Meta Data•Requests Actual data and output format

AssimilationEngines/Code

SCHEDULER•checks for new data•garbage collection---------------------------Invokes ProVIEW scripts

Staging Incoming Directory

(security)

PROCESSED Data and/or

SOURCE DATA(file system)

Flexible Readers•extracts & re-samples as needed ROI

Data Packersand Data

Visualization

META DATA(SQL Data base)

ConfigurationTables

(SQL Dbase)

Assimilation Engine Server Engine

WIPE server can consist of a single Windows/NT machine (200MHz and above)

5/25/1999

EXAMPLE SCREENS ON THE FOLLOWING PAGES SHOW

•NAVO (Un-classified Examples) •REA 96 data •REA 98 data

5/25/1999

High Level Search Browser

High Level Search Browser is used for finding data as a function of:•Time•Sensor•Location

REA 96-98 data availability

5/25/1999

Security is built on top of Windows/NT

•Password and Login•IP Address of Client

Access restrictions are done on each data-source, e.g. user x can access Bathymetry data but not satellite data

High Level Search Browser (cont.)

5/25/1999


Use the Navigationto step back to a previousdisplay

Use the zoom button to move in and out of an area

5/25/1999

User can zoom in into any area of interest


5/25/1999

Color assignmentto meta-data can be under WIPE administrator control


5/25/1999

Interactive Raw Data Browser

5/25/1999


5/25/1999


5/25/1999

Bathymetry Contours are generated on the fly.


5/25/1999


5/25/1999

Using the: ‘Select Action|NetCDF’ option

The user can generate a custom data cube to be downloaded into his machine for further usage (AESS or user apps)

For example, the generated cube can consist of SAR at different times, bathymetry, DTED, ...


5/25/1999

WIPE USER PROFILES

A session can be saved for future access

When a session is created it can be shared with other users

5/25/1999

META-DATA QUERY RESULTS


5/25/1999

Before

After

WWW Geo-referencing of satellite data against known coastal features is easily done


5/25/1999

In WIPE the User has direct Access to the DATA!

Line Profile View

View4d


5/25/1999

Internally WIPE creates multiple resolutions for imagery data

Given a user requested resolution, WIPE uses the best internal image match


5/25/1999

An Analyst Using WIPE can Perform Ambient Noise measurements:-ship size/type-ship density estimation-heading-...


5/25/1999

Example of Hyper-Spectral or Volumetric Data Processing

5/25/1999

METADATA

ACTUAL DATA

SAMPLE WIPE SCREENS WITH ACOUSTIC DATA

5/25/1999

REAL TIME DEMO

5/25/1999

•Incorporate Additional Sensor Modalities or Data Sets on the Existing WIPE Server

•Incorporate Display Options Suggested by NAVO, e.g. Map Projections

•Use of Additional WIPE Servers, E.G. Ingest Acoustic Imagery and Related Data Aboard a Ship for Rapid Access

•Interface to NAVO’ Data-Warehouse

•Investigate use of WIPE to support generation of Dynamic STOICs

•Interface NAVO Applications With WIPE Server•Install Proview Workstations That Interface With WIPE for More Complex Processing on the Client Side

•Interface NAVO/WIPE Server(s) With Other WIPE Servers at SACLANTC, NOAA, ...

Possible Future Developments at NAVO

5/25/1999

CONCLUDING REMARKS

ACT Is Interested in Working With NAVO in Demonstrating How The WIPE Architecture Can Assist NAVO’s WSC

5/25/1999

NETWORK CENTRIC Access to REA Data

Sample Sets:•Acoustic•Bathymetry•Roughness•Salinity•Sediment•Temperature•Mine Contacts•Ship Wrecks . . .•Satellite Imagery

Access to Other User Session Profiles

Time Window of Interest

5/25/1999

Sample Region of Interest Selected

Location of Acoustic Data Collection Sites and Mines

Selected Region to Zoom (see next VG)

5/25/1999

•Interactive Access to Acoustic Data•Scroll Window Capability

5/25/1999

Sample Region of Interest Selected•Bathymetry •Mine Locations

5/25/1999

Image Below depicts: Sediment Classes (SHAPE file Format) Mine Locations


5/25/1999

Ability to Zoom Into Any Region of Interest•Data Sets are automatically Re-sampled•Overlays can be enable or disabled•Can access any layer in volumetric data sets

5/25/1999

Immediate Access to any Layer in NAVO Temperature Datasets

ROI over Spatial and Temporal Selections

•Temperature Cube (NetCDF format) and Mine Locations

5/25/1999

NETWORK CENTRIC Access to REA Data

Sample Sets:•Acoustic•Bathymetry•Roughness•Salinity•Sediment•Temperature•Mine Contacts•Ship Wrecks . . .•Satellite Imagery

Access to Other User Session Profiles

Time Window of Interest

5/25/1999

5/25/1999

Documents

NAVO’s War-Fighter Image Processing Environment (A Network Centric Image Processing System)