DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl

DFD’s Data and Information Management System

a Brief Introduction

Joint WGISS Subgroup Meetings

ICS Task Team Session

Toulouse, May 14th,2003

Bernhard Buckl DLR/DFD

[email protected]

GermanRemote Sensing Data Center

Data Information and Management SystemOverview

Production control organizes the workflow for various processing systems generating raw or value-added products.

DIMS supports the production, cataloguing, archiving, ordering and distribution of earth observation products

A cornerstone is the product library which is the source of processing inputand the destination of the processing output. It provides a complete and consistent reference of the configured products.

Based on the product library, order management handles the business process ordering throughout the system.

A unified operating tool supplies interactive monitoring and control of the DIMS components.

User information services provide the user access to DIMS. A WWW-based interface guides the user from directory information via inventory searches to the desired products which can be directly ordered.


DIMS ScopeOverall Requirements

Access to products of related systems (e.g. ENVISAT-PDS, EUMETSAT UMARF/EPS)

Flexible interfacing with processing systems(e.g. ingestion processing, processing on request)

Support of multi-mission data products

Support of complete product and order loop

Support of existing and producible products

Unified solution for distributed sites or institutions


Product and OrderManagement

Domain

ProcessingDomain

DIMS FunctionsScenarios

User ServiceDomain

User InformationServices

(incl. Pickup-Point)

www.eoweb.de

Order Management

Orders Prices

Online/Offline ProductGeneration & Delivery

Ord

eri

ng

an

d D

elivery

Product Library

Archive

Inventory

Processing SystemIngestion System

11111111

000101011011100100000000

Level 010110011

000101011011100101100100

Raw

ProductionControl

Request TreesPost-Processing

Pro

cessin

g a

nd

Arc

hiv

ing

Op

era

tin

g T

oo

l

Requests

Mon

itori

ng

an

d C

on

trol


DIMS System CharacteristicsApplication Services Overview

Product Management Order Management

Production Management

Post-Processing SystemsProcessing Systems

Product Library

Archive

Inventory

Ordering Control

Orders

Op

era

tin

g T

oo

l

Requests Production Control

Request Trees


11111111

000101011011100100000000

Level 010110011

000101011011100101100100

Raw


User Information Services

Order Accounting

Prices

UIS Loader

ISIS Interface MUIS Interface

MUIS ServersISIS Server

Web Gateway

Post-Processing


DIMS Product LibraryProduct I/O - Item Information File (IIF)

ProcessingSystem

InputIIF

Output

IIF

<IIF> <item> ... </item> <item> ... </item> ...</IIF>

Product Library

Archive

Inventory

•<administration>• Item Identifier• Item Type

•<fileInformation>• File Locations & Names

•<components>• ItemReferences to other Items

•<parameters>• Coverage Information• Processing Information• Item Status (e.g. reliability)

•<specificParameters>• Item Type Specific Metadata

•<commandOption>• Insert/Update/Register

NDVI Product

PrimaryBrowse


User Information Services - EOWEBCatalogue Search


17.05.2000 E. Mikusch

DIMS System Characteristics - Distributed Configuration

Robot Server

ServerSUN/Solaris, PC/LinuxProcessing Server

Robot Library ADIC/Grau - 300TB

Data Bases Informix, Oracle, PSEproHierarchical Storage Management LSC SAM-FS

CORBA OrbixWeb

SUN/Solaris, PC/Windows Workstations

SUN/Solaris - Enterprise 3500, 450

ProductionControl

1 Server

Processing

25 Server

Product Library

2 Server+ Robot Library

Neustrelitz

ProductionControl

1 Server

Processing

25 Server

Product Library

2 Server+ Robot Library

UserService & Ordering

4 Server

Oberpfaffenhofen

RemoteProcessing

x Systems

Remote OperatorWorkstations

Remote UserWorkstations

World

Fir

ew

all


SUN/Solaris LINUX Windows

Java Virtual Machine

DIMS System CharacteristicsBasic Architecture based on CORBA and Java

JDBCNative

Methods Swing I/O

LoggingXML

Support GUI

BusinessService Trigger Session Queue

Specific Application

• Interoperability between components• Relocatable distributed DIMS services

• Platform independent communication

• Reusable basic components used to build up an application component

• Generic components added

• Platform independent software

• Numerous Java standard components

ProcessingSystem

240300

500600

700

Post-ProcessingSystem

Requests

Operating

CORBA

OrderManagementOrders Prices

ProductionControl

Request Trees

Product Library

Archive

Inventory


DIMS Multi-Mission Support - Examples

Product Library

Archive

Inventory


11111111

000101011011100100000000

Level 010110011

000101011011100101100100

Raw



Order Management

Orders Prices

ProductionControl

Request Trees

Op

erat

ing

To

ol

RequestsPost-Processing


Product Library

Archive

Inventory


11111111

000101011011100100000000

Level 010110011

000101011011100101100100

Raw



Order Management

Orders Prices

ProductionControl

Request Trees

Op

erat

ing

To

ol

RequestsPost-Processing


DIMSWDCWDC

Ozone SAFOzone SAF

ENVISAT VAENVISAT VA

MODIS PAFMODIS PAF

TerraSAR-X PGSTerraSAR-X PGSEPS EUMETSAT Polar SystemPAF Processing and Archiving FacilityPDS Payload Data Handling SegmentSAF Satellite Application FacilityUMARF Unified Meteorological Archive and Retrieval FacilityVA Value Added

Others ...Others ...

ESAENVISAT/PDS

ESAENVISAT/PDS

EUMETSATUMARF/EPSEUMETSATUMARF/EPS

ESAMulti-Mission

ESAMulti-Mission

SRTM PAFSRTM PAF


DIMS Archive StatisticsArchive: Data Volume [TB]

0

5

10

15

20

25

30

35

1996.06 1996.12 1997.06 1997.12 1998.06 1998.12 1999.06 1999.12 2000.06 2000.12 2001.06 2001.12 2002.06

GEMOS

SRTM

XSAR_2

XSAR_1

ERS-SAR

SEASAT

MODIS

NOAA

METEOSAT

ERS-GOME

ERS-ORB

[TB]DFD-OP Archive Data Volume


Data Information and Management SystemConclusion

Further extensions which will be made in the following areas: Near real-time distribution Interactive post-processing Interface to GISs (WCS) Support of future products and interface to mission planning Adapt metadata schema to ISO 19115 (tbc)

Documents

DFDs Data and Information Management System a Brief Introduction Joint WGISS Subgroup Meetings ICS Task Team Session Toulouse, May 14th,2003 Bernhard Buckl