1 1 Observatory Middleware Framework (OMF): Enterprise Service Bus for Environmental Observatories Duane R Edgington MBARI (Monterey Bay Aquarium Research

11 11

Observatory Middleware Framework (OMF): Enterprise Service Bus for

Environmental Observatories

Observatory Middleware Framework (OMF): Enterprise Service Bus for

Environmental Observatories

Duane R Edgington MBARI (Monterey Bay Aquarium Research

Institute)Moss Landing, California, USA

Duane R Edgington MBARI (Monterey Bay Aquarium Research

Institute)Moss Landing, California, USA

INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009

[email protected]

ContributorsContributors

• Randal Butler

• Terry Fleury

• Von Welch

• Duane Edgington

• Kevin Gomes

• John Graybeal

• Bob Herlien

• Scripps Institution of Oceanography (Scripps)

• Randal Butler

• Terry Fleury

• Von Welch

• Duane Edgington

• Kevin Gomes

• John Graybeal

• Bob Herlien

• Scripps Institution of Oceanography (Scripps)

22

Observatory Middleware Framework (OMF): Enterprise Service Bus for Environmental

Observatories

Observatory Middleware Framework (OMF): Enterprise Service Bus for Environmental

Observatories

INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009

33

Agenda todayAgenda today

Demonstrate a USA activity to prototype cyberinfrastructure (CI) in support of

earth observatories

Demonstrate a USA activity to prototype cyberinfrastructure (CI) in support of

earth observatories

INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009

Ocean Observatories Initiative Ocean Observatories Initiative USA National Science Foundation • next- generation, decadal-scale

program. 10 year, 330M$ US • observing and interacting with the

oceans. The Initiative has four basic elements • Regional: cluster of experimental

sites • Global: widely spaced, deep-

ocean, full-ocean water-column moorings,

• Coastal: focused on the variable, steep gradients of the near-shore

• Cyberinfrastructure: an integrative data management system.

USA National Science Foundation • next- generation, decadal-scale

program. 10 year, 330M$ US • observing and interacting with the

oceans. The Initiative has four basic elements • Regional: cluster of experimental

sites • Global: widely spaced, deep-

ocean, full-ocean water-column moorings,

• Coastal: focused on the variable, steep gradients of the near-shore

• Cyberinfrastructure: an integrative data management system.

44INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009INGRID 2009, Alghero, Sardinia, Italy April 1-3, 2009

55

Ocean Observing Initiative CyberInfrastructureOcean Observing Initiative CyberInfrastructure– Start with experiences and systems developed for

single ocean observatories (isolated Moored or Cabled to shore).

– Designing for:• Collaborative, web access• Utilizing Service Oriented Architecture• Incorporating Enterprise Service Bus technology• Grid enabled

– Requirements:• Multiple, diverse platforms (cabled to shore, moored surface

expressions, solar powered, diesel powered, associated autonomous mobile platforms)

• Wide geographic distribution• Thousands of instruments• Distributed data• Interactive control• (near) real-time data acquisition• Event response

– Start with experiences and systems developed for single ocean observatories (isolated Moored or Cabled to shore).

– Designing for:• Collaborative, web access• Utilizing Service Oriented Architecture• Incorporating Enterprise Service Bus technology• Grid enabled

– Requirements:• Multiple, diverse platforms (cabled to shore, moored surface

expressions, solar powered, diesel powered, associated autonomous mobile platforms)

• Wide geographic distribution• Thousands of instruments• Distributed data• Interactive control• (near) real-time data acquisition• Event response


Regional Scale NodeRegional Scale Node

The Regional Scale Nodes will enable new approaches to studies of Ocean and Earth processes that, for example:

• regulate global climate • store anthropogenic carbon • form many mineral deposits • support major fish stocks • govern rainfall patterns on land • threaten coastlines with storms, tsunamis,

harmful algal blooms, and oxygen depletion

• deliver sediment and pollutants from land to the oceans

• create and recycle Earth’s crust, and • harbor novel microbial life forms within

subseafloor volcanic environments.

The Regional Scale Nodes will enable new approaches to studies of Ocean and Earth processes that, for example:

• regulate global climate • store anthropogenic carbon • form many mineral deposits • support major fish stocks • govern rainfall patterns on land • threaten coastlines with storms, tsunamis,

harmful algal blooms, and oxygen depletion

• deliver sediment and pollutants from land to the oceans

• create and recycle Earth’s crust, and • harbor novel microbial life forms within

subseafloor volcanic environments.


Global and Coastal nodesGlobal and Coastal nodes


88

• Facilitating direct & immediate interaction with Ocean

• Connecting & coordinating operations between Observatories and with Science & Education

• Providing scientists with the capability to observe and respond to emergent conditions in the ocean

• Facilitating direct & immediate interaction with Ocean

• Connecting & coordinating operations between Observatories and with Science & Education

• Providing scientists with the capability to observe and respond to emergent conditions in the ocean


99

OOI CI Scenarios (Use Cases)OOI CI Scenarios (Use Cases)• The project's architecture will be configured for

certain basic scenarios, including:– Monitor and control a single observatory, or multiple

observatories; – Detect and respond to an event; – Fuse data from an observatory with a pre-existing

ocean model; – Design field experiments; – Create 'virtual' observatories by combining

components distributed among multiple physical observatories.

• The project's architecture will be configured for certain basic scenarios, including:– Monitor and control a single observatory, or multiple

observatories; – Detect and respond to an event; – Fuse data from an observatory with a pre-existing

ocean model; – Design field experiments; – Create 'virtual' observatories by combining

components distributed among multiple physical observatories.


1010

OOI CI Architecture FeaturesOOI CI Architecture Features• Leverage the integrative principles of modern,

service-oriented computer architecture• Adopt Enterprise Service Bus, to integrate

sensors, storage, scientific laboratories and computing

• Enable Grid Computing to integrate data with advanced ocean models and visualization

• Reuse the same software over many scales -- coastal, regional and global

• Leverage the integrative principles of modern, service-oriented computer architecture

• Adopt Enterprise Service Bus, to integrate sensors, storage, scientific laboratories and computing

• Enable Grid Computing to integrate data with advanced ocean models and visualization

• Reuse the same software over many scales -- coastal, regional and global


1111

Ocean Observatory SchematicOcean Observatory Schematic

TeraGrid

Open Science Grid


Observatory Middleware Framework (OMF)

Observatory Middleware Framework (OMF)

Researching alternative approaches extend beyond a single physical observatory support multi-domain research integrate existing sensor and instrument

networks with a common instrument proxy support a set of security (authentication and

authorization) capabilities critical for community-owned observatories

Researching alternative approaches extend beyond a single physical observatory support multi-domain research integrate existing sensor and instrument

networks with a common instrument proxy support a set of security (authentication and

authorization) capabilities critical for community-owned observatories


OMF SchematicOMF Schematic


1414

Example of a single cabled to shore observatory:Monterey Accelerated Research System (MARS)Example of a single cabled to shore observatory:Monterey Accelerated Research System (MARS)


1515

Example of Moored Observatory:Monterey Ocean Observing System Example of Moored Observatory:Monterey Ocean Observing System

• Surface expression with meteorological instruments and power generator

• Cable to sub-surface instruments (temperature, currents, bio-optical, etc.)

• Vertical profiler on cable• Benthic node with

extension cables to instruments on bottom

• Surface expression with meteorological instruments and power generator

• Cable to sub-surface instruments (temperature, currents, bio-optical, etc.)

• Vertical profiler on cable• Benthic node with

extension cables to instruments on bottom

Benthic network

Optical/power cable

Instrument node


ROADnet sensor mapROADnet sensor map


1717

• Enterprise Service Bus (ESB)– Addresses requirements for Cross-Cutting

Functions (security, policy enforcement)– Connects Multiple Platforms

• Enterprise Service Bus (ESB)– Addresses requirements for Cross-Cutting

Functions (security, policy enforcement)– Connects Multiple Platforms

Enterprise Service Bus (ESB)Enterprise Service Bus (ESB)

• OMF Prototype– Focus on high risk elements (e.g. applying

policy on ESB, common instrument interface, common network interface)

• OMF Prototype– Focus on high risk elements (e.g. applying

policy on ESB, common instrument interface, common network interface)


Enterprise Service BusEnterprise Service Bus


OMFOMF

1919

Security

Hydrophone


Focus on high risk elements (e.g. applying security & policy on ESB, common instrument interface,

common network interface

Use caseUse case


oIP Instrument ProxyoTranslates OGC SPS <-> local protocol

oSP Security ProxyoVerifies incoming messagesoSigns outgoing messages

oAuthorization Service UnitoValidates incoming messagesoAuthorizes messagesoSigns messages

OGC SPS

OGC SPSNative/Legacy

DemonstrationDemonstration


1. A researcher uses a web portal to send a request to remotely modify the data collection process from a specific instrument in the offshore instrument network.

1. A researcher uses a web portal to send a request to remotely modify the data collection process from a specific instrument in the offshore instrument network.


OGC SPS


2. The Security Proxy signs the outgoing modification request and passes it through to the Enterprise Service Bus (ESB) via the Message Broker.

2. The Security Proxy signs the outgoing modification request and passes it through to the Enterprise Service Bus (ESB) via the Message Broker.


OGC SPS


3. ActiveMQ, serving as a Message Broker, delivers the message to the Enterprise Service Bus

3. ActiveMQ, serving as a Message Broker, delivers the message to the Enterprise Service Bus


OGC SPS


4. The Authorization Service Unit verifies the message signature, applies policy, authorizes the message, and resigns it with its own key. The Enterprise Service Bus then routes the message to its intended destination, in this case, the networked instrument.

4. The Authorization Service Unit verifies the message signature, applies policy, authorizes the message, and resigns it with its own key. The Enterprise Service Bus then routes the message to its intended destination, in this case, the networked instrument.


OGC SPS


5. ActiveMQ, serving as a Message Broker, delivers the message to the networked instrument.

5. ActiveMQ, serving as a Message Broker, delivers the message to the networked instrument.


OGC SPS


6. The Security Proxy verifies incoming messages to ensure that the Authorization Service Unit in the Enterprise Service Bus has processed them.

6. The Security Proxy verifies incoming messages to ensure that the Authorization Service Unit in the Enterprise Service Bus has processed them.


OGC SPS


7. The Instrument Proxy converts the message (as needed) to the syntax and commands specific to the instrument for which it is intended.

7. The Instrument Proxy converts the message (as needed) to the syntax and commands specific to the instrument for which it is intended.


OGC SPS


8. After reaching the deployed instrument network, the message is relayed to the intended instrument.

8. After reaching the deployed instrument network, the message is relayed to the intended instrument.


OGC SPS


9. The instrument then sends a confirmation or other response, which is returned to the researcher via the same logical route as used by the original request. The message destination has a unique identity in OMF, as encoded in the original request and authenticated by the Security Proxy.

9. The instrument then sends a confirmation or other response, which is returned to the researcher via the same logical route as used by the original request. The message destination has a unique identity in OMF, as encoded in the original request and authenticated by the Security Proxy.


OGC SPS


10. The response is returned to the researcher by the web portal. Additional diagnostic information, accumulated as the communication passes through the OMF and instrument network, is also made available to the user and system operators as appropriate given their respective authorizations.

10. The response is returned to the researcher by the web portal. Additional diagnostic information, accumulated as the communication passes through the OMF and instrument network, is also made available to the user and system operators as appropriate given their respective authorizations.


OGC SPS


What is new about all of this?What is new about all of this?

• Support of multiple instrument interfaces through Instrument Proxy

• End-to-end standard security mechanism

• Implement message-based-system through off-the-shelf Enterprise Service Bus

• Support highly distributed system though Federated Enterprise Service Bus

• Support of multiple instrument interfaces through Instrument Proxy

• End-to-end standard security mechanism

• Implement message-based-system through off-the-shelf Enterprise Service Bus

• Support highly distributed system though Federated Enterprise Service Bus


3333

Partners in the OOI Cyberinfrastructure project includeOMF PartnersPartners in the OOI Cyberinfrastructure project includeOMF Partners

• Univ California San Diego o Scripps Institution of Oceanographyo Calif Inst for Telecommunications and Information Tech (CalIt2)o San Diego Supercomputer Centero National Center for Microscopy and Imaging Research Academic Partnerso NASA Jet Propulsion Laboratoryo Massachusetts Inst of Tech, Center for Ocean Engineeringo Monterey Bay Aquarium Research Instituteo North Carolina State University, Dept. Computer Scienceo Rutgers University, Coastal Ocean Observatory Labo University of Chicago, Globus (Ian Foster)o Univ Southen California, Information Sciences Instituteo Univ Illinois UC, National Center for Supercomputing Applicationso Woods Hole Oceanographic Institution Corporate Partnerso Raytheono Triad Project Management

• Univ California San Diego o Scripps Institution of Oceanographyo Calif Inst for Telecommunications and Information Tech (CalIt2)o San Diego Supercomputer Centero National Center for Microscopy and Imaging Research Academic Partnerso NASA Jet Propulsion Laboratoryo Massachusetts Inst of Tech, Center for Ocean Engineeringo Monterey Bay Aquarium Research Instituteo North Carolina State University, Dept. Computer Scienceo Rutgers University, Coastal Ocean Observatory Labo University of Chicago, Globus (Ian Foster)o Univ Southen California, Information Sciences Instituteo Univ Illinois UC, National Center for Supercomputing Applicationso Woods Hole Oceanographic Institution Corporate Partnerso Raytheono Triad Project Management


3434

Questions?Questions?


Documents

1 1 Observatory Middleware Framework (OMF): Enterprise Service Bus for Environmental Observatories Duane R Edgington MBARI (Monterey Bay Aquarium Research