1 1 ECHO Extended Services WGISS – 23 Hanoi, Vietnam May 15, 2007

11

ECHO Extended Services

WGISS – 23Hanoi, VietnamMay 15, 2007

2

Agenda

ECHO StatusReview of Extended ServicesPolicy and GovernanceECHO’s Service Domain ModelHow to…

3

ECHO Status and Activities

Release HighlightsPerformance StatusCurrent ParticipationUpcoming HighlightsGCMD Interoperability

4

What is ECHO?

SOA-based middleware for the exchange of Earth Observation resources

• Based on Web Service Technologies• Focused on Interoperability

Two types of registries• Data Registry

• Published metadata representing data holdings– Datasets (directory-level)– Granules (inventory-level)

• Data model is comprehensive, yet extensible• Service Registry

• Standards-based• Multiple service types• Flexible Categorization

ECHO’s services that support the interaction with those registries:

• Publication• Discovery• Understanding • Access

5

ECHO Status - Version 9

Version 9 went operational on April 25, 2007Key Capabilities• Improved Catalog Searching

• Performance• Case Sensitive Searches

• Improved Order Options• SSL communication• Streamlined API for providers• New Order Options framework

• Improved Reconciliation Capabilities• Improved error handling • Eventing for Services• Web-based PUMP tool

6

ECHO Status - Performance

ECHO performance improvement activities focused on Queries, Presenting Results, and OrderingOverall significant performance improvement:• Version 9 is 91% faster than ECHO Version 8

ECHO 8.0 ECHO 9.0

1 Dataset, Spatial1, and Temporal2 108 11

1 Dataset, Spatial3, and Temporal4 480 41

>10 Datasets, Spatial1, and Temporal2 690 60

Spatial1 and Temporal2 2760 180

1 Dataset and OnlineOnly 130 8

Dataset(s), Spatial1, Temporal2, and OnlineOnly

46 10

1 Dataset, Spatial1, Temporal2, and DayNightFlag

46 121. 10o x 10o

2. 1 month3. 25o x 75o

4. 10 months

7

ECHO Status - Current Participations

Current Holdings • Collections 2,082• Granules 56 million • Browse 19 million

Data Partners• Operational Public 10 • Test 1 (PO DAAC)• Proposed 2 (USGS, OCDPS)

Landsat incorporation in process

Availability beginning by end of 2007

Client Partners• Operational 1• In evaluation or test 9• Active development 3• Planning/requirements 3

8

ECHO Status - ECHO 10

Target Operational Q1 2008Ingest Updates• Improved Operability• Improved Reconciliation• Updated data rules for data integrity• Increase reliability and maintainability

Security improvementsMigrate existing ECS User accounts to ECHOAlpha Testbed available http://testbed.echo.nasa.gov/echo/

9

ECHO Policy – Participation

Data Providers• ECHO works to specific Data Success Criteria, as part of the EOSDIS

Evolution implementation effort 2005-2008.• Support metadata and browse for all EOS data products and other

identified data held by NASA DAAC and Data Centers or the USGS Long-term Archive.

• Transition existing EDG partners to ECHO, including interested international partners

Clients• ECHO has an open policy for clients; anyone can create an ECHO client• ECHO is identifying science communities who could benefit from ECHO’s

capabilities and resources (e.g. metadata and services)• ACCESS 2006 solicitation for ECHO clients• OPeNDAP community• Proposed TERRA data fusion client

Extended Services• ECHO is also looking to find extended services that could be applied to the

data represented in ECHO and would benefit the science community• ESDS’ Tech Infusion WG has been adding services to ECHO• LP DAAC has identified services that they would like to offer in ECHO for the land

community• Proposed TERRA data fusion client will add data fusion services to ECHO• CEOS presentation to solicit services participation

10

GCMD Interoperability

GCMD and ECHO provide complementary capabilities to enable Earth science research• GCMD enables users to locate a broad spectrum of Earth

science datasets and services relevant to global change and Earth science research. •GCMD holds over 21,000 metadata records.

• ECHO enables users to search and access NASA’s granule-level Earth science data and related services through tailored interfaces. •ECHO has over 2,000 datasets and 56 million granules.

GCMD and ECHO interoperate to provide a cohesive perspective of NASA’s Earth science data holdings

11

ECHO Extended Services - Overview

12

Extended Services Background

What are “Extended Services”• “Services” - functional capabilities offered by the community• “Extended” – because they are not native to ECHO• Published to the ECHO Registry

Functional Summary – What does ECHO do with them?• Register – Service Providers register the services• Activate – ECHO operations review and activate them.• Find – Users find the services using the UDDI inquiry API or

Extended Services Viewer• Retrieve – Users can get the services to view their details• Update – Service Providers can update their services• Delete – Service Providers can remove their services

13

Extended Services Capabilities

Full CRUD for Extended Service Entities• Create• Read• Update• Delete

Allow for combined Service Interface/Implementation WSDL• Single registration sequence

Initial brokering of services• Invocation Service

14

Extended Services Capabilities (con’d)

Event Management• Publication of events for changes in the registry

•Examples: New Service Interface, Service Deleted, Service Updated, etc.

• Ability to subscribe to those events• Notification upon event occurrence

Event Summary• New Dataset• Updated Dataset• Deleted Dataset• New Service• Updated Service• Deleted Service

Based on WS-Eventing & -Notification

15

Policy and Governance

Policy drives how an organization uses the tools available to them.• To protect the organization’s interests

ECHO is a partnership between NASA and ECHO participantsNASA has the responsibility to ensure that what it publicly represents is legitimate and appropriateECHO policy practices• Registered partners may publish

•Form sent to ECHO Operations team•NASA approval

• Two-phased Publication•Registration & Activation

16

Registration & Activation Pattern

Submit RegistryEntry

Validate SubmissionFormat

Partner ECHO Kernel ECHO Operations UDDI Registry

is valid?Exception sent<synchronously>

no

yes

Notify operations ofnew registry entry

Review Submission

meets policyguidelines?

no

yes

Notify partner ofregistration issue

Entry Activated<email>

Delete Entry

Registration Issue<email>

new registry entry notification

<email>

Activate Entry

Notify partner ofActivation

Make EntryVisible

17

ECHO’S Service Domain Model

Provider

18

Extended Services Entity:Web Service Interface

Defines a web service APIDefined in a WSDL fileHosted within ECHO system• Centrally managed interfaces

encourages standardization and reuse within community

Reusable between provider organizationsExample:• Common Subsetting interface• Common Access service

interface (OPeNDAP)• WMS service

ProviderProvider

19

ProviderProvider

Extended Services Entity:Web Service Implementation

An executable web service hosted by an ECHO Service ProviderDefined in a WSDL file• Contains at least one service

elementMay implement interfaces registered in ECHO• By importing interface WSDL

from ECHO hosted locationExamples:• An application-specific

service (OPeNDAP Query adaptor)

• A predictive model• Specific WMS server

20

ProviderProvider

Extended Services Entity:Web Service GUI

A user interface for a web serviceProvides a way for human to interact with a web serviceIncludes name, description, and access pointAssociated with implementations and interfaces registered in ECHOExamples:• ECHO Query Client• Domain Specific User Client

for subsetting

21

ProviderProvider

Extended Services Entity:Advertisement

A way to advertise a service that is not a real Web ServiceIncludes name and description of service and an access pointExample• Service for expert advice on

a specific application area• Ability to drop sensors in the

Chesapeake Bay

22

Categorization and Classification

Natural technique for understanding and remembering items and their relationship to other items

Categorization• Process of creating categories or types

Classification• Process of assigning objects within categories

Example:• Animal and Plant kingdoms• Businesses in a phone book

23

Taxonomies

A way of classifying extended service entities in ECHO.Have a tree like structure.• Root of the tree is the

taxonomy.• Leaves and nodes on the

tree are taxonomy entriesA taxonomy entry is a name and value pair.• Values are unique in a

taxonomy.

24

Virtual Taxonomies

This is a type of taxonomy (categorization scheme) that is populated by ECHO automatically. Example: As new data providers and their datasets are registered, they are added to the taxonomies (as appropriate)They behave and look to the user like a regular static taxonomy.

25

Existing Taxonomies in ECHO

nasa-ECHO:Dataset • Is a virtual taxonomy • Datasets are automatically added to the taxonomy

when they are ingested into ECHO• Used to classify services according to the primary type

of input data (the data that is primarily operated upon)Contains each provider and Collections for that provider

26


nasa-ECHO:ServiceType – This is a categorization scheme of kinds of services from a functional perspective. It is comprised of other taxonomies defined by external organizations.

Currently contains:ISO 19119 (OGC)• Specific OGC subgroups

OPeNDAP

27


nasa-ECHO:DataFormat – This is a categorization scheme based on the format of Earth Science data. It is similar to a mime-type classification scheme.

Currently containsComplexGraphical

28

Classification within ECHO

Service Partners classify their service offerings• Upon Publication• Updates as needed

Classification is not required• But very useful

Multiplicity• Classify to zero or more

Taxonomies• Classify to zero or more nodes

within a Taxonomy

ProviderProvider

29

How To…

What is available to use ECHO Extended Services• APIs• Documentation• Tools

Extended Services Scenarios• Register as a Service Provider• Publish a Web Service Interface• Publish a Web Service Implementation• Publish a Web Service GUI• Publish an Advertisement• Classify an offering• Update an offering• Delete an offering

30

Using Extended Services

API’s available for all capabilities• Operational System• http://www.echo.nasa.gov/reference/reference.sht

mlExtended Services Registry Tool (ESRT)• GUI for all management functions (CRUD)• http://www.echo.nasa.gov/services/service_tools.sht

ml

Extended Services Viewer• Navigation tool to discover services• Operational System• http://api.echo.nasa.gov/echo-esviewer/

31

ECHO Tools – Extended Services Registry Tool (ESRT)

Tool for Service PartnersRegistrationPublishing Services• Any type• Classification

Manage OrganizationalcontactsFull CRUD

32

ECHO Tools – Extended Services Viewer

Discovery and Navigation Tool for Services RegistryEach Categorization Scheme represented by a treeDetails of selected node presented in the right-hand panel

33

Create an ECHO User Account

Logon as “guest”, with your email address as a password.Once logged on, select the “User” Task Group

34


35


36


37

Register as a Service Provider

Goal• As an organization,

offer your capabilities to the broader EO community

Prerequisites• Register as a User• Login as User

Once logged in to ECHO using the ESRT, Select the “Provider“ Task Group. Then select “Create Provider”

38


39


40


41


Describe your offerings in the “Descriptions” panelIn the “Additional Information” text area, provide the ECHO user account name that you would like associated with this provider or contact ECHO Ops @ [email protected] to have them associate your ECHO user account with the ECHO Service Provider.

42


At this point your organization has been registered, but not activated. ECHO Operations has been notified of your registration and will review the application. Once they approve your application, you will be notified via email sent to the email address you supplied above.

43


Once you are notified that your ECHO user account is associated with an ECHO Service Provider you can begin to register your Extended Service.The next time you login, you enter your provider ID in the “On behalf of provider” field.

44

Publish an Extended Service

Under the “Task Groups” for Extended Services you must register your Interface, Implementation, GUI or Advertisement service.

ECHO Ops will then review your registration and notify you of your status.

45

Publish a Web Service Interface

Goal• Offer a standard

interface which can be used by multiple organizations.

Prerequisites• Be a registered User• Your organization is a

Registered Service Provider

• Login, with your provider context set to a Registered Service Provider

• Have the Web Service Interface defined in a .wsdl file

46

Publish a Web Service Implementation(using a Web Service Interface)

Goal• Offer a Service for

access by the community




• Have the Web Service Implementation defined in a .wsdl file

• Reference a published Web Service Interface

47

Publish a Web Service GUI

Goal• Offer a GUI which provides

a human interface to a published Web Service, for access by the community


Registered Service Provider• Login, with your provider

context set to a Registered Service Provider

• Reference a published Web Service Interface or specific Web Service Implementation

48

Publish an Advertisement

Goal• Offer a

capability which is not a Web Service, to the EO community

Prerequisites• Be a registered

User• Your

organization is a Registered Service Provider


49

Classify an Offering

Goal• Enable better

discovery by classifying your offering in one or more taxonomies

• Can be done in registration, or by updating




• A registered service offering has been (or is being) published

50

Update an Offering

Goal• Change the information

representing a published service offering





• Have the GUID of the service to be updated

51

Delete an Offering

Goal• Remove a published

service offeringPrerequisites• Be a registered User• Your organization is

a Registered Service Provider



NOTE:ECHO will “take

ownership” of an interface which has dependent implementations and/or GUIs.

52

Contacts

http://www.echo.nasa.gov/

ECHO Operations team• [email protected]

NASA ECHO Operations Lead• Andy Mitchell• [email protected]

Me• Michael Burnett• [email protected]

53

Backup Slides

54

Submit search criteria to WIST

Use Portal to select metadataGCMD

Search GCMDfor datasets

ECHO

GCMD and ECHO: Users

Or search WIST for granule-level metadata

Display Results

WIST

GCMD’s ECHO Portal1 2

34

5

6

Query ECHO

7

Click “Get Data” link

55

GCMD and ECHO: Data Providers

Documents

1 1 ECHO Extended Services WGISS – 23 Hanoi, Vietnam May 15, 2007