CEFRIEL-DEI_DellaValle-Facca_SWE-ET

SEMANTICWEBEENGINEERING-EENVIRONMENT

&TOOLS

MODEL-DRIVEN SEMANTIC WEB SERVICE APPLICATION

DEVELOPMENT

TEAMM. Brambilla, A. Carenini, I. Celino, S. Ceri,

D. Cerizza, E. Della Valle, F. M. Facca and A. Turati

IBM Almaden Research Center, San Jose, CA USA 2-11-2007IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. FaccaE. Della Valle and F.M. Facca

Emanuele Della ValleCEFRIEL – Politecnico di

Milanoemail:[email protected]

web: http://swa.cefriel.it

Federico M. FaccaPolitecnico di Milanoemail: [email protected] web: http://www.webml.org

LECTURERS

IT should be responsive to change!IT should be responsive to change!

IBM Almaden Research Center, San Jose, CA USA 2-11-2007IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. FaccaE. Della Valle and F.M. Facca 22/43/43

Today’s IT architectures, arcane as they may be, are the biggest roadblocks most companies face when making strategic moves.

--- McKinsey“Flexible IT, Better Strategy”

“It is not necessarily the strongest of the species that survives nor the most intelligent, but the one that is most responsive to change.”

--- Charles Darwin

Two roads: SOA or Web 2.0?Two roads: SOA or Web 2.0?


source: http:/ / www.w3.org/ TR/ 2002/ WD-ws-arch-20021114/

Publish

Serviceprovider

Servicerequester

DiscoveryAgencies

Service Description

Discover

Interact

Service Description

WSBPEL

SOAP ..

WSDLUDDI

SOA unique selling pointsSOA unique selling points


Rela

tive c

osts

Adoption Deployment Maintenance Changes[source ZapThink http://www.zapthink.com/]

Costs of different EAI approces

Custom IntegrationProprietary EAI solutionsWeb Services based EAI solutionsSOA based EAI solutions

… … mature integration modelmature integration model


1 2 3 4 5silos object component service SOA

Maturità del modello di integrazione

infrastructure

architecture

applications

method

IT seen from the business

Function oriented

modules

structured

Close platforms

monolitic

Function oriented

modules

Object oriented

Close platforms

a layers

Function oriented

components

Component based

Openplatforms

Component-based

Service oriented

service

Service modeling

Web Services

Client-server

Service oriented

Business Process made of services

IT process modeling

Web Services

SOA


SOA allows to open-up the silosSOA allows to open-up the silos

A common problem faced by EAI is the integration of different existing application silos.

[…]

Silos 1 Silos 2 Silos N



… by identifying common components deployed in multiple silos and …

[…]

Silos 1 Silos 2 Silos N



Silos 1

Shared Services

Outsourced Services

Provider

Customer

Silos 2

… by rationalizing the architecture.

SOA provide great plumbing!SOA provide great plumbing!


• WIKIs

• Social Tagging

• C2C e-commerce

• User Review


Web 2.0 is a collection of success Web 2.0 is a collection of success stories!stories!

• RSS

• Blogs

• Social Networks

• Pod Casting

1010//4343

Web 2.0 success factorsWeb 2.0 success factors

•Services, not packaged software•cost-effective scalability•Control over data sources

• unique, • hard-to-recreate • that get richer as

more people use them•Trusting users as co-developers•Harnessing collective intelligence•Leveraging the long tail through customer self-service•Lightweight

• user interfaces• development model• business models

IBM Almaden Research Center, San Jose, CA USA 2-11-2007IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. FaccaE. Della Valle and F.M. Facca 1111//4343

Web 2.0 provide great plumbing!Web 2.0 provide great plumbing!



Can SOA and Web 2.0 get Can SOA and Web 2.0 get combined?combined?

SOA Web 2.0

plan

design

implement

monitor

1313//4343


Similarities and differencesSimilarities and differences

Web 2.0 SOA

Software as service = Software as service

Interoperability achieved using existing Web

standards in new ways (i.e., Ajax + REST service)

=

Interoperability achieved proposing new “Web” standards (i.e., SOAP, WSDL, UDDI)

Accent on platform = Accent on platform

Encurage re-use Allow re-use

Rich and lightweight user interfaces

No user interfaces

Participation Governance

1414//4343


SOA and Web 2.0 nicely fit SOA and Web 2.0 nicely fit together!together!

Fonte: Babak Hosseinzadeh, IBM

1515//4343


Mash-up based on SOA: great Mash-up based on SOA: great plumbing!plumbing!

Mash-up SOA

1616//4343

Is pluming enough?Is pluming enough?


The problem is in the semantics! The problem is in the semantics!


to know what that format is. You have to agree on what the business objects look like. And no one has come up with a feasible way to work that out yet ...“

Oracle Chairman and CEO - Larry Ellison

"Semantic differences remain the primary roadblock to smooth application integration, one which Web Services alone won't over-come. Until someone finds a way for applications to understand each other, the effect of Web services technology will be fairly limited. When I pass customer data across in a certain format using a Web Services interface, the receiving program has

The problem is not in the plumbing, it is in the semantics ”

Verizon Chief Scientist - M . L . Brodie

The great challengeThe great challenge

The process is not trivial. For each taskthe most convenient service or data source is discovered either at design-time or at run-time. Heterogeneity in exchanged data and service behaviours is handled automatically.

IBM Almaden Research Center, San Jose, CA USA 2-11-2007IBM Almaden Research Center, San Jose, CA USA 2-11-2007E. Della Valle and F.M. FaccaE. Della Valle and F.M. Facca

1919//4343

Inte

gra

tion

Bu

sin

ess

Pro

cess

Serv

ices

Buyer

3rd Party Shipment

Mediator Mediator

LegacyMediator

Mediator Comm.Mediator

Mediator MediatorMediator

MediatorMediatorLegacyMediator

Mediator

LegacyMediator

Mediator

MediatorMediator Comm.MediatorComm.

MediatorMediatorMediator

Web as a world scale platform

[…]

[…]

[…]

Coping with complexity…Coping with complexity…


Inspired by: J. Cardoso, C. Bussler, A. Sheth, D. Fensel, Semantic Web Services and Processes, October 2002

A4A1

A4A1 A2

A1 A2

A1

B3A4 A2

A1

B3

A1

B3A1

A1A2

A1

A4

A4 A2

A1

A4A4

A2

A1

A2A2

A1

B3

A1

A1A2

A1

A1

A1B3 A1

A1

A1

A1

A4

A4

A4

A1A1

A2A1

A4

A1

A1

A1 A1

B3B3

A2A4

A1A1

A1A2

A1

A1 A2

A1 A1

A1

A1B3 A4

A1

A1

A1

A1 A1

A1

A4

B3B3

B3

B3

A1

B3

A4

B3

A1A4

A1

A4 A2A2A1 A1

A1

A1

A4

A1

A1

A1

A2

A1

A4

A1

A4

B3

A1 A1A4

A2

A4A1

A1A2

B3

A1 A2

A2

A1

A1

B3

A1

A1

A1A1

A1

A4

B3

A2

A1

A4

A1 A1 A1

A4

A1

B3

A1A2

A2

A1

A4 A2

A1

A2

A1

A1

A1

A2A1

A1A1

A1

A1 A1

A1

B3

B3

A4 A4

A1

A4A2

A1

A4

If you have few services and data source you want to support several simple mashup

But, if you have lot of services and data sources and you want to support complex business process?

A

?

C D

N1 N2 FE

B8

A1A4 A1 A2

A2

A4

B3

A1A4 A6

A2A2

A5

A4 A1 A4A1A1B3

B3

A1

A1

B3 A1

A1 A4

A4 A1A1

A4 A1 A2

A1B3

A1A4

A4

A1A2

A2

B3A2

Few services and data sources

Simple mashup

Lot of complex services and data sources

Complex Business Process

Where semantics is in SOA?Where semantics is in SOA?

In concrete situation a strong agreement on semantics is needed


?Sem

PublishPublish

Serviceprovide

r

Servicerequeste

r

Discovery

Agencies

Discovery

Agencies

DiscoverDiscover

InteractInteract

ProviderHumanRequester

Human

Provider Entity

Requester Entity

WSDWSD+

WSDWSD

+ Sem

AGREEAGREE

WSDWSD

? Sem

Could machine process semantics?Could machine process semantics?

We need some mechanism for encoding semantics in a machine processable way


Discovery

Agencies

Discovery

Agencies

PublishPublish

Serviceprovide

r

Servicerequeste

r InteractInteract


Human

Provider Entity

Requester Entity

AGREEAGREEWSD+SemSemWSDWSD

Sem

WSD+SemSemWSDWSDDiscoverDiscover

+SemSemWSDWSD

?Sem

WSD+SemSemWSDWSD

!

We may use Semantic Web We may use Semantic Web technologiestechnologiesIl Semantic Web offers ontologies ( ) to share the formal agreement among human and

machines metadata ( ) to make semantics machine processable mediators ( ) to bypass heterogeneity


Discovery

Agencies

Discovery

Agencies

PublishPublish

Serviceprovide

r

Servicerequeste

rInteractInteract


Human

Provider Entity

Requester Entity

AGREEAGREEWSD+SemWSD

Sem

WSD+SemSemWSDWSDDiscoverDiscover

+SemSemWSDWSD

?Sem

WSD+SemSemWSDWSD

METAMETA

METAMETA

METAMETA

ontologia

ontologia

METAMETAMETAMETAMETAMETA

e.g., WSMO: We.g., WSMO: Webeb S Serviceervice M Modelingodeling OOntologyntology

WSMO consists of four different main elements for describing semantic web services:

ontologies ( ) that provide the terminology used by other elements goals ( ) that define the problems that should be solved by web

services web services ( ) descriptions that define various aspects of a web

service mediators ( ) which bypass interpretability problems.


GGGGGGGG

GG

WSMO language WSMO execution

A Semantic Web Service ChallengeA Semantic Web Service Challenge


Legacy CRM System

Legacy OM System

Legacy System toRosetta PO Interface Mediator

Rosetta PO Interface toLegacy System Mediator

Customer Order Management Interface

Rosetta send Purchase Order

OrganizeShipment

Receive PO

Obtain moons internal

customer id

Create order using internal customer id

Send line item n

Close order

confirmLineItemoperation

Send POC

searchCostumer operation

createNewOrder operation

addLineItem operation

closeOrder operation

Confirm/Refuse Line Item

SearchStringCustomerObject

CustomerIdOrderId

LineObjectLineConfirmation

OrderId

ConfimationObject

PIP3A4 POAckOfReceipt

AckOfReceiptPIP3A4 POC

Customer Shipment WS

searchShipOffer operation

confirmShipOffer operation

ShipmentObjectShipmentOffer

ShipmentOfferIdConfirmation

BLUE MOON

Discovery Eng.

achieveGoal operation

GoalGoalCompliantWS

Send Goal

WS Offer Invoker

WS Purchase Invoker

Shipment Web Services

Rosetta send Purchase Order

reciveShipment

confirmation

http

://s

ws-

chal

len

ge.o

rg

sponsored by

organized by

Me

dia

tio

nD

isco

ve

ry


State-of-the-art and SWE-ET innovationState-of-the-art and SWE-ET innovation

Semantic Web Services (SWS) have a great potentialeasy web service discoveryautomatic web service integrationeasy interoperability…

Till now SWS are rarely used in practiceannotations are an extra cost

Software Engineering (SE) tools and methodologies can push the use of SWSmodel driven development techniques can be improved to

include annotation and generate Semantic Web ServicesSWE-ET key innovations are a SE approach in developing SWS applicationa comprehensive set of toolsautomatic generation of semantic annotationsintegration of Semantic Web Service Discovery


The SWE-ET approachThe SWE-ET approach

Business Process Modeling Software (Web) engineering

http://www.bpmn.org/

BPMN

http://www.webml.org/

Semantic Web Services

SWE-ET

http://www.wsmo.org/

Semantic Web (services) Engineering Environment and Tool

GLUEWSMO Discovery Engine

http://glue.cefrie.it

WebML and WebRatio at workWebML and WebRatio at work

IBM Almaden Research Center, San Jose, CA USA 2-11-2007IBM Almaden Research Center, San Jose, CA USA 2-11-2007 2828//4343

E. Della Valle and F.M. FaccaE. Della Valle and F.M. Facca

GLUE as discovery engineGLUE as discovery engine

GLUEis a WSMO compliant discovery engine

it aims at developing an efficient system for the manage-ment of Semantic Web Services and their discovery

adopts a mediator centric approachProvider and requester don’t have necessarily to

agree on using the same set ontologies in describing their goals and Web Services,

But, they only have to agree in using compatible ontologies and in coding how to bypass heterogeneity using mediators:

ggMediators are used for goal refinementwgMediators are used for discovery



c2

a

ggMediator(goal refinement)

wgMediator(discovery)

c5c1 c2 c3 c4

a b bb c2

RE

QU

ES

TE

R

PR

OV

IDE

RS

SWE-ET: Extended WebML SWE-ET: Extended WebML frameworkframework


SWSWebMLS

eman

tic Web S

ervice

Ap

plicatio

n


The SWE-ET development process The SWE-ET development process

We adopt a development process in line with the classic Boehm’s Spiral model extended with semantic importing and annotation.


Data Design

Presentation Design

Hypertext / Service Design

Ontology Importing

Semantic Annotation

Business Requirements

Requirements Specification

Architecture Design

ImplementationTesting and Evaluation

Maintenance and Evolution

Business process modeling

Reuse of existingontological data source

Specialized units foradvanced queries over semantic data and annotation extraction

Model-Driven SWS application Model-Driven SWS application developmentdevelopmentThe result is a top-down approach to the development of applications employing Semantic Web Services, that combines semantic methods and tools with Software Engineering ones.


WSMLGoal

WSML WSChoreography

WSMLWS Capability

WSMLOntology

Ontology importing and/or semantic annotation

Automaticcodegeneration

Businessprocessmodeling

WF-drivenWebMLgenerator

Webapplicationmodeling

BPMNmodel

WebMLskeleton

Runningapplication

WebMLdatamodel

WebMLhypertextmodel

WSMLOntologyGenerator

WSMLWS CapabiltyGenerator

WSMLWS Chor.Generator

WSMLGoal Cap.Generator

the discovery scenariothe discovery scenario

Problem statement: find the best shipment service keeping into account:• pick up location and time (espressed in accordance with timezone), • destination and expected delivery date-time,• price (expressed in $, €, ect.), • weigth and dimension (also expressed in different units)

29 Novembre 2006, La dimensione semantica dell’IT, Roma29 Novembre 2006, La dimensione semantica dell’IT, Roma Author: E. Della Valle - SWA © CEFRIEL-Author: E. Della Valle - SWA © CEFRIEL-DEIDEI

3333//4343

Read out more: http://sws-challenge.org/wiki/index.php/Scenario:_Shipment_Discovery

Dis

cov

ery


SWE-ET at workSWE-ET at work

BPMN modelingBPMN modeling

We used the WebML Business Process Modeling tool to model the discovery process that was informally described by the SWS challenge organizers



Design of the Data Model in WebMLDesign of the Data Model in WebML

We model the shipment ontology in WebML using its extended Entity-Relationship and constraint language.

ShipmentService where ShipmentService.shipTo

not in ShipmentService.locatedIn

Self TO Europe where Self.locatedIn isa Europe



Extraction of the OntologiesExtraction of the Ontologies

The expressivity of WebML is close to WSML-Flight This makes converting WebML data models in WSML Flight easy.

concept EuropeanShipmentService subConceptOf InternationalShipmentService

nfp dc#relation hasValue { EuShipmentServiceDef } endnfpaxiom EuShipmentServiceDef definedBy ?x memberOf InternationlShipmentService

and hasLocation(?x,?nation) and ?nation memberOf Europe implies ?x memberOf EuropeanShipmentService.

InternationalShipmentService(as SuperEntity) where

InternationalShipmentService.hasLocation isa Europe

Once the business process is designed, workflow constraints are turned into navigation constraints among the hypertext activities pages and into data queries on the workflow metadata for checking the status of the process. This applies both to the human-consumed pieces of contents (i.e., site interfaces)

andto the machine-consumed contents (i.e., Services

interactions).



Design of User and Service InterfacesDesign of User and Service Interfaces

29 Novembre 2006, La dimensione semantica dell’IT, Roma29 Novembre 2006, La dimensione semantica dell’IT, Roma Author: E. Della Valle - SWA © CEFRIEL-Author: E. Della Valle - SWA © CEFRIEL-DEIDEI

3838//4343

Semantics coded in the Discovery Semantics coded in the Discovery EngineEngineSOA Aspects

Goal come proposto in WSMOWeb Service come proposto in WSMOWebService-to-Goal-Mediator in cui sono codificate le regole di

matching Temporal Aspects

concept dateAndTime subConceptOf instantdate ofType (1 1) date

time ofType (1 1) time

axiom beforeDateAndTime definedBy

before(?x,?y) :-?x[date hasValue ?xd, time hasValue ?xt] memberOf dateAndTime and

?y[date hasValue ?yd, time hasValue ?yt] memberOf dateAndTime and

(before(?xd,?yd) or (equal(?xd,?yd) and before(?xt,?yt))).Geographical Aspects

concept location

concept worldwide subConceptOf location

concept europe subConceptOf worldwide

axiom check ContainmentOf PickupLocation definedBy

satisfied(?request, ?provider) :-

?request[pickupLocation hasValue ?x] and ?provider[pickupLocations hasValue ?y] and

(?x = ?y or ?x subConceptOf ?y).

DEMO: Glue at workDEMO: Glue at work




Try it! http://webml.org/sws-challenge.html

Awards related to SWE-ETAwards related to SWE-ET


Legacy CRM System

Legacy OM System

Legacy System toRosetta PO Interface Mediator

Rosetta PO Interface toLegacy System Mediator

Customer Order Management Interface

Rosetta Purchase Order

Interface

OrganizeShipment Interface

Receive PO

Obtain moons internal

customer id

Create order using internal customer id

Send line item n

Close order

confirmLineItemoperation

Send POC

searchCostumer operation

createNewOrder operation

addLineItem operation

closeOrder operation

Confirm/Refuse Line Item

SearchStringCustomerObject

CustomerIdOrderId

LineObjectLineConfirmation

OrderId

ConfimationObject

PIP3A4 POAckOfReceipt

AckOfReceiptPIP3A4 POC

Customer Shipment WS

searchShipOffer operation

confirmShipOffer operation

ShipmentObjectShipmentOffer

ShipmentOfferIdConfirmation

BLUE

MOON

Discovery Eng.

achieveGoal operation

GoalGoalCompliantWS

Send Goal

WS Offer Invoker

WS Purchase Invoker

Shipment Web Services

Links: http://sws-challenge.org/wiki/index.php/Workshop_Budva#Evaluation http://www-304.ibm.com/jct09002c/university/scholars/it/faculty_awards.html


http://www.webml.org http://www.webratio.com

http://glue.cefrie.it

The most complete solution of

F

aculty Award 2006


ConclusionsConclusions A comprehensive method and toolA comprehensive method and toolSWE-ET is an approach for designing Semantic Web applications by exploiting software engineering techniques.

It offers a complete method for the semi-automatic extraction of WSMO elements by using existing software engineering abstractions. It supports the extraction ofWSML Flight Ontologies from the WebML data model and

their registration as shared resources in WSMX.WSMO Web Services functional capabilities for

each Web Service modelled in WebML; non-functional capabilities should be added manually.

WSMO Web Services Choreography interfaces by combining information in the Business Process Model and in the WebML hypertext model.

WSMO goals (e.g., goals that triggers the Glue discovery engine) by gathering data required to perform a given action of the business process


ConclusionsConclusions Future WorkFuture Work

With the current implementation of SWE-ET we provide a comprehensive methodology and a self-contained design approach for Semantic Web Service applications, but it lacks importing facilities for WSMO elements.

In order to overcome such limitation our next steps are providing the possibility of importing ontologies,

services and mediators descriptions, defining a set of new WebML primitives for

querying ontological information, incorporating WSMO elements as “first-class

citizens” in the design process, lifting them up in the artifacts design hierarchy, so as to further improve and simplify the design of native WSMO elements.

Thank you for paying attention.Thank you for paying attention.


Any QuestionAny Question??

4343//4343

Technology

CEFRIEL-DEI_DellaValle-Facca_SWE-ET