52
Colombo Architecture Meetup Enterprise Integration Architectural Challenges in Large Enterprises By Crishantha Nanayakkara Head of Technology, ICTA

Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

Embed Size (px)

Citation preview

Page 1: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

Colombo Architecture Meetup

Enterprise Integration ArchitecturalChallenges in Large Enterprises

By Crishantha NanayakkaraHead of Technology, ICTA

Page 2: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

Vs

Page 3: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

3

Enterprise Enterprise Application Application IntegrationIntegration

Page 4: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

4

The Information Silos

Systems that are not connected

Drawbacks:● Isolated without insufficient communication to the rest of the world

Page 5: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

5

The Enterprise Integration

Benefits:● Provides a way to connect each other

Drawbacks:● Extremely “Spaghetti” like architecture, create headaches

Page 6: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

The Enterprise Integration

Page 7: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

7

Enterprise Enterprise Application Application Integration Integration

Architectural Architectural ChallengesChallenges

Page 8: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

8

● Integration● Reliability● Mediation● Service Orientation● Interoperability● Security● Federated Identity

Page 9: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

9

1. Integration1. Integration

Page 10: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

10

Point-to-Point Integration

Page 11: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

11

Point-to-Point Integration

Specifically, linking every component to every other component will require N(N-1)/2 physical connections

N = Total Number of Components in the Network

e.g: If there are 10 components in the network,

Total number of physical connections = 10 (10-1)/2

= 45

Page 12: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

12

Point-to-Point Integration

● The value of the network increases linearly over time while its costs increase exponentially

Page 13: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

13

The SolutionA more centralized approached to the previous point-to-point approach

The Solution

Page 14: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

14

2. Reliability2. Reliability

Page 15: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

15

● This creates a loosely-coupled distributed system, which can continue to function reliably, without downtime, even when individual components or connections fail

Message Oriented Middleware

Page 16: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

16

● Supports Remote Communications● Integrating different language/platforms as a

Message Bus (Message Bus Pattern)● Supports Asynchronous Communication● Supports Throttling ● More reliable● Can be used for disconnected operations● Supports mediation

Message Oriented Middleware

Page 17: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

17

3. Mediation3. Mediation

Page 18: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

18

Page 19: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

19

Enterprise Integration Patterns

Page 20: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

20

Enterprise Integration Patterns

Message Router

Pipes and Filters

Page 21: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

21

Enterprise Integration Patterns

Content Based Router

Message Translator

Page 22: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

22

Enterprise Integration Patterns

Message Filter

Message Splitter

Page 23: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

23

Enterprise Integration Patterns

Message Aggregator

Message Resequencer

Page 24: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

24

Source: http://www.idevnews.com/views/images/uploads/general/talend_intfactory.jpg

Enterprise Integration Patterns

Page 25: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

25

The integrated SOLUTION

Page 26: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

26

5. Service 5. Service OrientationOrientation

Page 27: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

27

The SOA Environment

Source: Open Source SOA

Page 28: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

28

A typical SOA environment

● Service Interfaces/ Contracts● Service Transparency● Service Composition● Service Registry or Publication● Service Governance

Page 29: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

29

The Core Characteristics of SOA1) The Service Interface / Contract

Page 30: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

30

The Core Characteristics of SOA2) The Service Transparency What if you change

the IP of this address???

Page 31: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

31

The Core Characteristics of SOA2) The Service Transparency

Page 32: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

32

The Core Characteristics of SOA3) Service Composition

– There are two general types of composite services● Simple● Complex

– Simple: Simply wraps one or more lower­level services together into a more coarse­grained operation

– Complex: (Work Flow Type BPM)● WS­BPEL● Entry Point of invoking WS­BPEL is usally a web 

service

Page 33: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

33

The Core Characteristics of SOA3) Service Composition

Page 34: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

34

The Technologies of SOA

Page 35: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

35

Bottom Up Vs Contract First

● Why Contract First is better?

Page 36: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

36

6. Interoperability6. Interoperability

Page 37: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

37

Private Sector Companies

Services

ApplicationServices

Application

The Department of Motor Traffic

Vehicle Domain

Services

Application

The Department Registration of Persons

Personal Domain

Services

Application

The Land Ministry

Land Domain

Page 38: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

38

DMTDMT

Translationin the

Middleware

Translationin the

Middleware

WPDMTWPDMT

Owner First NameOwner Last NameOwner Address Line1Owner Address Line2Owner CityVehicle Reg NoFuel TypeWeightNumber of Seats

Owner First NameOwner Last NameOwner Address Line1Owner Address Line2Owner CityVehicle Reg NoFuel TypeWeightNumber of Seats

Owner Full NameOwner AddressVehicle Reg NoFuel TypeWeightNumber of Seats

Owner Full NameOwner AddressVehicle Reg NoFuel TypeWeightNumber of Seats

Page 39: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

39

The Need

● So many distributed & diverse systems,

– May have used various technologies

– May have used various data architectures

– May have used conflicting policies, procedures, guidelines

Page 40: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

40

The Solution

● Standardize data representation, formats and semantics on the wire by having an Interoperability Framework

● Use Open Standards

Services Oriented Architecture&

Web Services

Page 41: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

41

Interoperability Frameworks

Page 42: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

42

Enterprise Architecture

● Enterprise Architecture is the complete expression of the enterprise

● “Enterprise Architecture is about understanding all of the different elements that go to make up the enterprise and how those elements interrelate.” - The Open Group

Page 43: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

43

Enterprise Architecture Frameworks (EAF)

Page 44: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

44

7. Security7. Security

Page 45: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

45

Transport Vs Message Level Security

Page 46: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

46

Point to Point SecurityESB as a Security Gateway

Page 47: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

47

End to End Securitywith Pass Through

Page 48: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

48

End to End Security with Security Translantion at ESB Level

Page 49: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

49

Web Services Security Stack

Reference: Securing Web Services with WS-Security (Jothy Rsenberg, David L Remy)

Page 50: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

50

8. Federated Identity8. Federated Identity

Page 51: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

51

● SAML provides a loosely coupled identity management with the help of WS-Trust and WS-Fedeartion specifications.

Page 52: Enterprise Integration Architectural Challenges in Large Enterprises - Colombo Architecture Meetup - Session-02

52