COPYRIGHT © 2008-2011 OSGi Alliance. All Rights Reserved
The Dawn of Composite Cloud
Richard Nicholson
Paremus
20-September-2011
OSGi Alliance Marketing © 2008-2010 . All Rights Reserved
Page 1
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Cloud 1.0 - The Dream...
• Only pay for the resources you use.• Ability to scale on demand.• Reduced operations staff.• A robust operational platform.
All without changing your Applications!
Organisation X (which shall not be named!) Internal charge back - $2,000,000 for a rack of 32 Blade Servers!And 3 months required to deliver this hardware to the project!!
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Cloud 1.0 - The Reality: Pricing
As Product Prices Hit Ceiling, Is VMware Still Affordable?http://siliconangle.com/blog/2011/07/25/as-product-prices-hit-ceiling-is-vmware-still-affordable/
25 July 2011
http://www.informationweek.com/news/cloud-computing/platform/2316006721 Sept 2011
Google App Engine Price Hike Stuns Developers.... outcry as developers see their bills skyrocket.
• Complex Pricing Structures• Limited guarantee’s SLA’s
Financial Services Organisation X Internal charge back for compute resource equivalent to EC2 - once WAN bandwidth is considered - in-house resource is cheaper
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Cloud 1.0 - The Reality: Availability and SLA’s
Amazon's lengthy cloud outage shows the danger of complexityBy Peter Bright | Published 4 months ago
http://arstechnica.com/business/news/2011/04/amazons-lengthy-cloud-outage-shows-the-danger-of-complexity.ars
09 September 2011
Office 365, Google Docs go down again, could give pause to the cloud-waryBy Jon Brodkin | Published about 4 hours ago
http://arstechnica.com/business/news/2011/09/office-365-google-docs-go-down-again-could-give-pause-to-the-cloud-wary.ars
Millions of Hotmail users cut off by Microsoft 'cloud' failure
http://www.telegraph.co.uk/technology/news/8752156/Millions-of-Hotmail-users-cut-off-by-Microsoft-cloud-failure.html 09 September 2011
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Regulator Casts Doubt on Banking Clouds
Too risky, says Monetary Authority of Singapore.
... unlikely to allow a bank to put customer data into the cloud without significant due diligence, pointing out that in Singapore such behaviour could be punished with a three year jail term and a hefty fine.
"[Cloud] vendors do not understand the regulatory system and laws applying to financial services,"
Outages that have affected Amazon Web Services, Google App Engine, and Microsoft Azure, suggesting that there would be a huge loss of confidence in a bank that could not continue to process transactions.
Concerned by 'nested cloud' - scenarios in which cloud providers use services from other providers to deliver a service.
US SEC 10-Q filings by various cloud providers as examples of further cause for concern - the majority of its customers do not pay the extra fees charged for disaster recovery services.
http://www.itnews.com.au/News/235977,singapore-regulator-casts-doubt-on-banking-clouds.aspx
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
A Different Question
To what extent does Cloud address fundamental IT issues we actual face?
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Contributing factors to OPEX
Anne Thomas Manes (Gartner) – SOA Symposium: Berlin, October 2010
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
‘Cloud Computing’
?
Contributing factors to OPEX
Anne Thomas Manes (Gartner) – SOA Symposium: Berlin, October 2010
From an OPEX perspective - its the maintenance of applications that are the dominant PROBLEM!
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Question
Question: How Much Does it cost to change a single line of code?
Context? A large software vendor with aspirations to be a SaaS player
Answer: > $1,000,000
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Modular Systems are Maintainable Systems
This is true for Hardware and Software.
• Modularisation forces ‘accidental complexity’ out of the environment.
• Module boundaries enforce a clean contract between the runtime participants: & each layer of structural hierarchy!
• Runtime Dependencies are explicit!• Enforces low coupling & high cohesion.• Unit of Deployment is Unit of Maintenance.• Unit of Deployment is Unit of Re-use.
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
‘VM Image centric’ Compute Clouds
We’re pushing ‘static’ Gbyte sized software images to every node
To change / update / fix - we must push a new image out yet again!
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
VM Images - The Wrong Deployment Artifact
• Masks runtime dependencies
• Consumes unnecessary bandwidth
• Consumes unnecessary storage capacity
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Cloud 1.0
With each SOA Business Service lies a rotting design.....
Beneath each Cloud lies a rotting infrastructure.....
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
The Dawn of ‘Composite Cloud’
In response to an injected service description: each node assembles the corresponding service:
• Locally resolving all dependencies• Pulling only software components required.
But there is something much better if your applications are JAVA centric ;)
Solutions like Puppet & CodeChef - deployment and configuration of Linux packages - are a step in the right direction.
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Modular Clouds
Is OSGi ‘THE’ enabler for:
• OSGi applications in the Cloud?• Java applications in the Cloud?• Any type of Application?
ALL OF THE ABOVE!
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
RFP133 - OSGi and CloudsCloud
A Resource Pool
AC
B
A System
A Process Group A System Element instance!a process group member"Purpose:
• Provide a review of current industry standards bodies• Provide a conceptual model • Relate conceptual model to relevant OSGi specifications
- Requirements and Dependencies - OBR specification- Remote Services - RSA specification- Configuration - ConfigAdmin
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
IaaS
PaaS
An IaaS resource dependency
i.e. Amazon S3
IaaS
PaaS
A PaaS Servicesi.e. Amazon SMS
An indirect resource dependency on IaaS storage - i.e. Amazon S3
RFP133 - OSGi and Clouds
Business Benefit? Directly address environmental dependencies!
• Avoid Cloud middleware service lock-in- By inverting the middleware stack
• Addressing infrastructure fragility- By speed at which applications can be re-installed andchanged
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Next Steps
Next Steps - the RFC’s:
• Framework Advertisements- How do we advertise? Leverage RSA?- What?
• Generating Environment metadata for OBR resolution • Deployment Description - for distributed ‘Composite’
applications
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
= 1
= 3
= 1
Target State Runtime State
Deploy
The Paremus Service Fabric - A model driven runtime
We Have a Guide
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
M!del
Target State
"Structure#SLA$
Runtime
Entity
Monitor
Provision Delta
Planned Deltase.g. Configuration
changes
Unplanned Deltase.g. Resource
failures
= 1
= 3
= 1
Target State Runtime State
The Service Fabric responds by creating the corresponding System - deploying all required components and ‘wiring’ these together
We Have a Guide
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Service Fabric: Example
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Data Will Always Be The Issue!
• Data is like Mass: the more there is - the more ‘effort’ it takes to move
• Latency will always be a barrier - speed of light
• Hence assemble processing close to where the Data is generated / collated
• No-longer centralised Compute Clouds but pervasive federated Data centric Clouds
Current public Cloud solutions are like the Internet pre ARPA-Net
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
Data Centric Clouds
Source of DataA processing Edge Unit
!
"#
!
"
#
local data generated .
Optional:Edge device advertises availability of data. .Edge device downloads appropriate functionality to locally process data..
Data Edge Behaviour : Processingmoved to location of data at edge
Processing moved to location of data.
OSGi Cloud Core
(OSGi Edge)
Copyright © 2011 Paremus Ltd.May not be reproduced by any means without express permission. All rights reserved.
The Dawn of Composite Cloud September 2011
To Conclude
At runtime we must manage dependencies - ALL THE WAY DOWN
OSGi is THE enabler for Cloud 2.0
But lets not repeat Cloud 1.0 architectural mistakes!