View
221
Download
0
Category
Preview:
Citation preview
W W W . I T K O . C O M1 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
What Makes a DevTest Cloud Fly? (And what is the value?)
John MichelsenNovember, 2010
W W W . I T K O . C O M2 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Dallas-based enterprise software company
Selling to Global 4000
Product Suite: LISA
Focused on Virtualization and Validation of
Complex, Distributed Environments
Resell relationships with HP, IBM, Accenture
& CSC and Partnerships with leading SI
solution providers
150% Annual Revenue Growth over last 4
years
Removing the constraints to software quality and agility.
iTKO Background
W W W . I T K O . C O M3 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Goals
Key Enablers for DevTest CloudIdentify the critical components unique to DevTest
Case Studies of Cloud SuccessYour company doesn’t have the money is no excuse!
The Case for the Cloud in Dev & TestBackgrounder on Cloud for Development use
W W W . I T K O . C O M4 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Complexity is Growing in Today’s Architectures
# of Interconnected
Components
# of Inter-
Dependent TeamsRate of
Change
# of Heterogeneous
Technologies
RMI ObjectsMessaging
Service
BI Tools
Business
Rules
File
System
ESB
Web
Interface
Content
Database
Data
Warehouse
Financials
Mainframe
Web/WAP
Interface
EJB
Virtual
Service
Routing
Service
SOAP
CRM
App
Products
Collaboration
App Portal
Help
Engine
BPMS
Legacy
Infrastructure
Private
Clouds
Public CloudSaaS
W W W . I T K O . C O M5 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Challenges of Cloud for Dev & Test
Production
Infrastructure
Provisioned
Dev & Test Labs
Volatility in Utilization &
Provisioning
Constant Setups &
Teardowns
High Costs and
Environment Sprawl
W W W . I T K O . C O M6 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Volatility of Utilization in Dev and TestVariability even higher and less predictable than in production app use
Aggregate consumption over time
Dev Team A, B, C…
Lab
Utilization
Large scale
performance test
Big
Release
Third Party
Integration Testing
W W W . I T K O . C O M7 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Volatile Utilization Drives Hybrid CloudHigh utilization makes on-premise most effective, low utilization on-premise least
Variable consumption over time
Dev Team A, B, C…
Private Cloud
Public CloudLab
Capacity
& Cost
W W W . I T K O . C O M8 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Cloud
Infrastructure
Catalog
Steps to Deploying a DevTest Cloud
1) Pool Lab Resources Together
(Leverage existing capacity)
2) Implement virtual lab provisioning
2a) Catalog the Virtual Machine Images
2b) Capture Virtual Services off-cloud
3) Start bringing teams onto the cloud
instead of dedicated environments
W W W . I T K O . C O M9 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Virtual Machines
App Server
Order Mgr
Virtual Lab
Manager
Cloud Environment
CRM
VMCatalog
Current Thinking on Cloud for Dev/TestGoals: Elastic Capacity as OpEx and Rapid Provisioning
Dev
Test
Provision Requests
IaaS
-Anonymous Infrastructure on demand
-Large-grained account management
-No Labs Concept
VLM
- Manages things like users, machine catalog,
quotas, charge backs, etc
- Lab definition with machine templates,
advanced setup, ACL, networking
W W W . I T K O . C O M10 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Virtual Machines
App Server
Order Mgr
Virtual Lab
Manager
Cloud Environment
CRM
MainframeSaaS DB System of
Record
System Dependencies
Remain Unanswered
VMCatalog
Dev & Test Cloud Lab Constraints“Wires hanging out” of the Virtual Lab for App Dev
Dev
Test
Provision Requests
Goals: Elastic Capacity &
Rapid Provisioning
Issue: “Wires Hanging Out”of your Cloud
W W W . I T K O . C O M11 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Impact Extends to Off-Cloud, Dependent Systems Cloud costs in dev & test become unpredictable due to unforeseen charges
Variable consumption over time
Lab
Capacity
& Cost
Private Cloud
Public Cloud
$10K usage
charge during one
load test!Big-Bang
Release
Inability to scale
due to off-cloud
constraint (MIPS)
W W W . I T K O . C O M12 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Dev & Test Cloud – Addressing BottlenecksThroughput is always set by the lowest capacity system
Any off-Cloud system nullifies the promise of on-demand capacity
Portal Service/XML
Gateway
ERP Mainframe
(CAN’T
REPLICATE)
Order Mgmt Fulfillment
Actual throughput
Post-Cloud throughput
20 20 10 8
=2
2 =2
W W W . I T K O . C O M13 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Typical Enterprise Apps Have Downstream
Dependencies -- Off-Cloud and/or Data Volatile
Target
Application
“My greatest inhibitor to delivery
is outside my control.”
“I can’t do anything until I have
everything… and I never have
everything!”
JDBC
MQ
ERP
Database
Mainframe
SOAP
Under Construction
Wrong test data
2hr. access window
W W W . I T K O . C O M14 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Virtual Service Environment
in the Cloud
Service Virtualization Solves the Off-Cloud IssueRepresenting the behavior of the off-cloud asset without constraints
Create
Maintain
Live Cloud and
Service I/O TrafficTransaction logs,WSDL definitions, flat files, other
LISA Agents on Systems
LISA Workstation
“Self-Heal” from
Live Systems
Virtual Services are typically
“complete enough” when
created
Consume
Performance Lab
Dev & Test Labs
W W W . I T K O . C O M15 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Time to Productize the Stub/Mock Space
Consumers Need Control: Stubs are usually built by the real
service producer, but the developer’s needs are simple compared
to the consumer -- and consumer often doesn’t have appropriate
skill
Static Data/Performance Only: Stubs are too simplistic so they may
prove one scenario but leave all the rest unavailable
Not Often Possible: How do you stub the database changes that
aren’t made yet? Or the web service that doesn’t have a
development team? Or load test not 100 but 100,000 data
scenarios?
Stubber: “Mr Consumer, here is your customer look-up stub so you
can run in parallel with my development of the real service.”
Consumer: “Yeah, but every customer response in there is the
same customer profile; I need customers with high balances,
old invoices, near their credit limit, long-standing customers
with no balance, … ”
W W W . I T K O . C O M16 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Mainframe
Risk Solution Providers
Credit Bureau
SMS Gateway Providers
Teleconference Service Provider
Card Processing Services
VOIP Phone / Conference Bridges
Bill Payment Services
Motor Vehicle Records (MVR) System
Global Distribution System (GDS)
Almost Any IT Asset in Your DevTest Cloud
W W W . I T K O . C O M17 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Use Case: Accelerate Parallel DevelopmentMajor US Telecommunications Company
Business Problem Client systems waiting for server systems to
deliver first
Software changes taking too long
Business Impact
Reduced Development Cycle by 3
months by modeling dependencies
as Virtual Services
DELAY
DELAY
Billing
Savvion
Siebel
Time Time
VSE
VSE
Before After
Billing
Savvion
Siebel
W W W . I T K O . C O M18 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
App 3
App 2
System
Under Test
Use Case: Eliminate Test Data Volatility
Effort = (# Data Sync/Setups) x (# Test Runs)
App 1
Large Insurance Provider
Data Does Not Exist
Sensitive/ Secure Data
Data Volatility
ChallengesHard to sync test data across multiple apps
Dynamic, time sensitive data scenarios
Difficult to use volatile/sensitive live data
Virtualized Test Data
Effort = 1x Virtualized Data Setup
(Repeat and Reset at Will)
System
Under Test
Before After
Results with LISA
TDM costs reduced 80% in 2 weeks
Cycle reduced by 10 weeks (67%
overall reduction)
W W W . I T K O . C O M19 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Simplified, Automated Test Data ManagementIntelligent, automated solution that replaces manual, time-intensive approaches
Automatically Desensitizes live
data for security and compliance
Capture directly or import from
transactions, databases, files
Heal the data model from the live
system when invalid or outdated
Dynamically adjusts data for
time or situational relevance
W W W . I T K O . C O M20 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Use Case: Unlimited Capacity in Perf LabsMajor US Bank – Performance Testing
Business Problem
Limited capacity on test instances of Back-
end Services
Unable to sufficiently test ESB for
performance
Business Impact
More complete SLA testing in less time
Avoided $20M lab expansion
Every performance test > 30% faster
VSE
~5000 tps
ESB
Back-end
Services
ESB
Load GeneratorsLoad Generators
Before After~20 tps
W W W . I T K O . C O M21 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Dev & Test Cloud – Bottleneck Gone!Virtualize away capacity limitations with Virtual Services in the Cloud
Realize the promise of Cloud Elasticity
Portal Service/XML
GatewayERP Mainframe [Order Mgmt] [Fulfillment]
Actual throughput
20 20 =20unlimited
Virtual Services
in the Cloud
W W W . I T K O . C O M22 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Virtual Machines
Websphere
Order Mgr
Virtual Lab
Management
CRM
LISA Virtualize(Virtual Services)
MFvs DBvs SaaSvs
Virtual
Service
Catalog
Provision
request
VM
Catalog
LISA Virtualize eliminates dependencies, helps
contain costs, and simplifies provisioning.
Constraint-Free Cloud Environments with LISA
W W W . I T K O . C O M23 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Cost Reduction: After DevTest Cloud
Variable consumption over time
Private Cloud
Public Cloud
Minimize
Public Cloud
usage
Virtual Services in
Dev/Test Private Clouds
Reduce Overall
Private Cloud
investment
Off-Cloud
Capacity/
Constraints
& Costs
Eliminated
Lab
Capacity
& Cost
W W W . I T K O . C O M24 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Virtual Machines
Websphere
Order Mgr
Virtual Lab
Management
CRM
LISA Virtualize(Virtual Services)
MFvs DBvs SaaSvs
Virtual
Service
Catalog
Provision
request
VM
Catalog
Example 1: DevTest Cloud Bill of Materials for a
Global Bank
Yours may vary: DevTest does not demand a specific Cloud
infrastructure, integration or service management solution
W W W . I T K O . C O M25 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Example 2: Working with IBM in the CloudEnd-to-End Test, Defect Collaboration, Service Virtualization
Create RTC work items or ClearQuest defects with detailed, multi-tier trace
information from any LISA test
Auto-generate Virtual Data Sets, Regressions, and Virtual Services for
constraint-free resolution and transparency across services
LISA integrates with Rational Quality Manager built on the Jazz platform to
manage validation in ALM processes
LISA Suite< Alt-Click! >
IBM Rational Quality
Manager
Defect
Resolution
Continuous
Validation &
Test
W W W . I T K O . C O M26 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Example 3: Oracle’s Private DevTest CloudLISA is a key enabler for Fusion, AIA, and Fusion Apps Dev & Test
“We reduced our testing cycle times by 90%”
Objects
(EBO)
Order -to-Cash
Oracle
Financials
Siebel
CRM
Other
Integrations
Repository
Web 2.0
UIs
Oracle DB
Java
Frameworks
PeopleSoft
MainframeWebLogic
ESBProcure-to-Pay
OtherPIPs...
PIPs
Services
(EBS)
Fusion
UIs
Fusion teams test UIs
with LISA
Virtualize test data
Performance test
response times
AIA isolates/virtualizes
PIPs & environments
for dev & test
Virtualize test data
VS of integrations in
private Cloud labs
See case study at http://www.itko.com/resources/oracle.jsp
W W W . I T K O . C O M27 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Example 4: Global Telco
Reduced cycle time by 40-70% over the first 6 months by
eliminating dependency constraints
Accelerated testing 1 to 2 phases earlier in the lifecycle
and expanded test responsibilities
Virtual data mgmt expanded scenarios validated by 5X
Avoided millions of dollars in environment costs
4 weeks to achieve 100%+ ROI
Team Previous Cycle Time Cycle Time with LISA
TeamA 45 5
TeamB 10 5
TeamC 5 .5
TeamD 5 0
TeamE 15 .5
TeamF 5 0
TeamG 20 1
TeamH 20 6
TeamI 15 2
W W W . I T K O . C O M28 © 2002-2010, Interactive TKO, Inc. | PROPRIETARY / CONFIDENTIAL
Summary and Q&A
Learn about DevTest Cloud from iTKO:
“The DevTest Cloud: An Essential Platform for App Dev”
“Cloud-Based Test Environments and Benefits”
“Service Virtualization Practices”
http://www.itko.com/cloud
• For more information:
• iTKO Blog: http://blog.itko.com
• Twitter: http://twitter.com/itko
• Email: info@itko.com
“Best Cloud
Integration”
Solution 2009
Recommended