Embed Size (px)
Citation preview
W5 Performance Testing
5/1/2013 11:30:00 AM
Building an Enterprise Performance
and Load Testing Infrastructure
Presented by:
Dave Ogletree
Bridgepoint Education
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com
Dave Ogletree
Dave Ogletree has long advocated leveraging virtualization and IT operations expertise in his quality teams. In his current role as the director of quality assurance at Bridgepoint Education, Dave is the process owner for software testing and IT quality control. He has served as the project manager, subject matter expert, and project sponsor for Bridgepoint’s development and testing infrastructure. A seasoned quality assurance professional with more than fifteen years of progressive experience in IT quality management, Dave has specialized in high-compliance and risk-adverse cultures, including government economic data, commercial real estate, financial lending, health care, and education.
4/16/2013
1
David Ogletree
Director of Quality Assurance
Bridgepoint Education
Enterprise Class Load Testing
Things That Make You Go Hmm…
4/16/2013
2
• Isolated environments
• Do we build labs in
house or externally?
• Keeping our developers
and product owners
happy
• Speed of delivery
• Lack of confidence in
reliability
Challenges We Faced
versus
Why we went with a hybrid cloud?
• Security and compliance policies
• Complexity of environments
• Organizational culture
Build Versus Buy
4/16/2013
3
Why we chose vCloud Director?
• Allowed us to easily segregate our
environments
The Hybrid Cloud
Architecture Review
4/16/2013
4
Architecture Review
Catalog Interface
4/16/2013
5
Detailed Operating Procedures
Our Missions
• Improve transaction times for eBook solutions
• Nationwide brand awareness campaign
• Load testing a third-party CRM software for over 2,000
employees
4/16/2013
6
eBook Solution
•Managed service to provide performance and load testing
for eBook solution
• Same solution as production monitoring tools
• Proven success with monitoring partner
• Better capabilities to capture end-user experience and
performance
Page Load Time Results
• Better performance
testing capabilities
• 60% reduction in key
transaction time
• Better confidence in IT
delivery
4/16/2013
7
Nationwide Campaign
• Challenge was speed of delivery for the
Marketing team
• Leverage VCD to build out environment
• Conduct stress testing in development VDC
• Use Google Analytics to capture historical
usage based on Holiday Bowl ads
• Build load solutions with internal resources
• Leverage load testing rig in tools network
PLT Architecture Review
• Use Internal team and tools to support nation wide campaign
4/16/2013
8
Site Availability from Nationwide Campaign
• Better availability numbers for public
facing systems
• Service level targets are being met
Integrating Third-Party Client Server
• Integrating third-party CRM software to more
than 2,000 internal employees
• Load testing thick client
• Building a load testing lab consisting of 12
client- server desktop machines
• Load testing using a record and playback tool
4/16/2013
9
Injector Visio Diagram
Challenges That Remain
• VM sprawl
•Maintenance of environments
• Lack of ownership of environments
• Lack of standards for building virtual systems for
dev/test
• Governance on operating procedures
• Speed of delivery for environment build-outs
4/16/2013
10
Lessons Learned
•Maintain scope
• Set correct expectations with
stakeholders
• Get quick wins
• Vendor management
• Form governance committee
• Capacity management
Kirk Bellmore | VMware Systems Engineer III
Bridgepoint Education
David Ogletree | Director, Quality Assurance
Bridgepoint Education
Steve Gyves | Quality Assurance Analyst III
Bridgepoint Education
Contact Information
