Embed Size (px)
DESCRIPTION
Visual Studio 2010 Ultimate lets you profile and stress test your application early and throughout its development lifecycle with realistically modeled simulated load. By integrating performance validations early into your applications, you can ensure that your solution copes with real-world demands and behaves in a predictable manner, effectively increasing overall software quality. In this session, we will learn the importance of performance and stress testing, as well as the capabilities of Visual Studio 2010 Ultimate to improve profiling and testing throughout the application lifecycle.
Citation preview
Improving Overall Software Quality Through Profiling and Performance Testing
Ervin Loh and Lai EeALM Program Manager and ALM EngineerK365Labs Sdn Bhd
Agenda
Load & Performance Testing with Visual StudioProven within Microsoft
External Success Stories
The Visual Studio Load & Performance Offering
The Visual Studio Load & Performance Community
Visual Studio: Battle Hardened
Visual Studio is the de facto load testing tool within Microsoft
Scales to massive loads
Handles the most complex scenarios
Team Test Target Description
Office Server Office SharePointWindows SharePointExcel Server
Perf and stress testing of Office Server System
SQL SQL Reporting ServicesSQL BI
Perf and Stress, benchmarking, sizing
Dynamics AX Dynamics 4.0 Perf and Stress, benchmarking, sizing
MSN/Live Ad CenterHot MailVirtual EarthAutosMarch MadnessMusicMore…
High volume perf and stress testing
Groove Open Office Perf and Stress Testing
DevDiv Team Foundation Server Perf and Stress Test TFS
MSIT SAP Load Test SAP via Web Services
MSTV IPTV servers Huge tests to load test IPTV national rollout
MS CRM MS CRM Perf and Stress, benchmarking, sizing
Microsoft.com Microsoft.com Perf and Stress Testing
Dr Watson Log collection servers Perf and Stress Testing
Windows Update Patch download servers Perf and Stress Testing
Load Test Internal Success Stories
Recent 12-hour production test:Total requests generated 3.63 BillionAverage requests/sec 84,248
Using Load Tests to validate IPTV podsEach services 100,000 customersMany major telecoms are customers:AT&T, Tel Italia, Bell Canada, more…
External Success Stories
Services Test LabsProfessional performance and stress testing services
Before: 100% on HP Load Runner and Borland Silk Performer
After: 100% on VS, with many successful customer engagements
Prefer VS over Load Runner and Silk Performer
Many others
Tailspin Toys
Agenda
Load & Performance Testing with Visual Studio
The Visual Studio Load & Performance OfferingWeb Test Architecture & Feature Set
Load Test Architecture & Feature Set
The Visual Studio Load & Performance Community
Web Performance Test Feature Set
Deep integration with Visual Studio
Web (HTTP) Tests
Data CollectionPerformance Counter Sets capture key measurements
Test results stored in SQL for custom reporting
Performance Analysis Correlate of server activity with performance measurements
Drill into error logs
Web Performance Test Recorder
Visual Studio
Recorder Listener
Internet Explorer
Browser Control
Wininet Shim
Wininet
Browser Recorder
Wininet Recorder
Browser events
Intercepts wininet calls
Merging Recorder
Record events
Record events
Record events
Recorder BHO
Visual Studio Launches Internet Explorer
Web Test Recorder Plugin
Visual Studio
Recorder ListenerRecord events
Internet Explorer
Browser Control
WininetShim
Wininet
Browser Recorder
WininetRecorder
Browser events
Intercept s wininet calls
Merging Recorder
Record events
Record events
Recorder BHO
Visual Studio Launches Internet Explorer
Key Capabilities in 2010
Declarative branching and looping in a web performance testExcel based performance reportingRun UI tests as performance testsIntegration with data collectors
ASP.net profilerIntellitrace™
Web Performance Tests
Visual Studio 2010 Load Test Architecture
web server
database server
Microsoft Test Manager 2010
test controller
Load agent
Visual Studio
Load/Stress Test Feature Set
Flexible Load Modeling“Scenarios” for modeling different user groups
Goal-based, step, constant, and custom load patterns
Model different browsers and networks
Duration-based and iteration based
Efficient Load Generation
“Unit” tests can be run under load
Key Capabilities in 2010
Virtual user activity chart
64-bit test execution
Driver level network emulation
Collect the full test result on error
Numerous enhancements to make creating scripts easier
New extensibility points
… and more
Load Tests
Agenda
Load & Performance Testing with Visual Studio
The Visual Studio Load & Performance Offering
The Visual Studio Load & Performance Community
Plugins, Extensibility
Forums, Blogs
Extensibility
Load test plugins
Many extensibility points in Web performance tests
web test plugins
web test request plugins
web test recorder plugins
diagnostic data adapters (DDA) (a.k.a “data collectors”)
Visual Studio Load & Performance Community
Forumshttp://social.msdn.microsoft.com/Forums/en-US/vstswebtest/threads
BlogsBlogs.msdn.com/edglas
Blogs.msdn.com/billbar
Blogs.msdn.com/slumley
http://blogs.msdn.com/edglas/pages/content-index-for-web-tests-and-load-tests.aspx
Visual Studio Load & Performance Community
CodePlexQuick Reference Guide
WCF Load Test Recorder
SQL Load Test Recorder
Load Test Reports
Web and Load Test Plugins
SharePoint Scripts
continue….
How Do I Get It?
Questions & Answers
Resources
Getting Started with Load and Web Performance Test Walkthroughshttp://msdn.microsoft.com/en-us/library/ee923685.aspx
Web Performance Test Walkthroughshttp://msdn.microsoft.com/en-us/library/aa337591.aspx
Load Test Walkthroughshttp://msdn.microsoft.com/en-us/library/ff406963.aspx
Walkthrough: Using a Test Controller and Test Agents in a Load Testhttp://msdn.microsoft.com/en-us/library/ff400223.aspx
We value your feedback!
Please remember to complete the overall conference evaluation form and return it to the Registration Counter.
