Embed Size (px)
DESCRIPTION
A presentation to the Canberra VSTS User Group on the topic of Microsoft Test Manager (MTM).
Citation preview
• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments
• Terminology
• Demos – Creating Test Plans
– Understanding Test Settings
– Creating Test Cases
– Using Shared Steps
– Launching Test Cases
– Creating Bugs
– Reviewing Results
• Best Practices
• Test Plan; a container for test cases with a
set time span.
• Test Case; a sequence of steps which must
be tested.
• Test Run; a group of tests that are being
run locally or in the lab.
• Test Result; a result from a test case in a
test run.
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
Demonstration
• Test Plans – By Feature Area/By Iteration?
• Shared Steps – When to Use?
• Configurations – Common Attributes?
• Data Recorders – Considerations?
• Coded UI Test; some code that uses the UI test automation framework that is hosted inside MSTest.
• Coded UI Test Builder; a utility that allows you to graphically construct UI tests.
• Action Log Recording; an XML file previously recorded via the Test Runner with the Action Log Recording data collector.
• Terminology
• Demos
– Create from Action Log Recording
– Create with Coded UI Test Builder
– Create from Scratch
– Using Test Case Data Sources
• Best Practices
Demonstration
Demonstration
Demonstration
Demonstration
• Action Log Recordings - Good or Bad?
• Hand Code? The curse of the UIMap!
• Automation - When to automate?
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Legend
New
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Legend
New Changed
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Legend
New Changed Stable
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Action Log Assisted Testing
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Action Log Assisted Testing
Coded UI Testing
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Action Log Assisted Testing
Coded UI Testing
Unit Testing
• Terminology
• Demos
– Running Automated Tests from MTLM
– Creating Environments
– Automating Deployments
– Nightly Regression Tests
• Best Practices
• Team Build; a component of TFS that
provides distributed build capability.
• Build Workflow; a XAML file containing
the instructions to produce a build via
Team Build.
• Lab Build; a special case build workflow
designed to automate lab management.
• Lab; the infrastructure you use to test out the products you are developing.
• Environment; a specific subset of the lab dedicated to a particular team project.
• Hyper-V; the virtualisation technology created by Microsoft.
• SCVMM; a product from the System Centre suite designed to manage multiple Hyper-V hosts.
• Library; a storage location for saved VMs,
ISO images etc.
• Snapshot/Checkpoint; a point in time
version of a lab machine (memory + disk).
Demonstration
Demonstration
Demonstration
Demonstration
• Snapshotting – Pre/Post?
• Reporting - Track Quality, Track Activity
• Network Isolation – What is it? Why?
• Environment Configuration – How?
Internet
Fire
wal
l
Remote Access
Gateway
VPN (Encrypted) RDP (Encrypted)
HTTP (Encrypted)
Active Directory
Multi-Tenant TFS
Hyper-V Farm
(VMM) Customer
Build Server(s)
Customer Build
Server(s)
Dedicated Lab
Machines
Dedicated Lab
Machines
Dedicated Lab
Machines
Dedicated Lab
Machines optional external
exposure
Other Services
Other Services
• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments
• http://blogs.msdn.com/lab_management/
• http://vslabmgmt.codeplex.com
• http://channel9.msdn.com/tags/ALM/
• Visual Studio 2010 Workshop (1 day)
• Implementation Consulting
• Virtual Build Master (Managed Service)
