Advanced Diagnostics, IntelliTrace™ and Test Automation

Advanced Diagnostics, IntelliTrace™ and Test AutomationHabib Heydarian (habibh@microsoft.com)http://blogs.msdn.com/habibhProgram ManagerMicrosoft Corporation

PDC09-FT16

VS2010: Quality as a 1st Class Citizen

1 2

34

It Works on My Machine!

File Bug

Resolve as“No Repro”

Hand-offto Test

Test Code Hand-offto Dev

Investigate Bug

Write Code

What is IntelliTrace?

+ =

Application Instrumentation Log File

Today

+ ==

IntelliTrace • Record• Playback• Rewind

IntelliTrace

IntelliTrace: How Did I Get Here?

Habib HeydarianProgram ManagerVisual Studio

demo

IntelliTrace Capabilities> Code is instrumented dynamically> Records program execution flow

> Method Enter & Exit> Records program data

> Parameters> Return values

> Low overhead for collection> Supports Dev, Test and Staging

environments> Pay-as-you-go collection model> 1st class debugging experience in VS

IntelliTrace: Why did this Build Verification Test (BVT) test fail?

Habib HeydarianProgram ManagerVisual Studio

demo

How IntelliTrace WorksApplication

IntelliTrace File

CollectionPlan.xml

IntelliTrace Recorder

Choose the Right Tests

Automated

Testing

Manual Testing

User Testing

Choosing the Right TestsThe Problem

Application Functionality

Q: Which tests should the developer and tester run to verify this code change?A) Automated Tests

onlyB) Manual Tests onlyC) All of the aboveD) Don’t knowE) Trick question??

Δ

Code Change

Choosing the Right TestsThe ConsequenceThe world of Developers> Run more tests than

needed> Run too few tests than

needed

The world of Testers> Verify more tests than

needed> Verify too few tests than

needed

1. Less Productivity• Effort wasted on tests that don’t need to be

run2. Lower quality• Not enough testing to verify code change

What is Test Impact Analysis?> Automatically pinpoint which tests are

impacted as a result of a code change What is the impact

of this bug fix?

Test Impact Analysis: A One Line Bug Fix

Habib HeydarianProgram ManagerVisual Studio

demo

How Test Impact Analysis Works

Automated Impacted Tests

Test Impact View

TFSTeam Build

Manual Impacted Tests

Microsoft Team & Lab Mgr

Team Build Report

A B

C

Multi-Tier Performance Analysis

Client-side Script Database calls

Multi-Tier Performance AnalysisUser: “Why is it taking so long to load the Orders

page?”

Developer: “I wonder where the

problem could be???”

Front End?

Mid Tier?

Back End?

Performance Analysis Across Multiple Tiers

Habib HeydarianProgram ManagerVisual Studio

demo

Solve Complex Debugging Tasks

Collaborative Debugging

Habib HeydarianProgram ManagerVisual Studio

demo

DataTipsPin the DataTip to the source code

DataTip stays in sync with the source code

Toolbar allows the user to pin/unpin a DataTip

Context menu for managing values/expressions in the DataTip

Floating DataTips can be dragged anywhere, and can’t be pinned unless over source code

Space provided for comments in the DataTip which can be collapsed/expanded as desired

DataTip changes color to indicate it is a floating window

Debugging a Crash in a Deployed Application using Dump Files

Habib HeydarianProgram ManagerVisual Studio

demo

Dump File Summary PageDump file summary information

Support for mixed-mode dump files

IL Interpreter for managed property evaluation

Operating system and CLR version information

Module Information

Search modules

Summary

• IntelliTrace • Test Impact Analysis

• Tier Interaction Profiling• Client-side Script Profiling

• Collaborative Debugging• Debugging Dump Files

YOUR FEEDBACK IS IMPORTANT TO US! Please fill out session evaluation

forms online atMicrosoftPDC.com

Learn More On Channel 9> Expand your PDC experience through

Channel 9

> Explore videos, hands-on labs, sample code and demos through the new Channel 9 training courses

channel9.msdn.com/learnBuilt by Developers for Developers….

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.