27
Advanced Diagnostics, IntelliTrace™ and Test Automation Habib Heydarian ( [email protected] ) http://blogs.msdn.com/habibh Program Manager Microsoft Corporation PDC09-FT16

Advanced Diagnostics, IntelliTrace™ and Test Automation

  • Upload
    hung

  • View
    57

  • Download
    0

Embed Size (px)

DESCRIPTION

PDC09-FT16. Advanced Diagnostics, IntelliTrace™ and Test Automation. Habib Heydarian ( [email protected] ) http://blogs.msdn.com/habibh Program Manager Microsoft Corporation. VS2010: Quality as a 1 st Class Citizen. 1. 2. 4. 3. It Works on My Machine!. Write Code. - PowerPoint PPT Presentation

Citation preview

Page 1: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Advanced Diagnostics, IntelliTrace™ and Test AutomationHabib Heydarian ([email protected])http://blogs.msdn.com/habibhProgram ManagerMicrosoft Corporation

PDC09-FT16

Page 2: Advanced Diagnostics,  IntelliTrace™  and Test Automation

VS2010: Quality as a 1st Class Citizen

1 2

34

Page 3: Advanced Diagnostics,  IntelliTrace™  and Test Automation

It Works on My Machine!

File Bug

Resolve as“No Repro”

Hand-offto Test

Test Code Hand-offto Dev

Investigate Bug

Write Code

Page 4: Advanced Diagnostics,  IntelliTrace™  and Test Automation

What is IntelliTrace?

+ =

Application Instrumentation Log File

Today

+ ==

IntelliTrace • Record• Playback• Rewind

IntelliTrace

Page 5: Advanced Diagnostics,  IntelliTrace™  and Test Automation

IntelliTrace: How Did I Get Here?

Habib HeydarianProgram ManagerVisual Studio

demo

Page 6: Advanced Diagnostics,  IntelliTrace™  and Test Automation

IntelliTrace Capabilities> Code is instrumented dynamically> Records program execution flow

> Method Enter & Exit> Records program data

> Parameters> Return values

> Low overhead for collection> Supports Dev, Test and Staging

environments> Pay-as-you-go collection model> 1st class debugging experience in VS

Page 7: Advanced Diagnostics,  IntelliTrace™  and Test Automation

IntelliTrace: Why did this Build Verification Test (BVT) test fail?

Habib HeydarianProgram ManagerVisual Studio

demo

Page 8: Advanced Diagnostics,  IntelliTrace™  and Test Automation

How IntelliTrace WorksApplication

IntelliTrace File

CollectionPlan.xml

IntelliTrace Recorder

Page 9: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Choose the Right Tests

Page 10: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Automated

Testing

Manual Testing

User Testing

Choosing the Right TestsThe Problem

Application Functionality

Q: Which tests should the developer and tester run to verify this code change?A) Automated Tests

onlyB) Manual Tests onlyC) All of the aboveD) Don’t knowE) Trick question??

Δ

Code Change

Page 11: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Choosing the Right TestsThe ConsequenceThe world of Developers> Run more tests than

needed> Run too few tests than

needed

The world of Testers> Verify more tests than

needed> Verify too few tests than

needed

1. Less Productivity• Effort wasted on tests that don’t need to be

run2. Lower quality• Not enough testing to verify code change

Page 12: Advanced Diagnostics,  IntelliTrace™  and Test Automation

What is Test Impact Analysis?> Automatically pinpoint which tests are

impacted as a result of a code change What is the impact

of this bug fix?

Page 13: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Test Impact Analysis: A One Line Bug Fix

Habib HeydarianProgram ManagerVisual Studio

demo

Page 14: Advanced Diagnostics,  IntelliTrace™  and Test Automation

How Test Impact Analysis Works

Automated Impacted Tests

Test Impact View

TFSTeam Build

Manual Impacted Tests

Microsoft Team & Lab Mgr

Team Build Report

A B

C

Page 15: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Multi-Tier Performance Analysis

Client-side Script Database calls

Page 16: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Multi-Tier Performance AnalysisUser: “Why is it taking so long to load the Orders

page?”

Developer: “I wonder where the

problem could be???”

Front End?

Mid Tier?

Back End?

Page 17: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Performance Analysis Across Multiple Tiers

Habib HeydarianProgram ManagerVisual Studio

demo

Page 18: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Solve Complex Debugging Tasks

Page 19: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Collaborative Debugging

Habib HeydarianProgram ManagerVisual Studio

demo

Page 20: Advanced Diagnostics,  IntelliTrace™  and Test Automation

DataTipsPin the DataTip to the source code

DataTip stays in sync with the source code

Toolbar allows the user to pin/unpin a DataTip

Context menu for managing values/expressions in the DataTip

Floating DataTips can be dragged anywhere, and can’t be pinned unless over source code

Space provided for comments in the DataTip which can be collapsed/expanded as desired

DataTip changes color to indicate it is a floating window

Page 21: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Debugging a Crash in a Deployed Application using Dump Files

Habib HeydarianProgram ManagerVisual Studio

demo

Page 22: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Dump File Summary PageDump file summary information

Support for mixed-mode dump files

IL Interpreter for managed property evaluation

Operating system and CLR version information

Module Information

Search modules

Page 23: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Summary

• IntelliTrace • Test Impact Analysis

• Tier Interaction Profiling• Client-side Script Profiling

• Collaborative Debugging• Debugging Dump Files

Page 24: Advanced Diagnostics,  IntelliTrace™  and Test Automation

YOUR FEEDBACK IS IMPORTANT TO US! Please fill out session evaluation

forms online atMicrosoftPDC.com

Page 25: Advanced Diagnostics,  IntelliTrace™  and Test Automation

Learn More On Channel 9> Expand your PDC experience through

Channel 9

> Explore videos, hands-on labs, sample code and demos through the new Channel 9 training courses

channel9.msdn.com/learnBuilt by Developers for Developers….

Page 26: Advanced Diagnostics,  IntelliTrace™  and Test Automation

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Page 27: Advanced Diagnostics,  IntelliTrace™  and Test Automation