154
House MD: Solving Complex IT Issues Using Differential Diagnosis Steve Bennett [email protected] @DaemonSteve Saturday, 30 June 12

House MD: Solving Complex IT Issues Using Differential

Embed Size (px)

DESCRIPTION

House MD: Solving Complex IT Issues Using Differential Diagnosis In this presentation I will explore how we as IT professionals can learn from the medical profession when it comes to diagnosing particularly complex issues. The human body is complex, as are the applications and computer systems that we are responsible for. These systems sometimes experience “issues”. This can be diseases in patients or for us a site outage or slow-down. Medical doctors have been fixing people longer than we have been tinkering with computers. The first medical diagnosis textbook was dated 1069-1049BC. I will take you through how to manage the problem using “Differential Diagnosis”, which is a widely used mechanism for solving those particularly hard cases. It is particularly useful when trying to problem solve with a team. We will touch on the culture that is needed to allow these methods to flourish in your organisation, as well as a few of the do’s and don’t when trying it out for yourselves. I hope the audience will be left with an understanding of how to apply these processes to reduce your own TTR and make your boss smile.

Citation preview

Page 1: House MD: Solving Complex IT Issues Using Differential

House MD: Solving Complex IT Issues Using Differential Diagnosis

Steve Bennett

[email protected]@DaemonSteve

Saturday, 30 June 12

Page 2: House MD: Solving Complex IT Issues Using Differential

AGENDA

A Brief History Of Medical Diagnosis.Why & How You Should Prove Yourself Wrong.

Differential Diagnosis.Diagnostic Approaches.Diagnostic Thresholds.

Do’s, Don’ts & Application.

Saturday, 30 June 12

Page 3: House MD: Solving Complex IT Issues Using Differential

Who’s This Guy?

Saturday, 30 June 12

Page 4: House MD: Solving Complex IT Issues Using Differential

Why...?

Saturday, 30 June 12

Page 5: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 6: House MD: Solving Complex IT Issues Using Differential

http://www.technologyreview.com/tr35/profile.aspx?TRID=1108

Saturday, 30 June 12

Page 7: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 8: House MD: Solving Complex IT Issues Using Differential

http://flic.kr/p/npaoT

Saturday, 30 June 12

Page 10: House MD: Solving Complex IT Issues Using Differential

Medical Diagnosis

Saturday, 30 June 12

Page 11: House MD: Solving Complex IT Issues Using Differential

http://4.bp.blogspot.com/-cCTr1WWve1E/TfefWAn8zvI/AAAAAAAAAA0/aXO50-syXuE/s1600/Imhotep_Museum-hd-1.jpg

Imhotep - 2600BCSaturday, 30 June 12

Page 12: House MD: Solving Complex IT Issues Using Differential

http://en.wikipedia.org/wiki/File:Edwin_Smith_Papyrus_v2.jpg

Saturday, 30 June 12

Page 13: House MD: Solving Complex IT Issues Using Differential

Hippocrates - 460BC

http://www.sculpturegallery.com/two/hippocrates3.jpg

Saturday, 30 June 12

Page 14: House MD: Solving Complex IT Issues Using Differential

Galen - AD131http://www.sculpturegallery.com/two/hippocrates3.jpg

Saturday, 30 June 12

Page 15: House MD: Solving Complex IT Issues Using Differential

In Summary;It’s Been Around A Long Time..

Saturday, 30 June 12

Page 16: House MD: Solving Complex IT Issues Using Differential

Hypothetico-Deductive Model

Saturday, 30 June 12

Page 17: House MD: Solving Complex IT Issues Using Differential

William Whewell

Saturday, 30 June 12

Page 18: House MD: Solving Complex IT Issues Using Differential

"No amount of experimentation can ever prove me right; a single experiment can prove me

wrong." Albert Einstein

Saturday, 30 June 12

Page 19: House MD: Solving Complex IT Issues Using Differential

Hypothetico-deductive model

Saturday, 30 June 12

Page 20: House MD: Solving Complex IT Issues Using Differential

Something unexplained happens.

Saturday, 30 June 12

Page 21: House MD: Solving Complex IT Issues Using Differential

Hypothesize.

http://www.flickr.com/photos/dougcaldwell/4213877479

Saturday, 30 June 12

Page 22: House MD: Solving Complex IT Issues Using Differential

Plan a test that can falsify.Predict the result.

Saturday, 30 June 12

Page 23: House MD: Solving Complex IT Issues Using Differential

Test.

http://www.flickr.com/photos/kenilio/3351824931

Saturday, 30 June 12

Page 24: House MD: Solving Complex IT Issues Using Differential

Hypothesize.Plan a test that can falsify.

Predict.Test.

Saturday, 30 June 12

Page 25: House MD: Solving Complex IT Issues Using Differential

An Example.

Saturday, 30 June 12

Page 26: House MD: Solving Complex IT Issues Using Differential

I went shopping..

Saturday, 30 June 12

Page 27: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 28: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 29: House MD: Solving Complex IT Issues Using Differential

Failed Card

http://flic.kr/p/9MShdE

Saturday, 30 June 12

Page 30: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 31: House MD: Solving Complex IT Issues Using Differential

Hypothetico-deductive model

Saturday, 30 June 12

Page 32: House MD: Solving Complex IT Issues Using Differential

Something unexplained happens.

Saturday, 30 June 12

Page 33: House MD: Solving Complex IT Issues Using Differential

Hypothesise.

Saturday, 30 June 12

Page 34: House MD: Solving Complex IT Issues Using Differential

Hypothesise.

There Is A System Problem

My Wife Has Been Shopping

I Didn’t Pay My Bill In Time

I’ve Spent Too Much On SSD’s

Saturday, 30 June 12

Page 35: House MD: Solving Complex IT Issues Using Differential

Plan a test.Predict.

Saturday, 30 June 12

Page 36: House MD: Solving Complex IT Issues Using Differential

Plan a test.Predict.

Test: I’ll call the credit card company.

Saturday, 30 June 12

Page 37: House MD: Solving Complex IT Issues Using Differential

Plan a test.Predict.

Test: I’ll call the credit card company.

Prediction: I have sufficient funds.

(If correct will falsify 3 hypothesis)

Saturday, 30 June 12

Page 38: House MD: Solving Complex IT Issues Using Differential

Test.

Saturday, 30 June 12

Page 39: House MD: Solving Complex IT Issues Using Differential

Test.

Result: I have sufficient funds.

Saturday, 30 June 12

Page 40: House MD: Solving Complex IT Issues Using Differential

Hypothesise.

There Is A System Problem

My Wife Has Been Shopping

I Didn’t Pay My Bill In Time

I’ve Spent Too Much On SSD’s

Saturday, 30 June 12

Page 41: House MD: Solving Complex IT Issues Using Differential

Hypothesise.

There Is A System Problem

Saturday, 30 June 12

Page 42: House MD: Solving Complex IT Issues Using Differential

Hypothetico-Deductive Model

Hypothesise.Plan a test that can falsify.

Predict.Test.

Saturday, 30 June 12

Page 43: House MD: Solving Complex IT Issues Using Differential

Differential Diagnosis.

Saturday, 30 June 12

Page 44: House MD: Solving Complex IT Issues Using Differential

Or DDx

Saturday, 30 June 12

Page 45: House MD: Solving Complex IT Issues Using Differential

What is it?

Saturday, 30 June 12

Page 46: House MD: Solving Complex IT Issues Using Differential

It’s that thing that House does.

Saturday, 30 June 12

Page 47: House MD: Solving Complex IT Issues Using Differential

It's a framework for problem diagnosis.

Saturday, 30 June 12

Page 48: House MD: Solving Complex IT Issues Using Differential

It's best used alongside the hypothetico-deductive model.

Saturday, 30 June 12

Page 49: House MD: Solving Complex IT Issues Using Differential

Process of elimination.

Saturday, 30 June 12

Page 50: House MD: Solving Complex IT Issues Using Differential

Assume most obvious.Until proved otherwise.

Saturday, 30 June 12

Page 51: House MD: Solving Complex IT Issues Using Differential

"When you hear hoof beats, look for horses, not zebras"

Saturday, 30 June 12

Page 52: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 53: House MD: Solving Complex IT Issues Using Differential

Probability is your friend.

http://www.flickr.com/photos/nashnosh/5922580484

Saturday, 30 June 12

Page 54: House MD: Solving Complex IT Issues Using Differential

Personalised probability is your best buddy.

http://www.flickr.com/photos/el5ajoola/3868649830

Saturday, 30 June 12

Page 55: House MD: Solving Complex IT Issues Using Differential

Here’s how it works.

Saturday, 30 June 12

Page 56: House MD: Solving Complex IT Issues Using Differential

Something happens.

Saturday, 30 June 12

Page 57: House MD: Solving Complex IT Issues Using Differential

Something bad happens.

Saturday, 30 June 12

Page 58: House MD: Solving Complex IT Issues Using Differential

Something bad and complicated happens.

Saturday, 30 June 12

Page 59: House MD: Solving Complex IT Issues Using Differential

Gather the facts...

Saturday, 30 June 12

Page 60: House MD: Solving Complex IT Issues Using Differential

Gather the facts...

Symptoms

Saturday, 30 June 12

Page 61: House MD: Solving Complex IT Issues Using Differential

Gather the facts...

Subject history

Previous test results

Symptoms

General observations

Saturday, 30 June 12

Page 62: House MD: Solving Complex IT Issues Using Differential

What else do we know?

Saturday, 30 June 12

Page 63: House MD: Solving Complex IT Issues Using Differential

Hypothesise.

http://www.flickr.com/photos/dougcaldwell/4213877479

Saturday, 30 June 12

Page 64: House MD: Solving Complex IT Issues Using Differential

List Hypotheses.

Saturday, 30 June 12

Page 65: House MD: Solving Complex IT Issues Using Differential

Immediately discount. Apply probability.

Saturday, 30 June 12

Page 66: House MD: Solving Complex IT Issues Using Differential

Prioritise hypothesis based on risk and probability.

Saturday, 30 June 12

Page 67: House MD: Solving Complex IT Issues Using Differential

Plan tests.Predict results.

Saturday, 30 June 12

Page 68: House MD: Solving Complex IT Issues Using Differential

Test.Or Treat.

Saturday, 30 June 12

Page 69: House MD: Solving Complex IT Issues Using Differential

Feedback results.

Saturday, 30 June 12

Page 70: House MD: Solving Complex IT Issues Using Differential

Continue until diagnosis is confirmed.

http://www.o-min.com/wp-content/uploads/mobius1-300x225.jpg

Saturday, 30 June 12

Page 71: House MD: Solving Complex IT Issues Using Differential

Gather the facts.Hypothesise.

Apply Probability.Prioritise.

Test or Treat.Loop.

Differential Diagnosis.

Saturday, 30 June 12

Page 72: House MD: Solving Complex IT Issues Using Differential

Diagnostic Approach

Saturday, 30 June 12

Page 73: House MD: Solving Complex IT Issues Using Differential

Possibilistic

Saturday, 30 June 12

Page 74: House MD: Solving Complex IT Issues Using Differential

Possibilistic

All Possibilities Are Equal

Test Everything

Saturday, 30 June 12

Page 75: House MD: Solving Complex IT Issues Using Differential

Possibilistic

All Possibilities Are Equal

Test Everything

Saturday, 30 June 12

Page 76: House MD: Solving Complex IT Issues Using Differential

Probablistic

Saturday, 30 June 12

Page 77: House MD: Solving Complex IT Issues Using Differential

Probablistic

Selection Based On Probability

Prioritise The Most Likely

Saturday, 30 June 12

Page 78: House MD: Solving Complex IT Issues Using Differential

Probablistic

Selection Based On Probability

Prioritise The Most Likely

Saturday, 30 June 12

Page 79: House MD: Solving Complex IT Issues Using Differential

Prognostic

Saturday, 30 June 12

Page 80: House MD: Solving Complex IT Issues Using Differential

Prognostic

Selection Based On Most Serious

Prioritise The Most Serious

Saturday, 30 June 12

Page 81: House MD: Solving Complex IT Issues Using Differential

Prognostic

Selection Based On Most Serious

Prioritise The Most Serious

Saturday, 30 June 12

Page 82: House MD: Solving Complex IT Issues Using Differential

Pragmatic

Saturday, 30 June 12

Page 83: House MD: Solving Complex IT Issues Using Differential

Pragmatic

Selection Based On Responsiveness To Treatment

Prioritise The Most Easily Treated

Saturday, 30 June 12

Page 84: House MD: Solving Complex IT Issues Using Differential

Pragmatic

Selection Based On Responsiveness To Treatment

Prioritise The Most Easily Treated

Saturday, 30 June 12

Page 85: House MD: Solving Complex IT Issues Using Differential

When do I use each approach..

Saturday, 30 June 12

Page 86: House MD: Solving Complex IT Issues Using Differential

Do something and do it fast...

Pragmatic.

Saturday, 30 June 12

Page 87: House MD: Solving Complex IT Issues Using Differential

If it really is that, we are in a world of hurt.

Prognostic.

Saturday, 30 June 12

Page 88: House MD: Solving Complex IT Issues Using Differential

Default = Probabilistic.

Saturday, 30 June 12

Page 89: House MD: Solving Complex IT Issues Using Differential

I want more probability...

Saturday, 30 June 12

Page 90: House MD: Solving Complex IT Issues Using Differential

Pre & Post Test Probability.

If the result is X;There is 60% chance of hypothesis being correct.

If the result is Y; There is 0% chance of hypothesis being correct.

Current Probability: 30%

Saturday, 30 June 12

Page 91: House MD: Solving Complex IT Issues Using Differential

This is easier in medicine.

Saturday, 30 June 12

Page 92: House MD: Solving Complex IT Issues Using Differential

Differential Diagnosis...Diagnostic Approach...

!

!

Saturday, 30 June 12

Page 93: House MD: Solving Complex IT Issues Using Differential

Diagnostic Thresholds

Saturday, 30 June 12

Page 94: House MD: Solving Complex IT Issues Using Differential

Define the point at which something is worth testing.

Saturday, 30 June 12

Page 95: House MD: Solving Complex IT Issues Using Differential

0% 100%Test

ThresholdTreatmentThreshold

Probability of Diagnosis

Worth TestingNot Worth

TestingWorth

Treating

High Priority Tests

Saturday, 30 June 12

Page 96: House MD: Solving Complex IT Issues Using Differential

Mnemonics.

Saturday, 30 June 12

Page 97: House MD: Solving Complex IT Issues Using Differential

Doctors Love Mnemonics.

Saturday, 30 June 12

Page 98: House MD: Solving Complex IT Issues Using Differential

Mnemonic for DDx.

Saturday, 30 June 12

Page 99: House MD: Solving Complex IT Issues Using Differential

Vascular

Inflammatory

NeoplasticDegenerative/Deficiency

Idiopathic/Intoxication

CongenitalAutoimmune/Allergic

EndocrineTraumatic

Saturday, 30 June 12

Page 100: House MD: Solving Complex IT Issues Using Differential

Mnemonic for Acute Pancreatitis.

Saturday, 30 June 12

Page 101: House MD: Solving Complex IT Issues Using Differential

Gallstones

Mumps

TraumaSteroids

Ethanol

AutoimmuneScorpion bites

Drugs(azathioprine, diuretics)Hyperlipidemia

GET SMASH’D

Saturday, 30 June 12

Page 102: House MD: Solving Complex IT Issues Using Differential

Mnemonic for the web...

Saturday, 30 June 12

Page 103: House MD: Solving Complex IT Issues Using Differential

Cache/Code Application engine

Services (Third Party)Hardware

Web server

Operating systemUsers

Network

Database/DatastoreSaturday, 30 June 12

Page 104: House MD: Solving Complex IT Issues Using Differential

Cache/CodeApplication engineServices (Third Party)HardwareWeb serverOperating systemUsersNetworkDatabase/Datastore

CA$HWOUNDSaturday, 30 June 12

Page 105: House MD: Solving Complex IT Issues Using Differential

These are used to follow a path through trees.

Saturday, 30 June 12

Page 106: House MD: Solving Complex IT Issues Using Differential

CA$HWOUND

Saturday, 30 June 12

Page 107: House MD: Solving Complex IT Issues Using Differential

How can this all help me?

Saturday, 30 June 12

Page 108: House MD: Solving Complex IT Issues Using Differential

It makes you more thorough.

Saturday, 30 June 12

Page 109: House MD: Solving Complex IT Issues Using Differential

It can help you fix things faster.

Saturday, 30 June 12

Page 110: House MD: Solving Complex IT Issues Using Differential

By working as a team.

Saturday, 30 June 12

Page 111: House MD: Solving Complex IT Issues Using Differential

By working more efficiently.

Saturday, 30 June 12

Page 112: House MD: Solving Complex IT Issues Using Differential

Reduces Thematic Vagabonding.

http://www.flickr.com/photos/neloqua/166353267

Saturday, 30 June 12

Page 113: House MD: Solving Complex IT Issues Using Differential

Reduces Lone Wolf Heroism.

http://www.flickr.com/photos/tambako/3559257456

Saturday, 30 June 12

Page 114: House MD: Solving Complex IT Issues Using Differential

Reduces Encystation

http://www.flickr.com/photos/tambako/3559257456

http://www.flickr.com/photos/emmacoulston/4442688125

Saturday, 30 June 12

Page 115: House MD: Solving Complex IT Issues Using Differential

This is what it looks like.

Saturday, 30 June 12

Page 116: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 117: House MD: Solving Complex IT Issues Using Differential

I’ve run out of diagnosis.

Saturday, 30 June 12

Page 118: House MD: Solving Complex IT Issues Using Differential

You suck.:-)

Saturday, 30 June 12

Page 119: House MD: Solving Complex IT Issues Using Differential

Then you’ve missed something.

Saturday, 30 June 12

Page 120: House MD: Solving Complex IT Issues Using Differential

Question your results, symptoms and observations.

Saturday, 30 June 12

Page 121: House MD: Solving Complex IT Issues Using Differential

Re-test if in doubt.

Saturday, 30 June 12

Page 122: House MD: Solving Complex IT Issues Using Differential

Call in a fresh pair of eyes.

Saturday, 30 June 12

Page 123: House MD: Solving Complex IT Issues Using Differential

Do’s and Don’ts

Saturday, 30 June 12

Page 124: House MD: Solving Complex IT Issues Using Differential

Assemble a team.

Saturday, 30 June 12

Page 125: House MD: Solving Complex IT Issues Using Differential

Get the right experts in the room.

Saturday, 30 June 12

Page 126: House MD: Solving Complex IT Issues Using Differential

Experts and generalists.

Saturday, 30 June 12

Page 127: House MD: Solving Complex IT Issues Using Differential

The diagnostic lead.

Saturday, 30 June 12

Page 128: House MD: Solving Complex IT Issues Using Differential

Diagnostic Lead, controls the pen.

http://www.flickr.com/photos/scttw/1819085915

Saturday, 30 June 12

Page 129: House MD: Solving Complex IT Issues Using Differential

Take it in turns to lead.Saturday, 30 June 12

Page 130: House MD: Solving Complex IT Issues Using Differential

Culture.

Saturday, 30 June 12

Page 131: House MD: Solving Complex IT Issues Using Differential

Openness is key.

http://www.flickr.com/photos/41427839@N07/5973163369/

Saturday, 30 June 12

Page 132: House MD: Solving Complex IT Issues Using Differential

Encourage people to challenge.

Saturday, 30 June 12

Page 133: House MD: Solving Complex IT Issues Using Differential

And be challenged.

Saturday, 30 June 12

Page 134: House MD: Solving Complex IT Issues Using Differential

Collaborate.

http://www.neale-wade.net/blog/wp-content/uploads/2008/08/100_1241.jpg

Saturday, 30 June 12

Page 135: House MD: Solving Complex IT Issues Using Differential

Do not immediately dismiss ideas...

http://www.flickr.com/photos/albaflickr/4416770182/lightbox/

Saturday, 30 June 12

Page 136: House MD: Solving Complex IT Issues Using Differential

Do not immediately dismiss ideas...

http://www.flickr.com/photos/albaflickr/4416770182/lightbox/

that were not yours...

Saturday, 30 June 12

Page 137: House MD: Solving Complex IT Issues Using Differential

Do not immediately dismiss ideas...

http://www.flickr.com/photos/albaflickr/4416770182/lightbox/

that were not yours...or your team’s...

Saturday, 30 June 12

Page 138: House MD: Solving Complex IT Issues Using Differential

There is a time to debate and a time to act.

http://www.flickr.com/photos/straubin/4541508733/

http://www.flickr.com/photos/54182266@N02/5017666438

Saturday, 30 June 12

Page 139: House MD: Solving Complex IT Issues Using Differential

Get better at making group decisions.

Saturday, 30 June 12

Page 140: House MD: Solving Complex IT Issues Using Differential

Build a culture that encourages creative suggestions.

Saturday, 30 June 12

Page 141: House MD: Solving Complex IT Issues Using Differential

Practice makes perfect.

Saturday, 30 June 12

Page 142: House MD: Solving Complex IT Issues Using Differential

When do I use this..?

Saturday, 30 June 12

Page 143: House MD: Solving Complex IT Issues Using Differential

Complex Problems.

Saturday, 30 June 12

Page 144: House MD: Solving Complex IT Issues Using Differential

Active Problems.

Saturday, 30 June 12

Page 145: House MD: Solving Complex IT Issues Using Differential

Post Mortem

Saturday, 30 June 12

Page 146: House MD: Solving Complex IT Issues Using Differential

Conclusion

Saturday, 30 June 12

Page 147: House MD: Solving Complex IT Issues Using Differential

Try and prove yourself wrong.

Saturday, 30 June 12

Page 148: House MD: Solving Complex IT Issues Using Differential

DDx is a framework that YOU can use to resolve & manage your complex problems.

Saturday, 30 June 12

Page 149: House MD: Solving Complex IT Issues Using Differential

Be aware of the Diagnostic Approach that you are using and why.

Saturday, 30 June 12

Page 150: House MD: Solving Complex IT Issues Using Differential

Create a Mnemonic for your system.

It acts as a checklist.

Saturday, 30 June 12

Page 151: House MD: Solving Complex IT Issues Using Differential

Saturday, 30 June 12

Page 152: House MD: Solving Complex IT Issues Using Differential

Watch House.

Saturday, 30 June 12

Page 153: House MD: Solving Complex IT Issues Using Differential

Further Reading;The Process of Diagnosis (AMA) -

http://medicine.ucsf.edu/education/resed/articles/jama6_the_process.pdf

Jessie Robbins - Creating Resiliency Through Destruction-http://www.slideshare.net/jesserobbins/ameday-creating-resiliency-through-destruction

All of John Allspaw’s presentations- http://www.slideshare.net/jallspaw

House MDhttp://www.fox.com/house/

Saturday, 30 June 12

Page 154: House MD: Solving Complex IT Issues Using Differential

Thank You.:-)

������������Saturday, 30 June 12