Task 1

Lease Management Case

1

Metrics for Software Managers

Fall 2014

Presented by: Team Touchstone

Dibyendu Roy, Felix Amoruwa, Jennifer Li, Pallavi Mathane, Susana Lau, Tushar Dadlani

AgendaProject Background

Approach - Goal-Question-Metric Diagram

Key Metrics/Reports

Team Decisions & Insights

Reflection: Lessons Learned

A Real Story

Q&A

2

3

Project BackgroundLease management portal

30 Developers + 20 Domain Experts

3 Years

Over 1000 stories

18 months plan-driven + XP

Tarak

Issue 1: Missing Deadline

4

Issue 2: Changing Requirements

5

Issue 3: Integration Failures

6

Assumptions

Stories are not of equal size and same priority

Requirements can come in any time

Team can accurately estimate hours/story

Nature of the project can’t be changed

7

Goal- Question - Metric

8

Velocity Defect Density

Key Metrics

9

Existing Metrics

http://aea365.org/blog/2011/10/page/2/

Story point Variance Variance of deadline over time Percentage of accepted story points by customer Attrition rate Unit test & integration test success rate

Suggested Metrics

Velocity Reports

10

Burndown & Burnup Charts

11

Defects & Tests Reports

12

Dashboard

13

http://howto.commetrics.com/articles/who-benchmarks-against-you/

Team Decisions & Insights1. How many goals to consider?

2. How to include different stakeholders?

3. How to present GQM in a meaningful way?

4. Important to provide actionable items for stakeholders based on reports

14

Task: What Worked

15

Suitable Hypothesis

Well Defined Goals

Questions

Metrics

Well Structured Reports

Actionable Items

End to end workflow

Task: What To Improve

16

Supplementary reports

Deep dive into existing tools for similar projects

Better understanding of what is absolutely necessary

Teamwork Reflection: What Worked

17http://raedevelopment.com/wp-content/uploads/2012/09/team-hands1.jpg

http://shirtoid.com/wp-content/uploads/2010/08/brainstorm.jpg

http://www.learning3pointzero.com/wp-content/uploads/2011/03/listeningBowler.jp

http://pdci-network.org/images/stories/consensus.jpg

Teamwork Reflection: What To Improve

18

Strategy

A Real Story - Sentinel

19

“10 years of ‘Waterfall’ failure and $800m of waste”

Background

2001 Virtual Case File (VCF) - FBI’s IT Modernization Project

2005 730,000 lines of code never worked properly

Abandoned after spending $170 million

2006 Award of a $305 million contract to Lockheed Martin

to develop Sentinel

20

However…Aug 2010 project was only half done …

… and $100 million over budget

Sep 2010 new Agile methodology development strategy

July 2012 successfully deployed ~$500 million

21

What Worked - Agile

• Organized work into 670 ‘user stories’

• To be developed over 21 sprints – each 2 weeks long

• Assign story points based on difficulty

• Demos every other Friday with a host of stakeholders

• Only stories passed tests claimed completed

22

Questions

23