© Mahindra Satyam 2009 Project Metrics QMS Training

© Mahindra Satyam 2009

Project Metrics QMS Training

2

© Mahindra Satyam 2009 Mahindra Satyam Confidential

Objective

Better Project Planning - data from past projects helps in developing plans

for the new project and in setting realistic goals

Controlling a project's performance - Metrics provide accurate information

about the state of the project and thus can be used to take corrective actions

in a timely manner

Analyzing and improving organization processes - metrics measure the

capability of the organization processes, track the changes in capability of

the processes and identify the improvement opportunities

3


Process

Prepare Metrics Plan

Collect Data

Consolidate and Analyze Data

Implement Corrective Actions

Submit End of Project Data

4


Identify Measures

Identify Metrics Categories

Identification of Goal Metrics

Identification of Control Metrics

Setting of Goals

Documenting strategy for achieving Goals

Identify process performance models

Prepare Metrics Plan

5


Inputs for metrics planning are organization baselines & goals, metrics

data from past projects

Generic measurement objectives and related measures are defined at

organization level, projects have to identify and define measures over

and above that, if any

Identify project specific measurement objectives

Identify measures for these objectives

Identify Measures

6


Metrics are categorized as

Project goal metrics : Project goal metrics indicate the overall

performance level that a project aims to achieve. These are typically

computed at the end of the project

Project control metrics : Project control metrics are used during project

execution to control the performance of goal metrics

Data collection items : These metrics need not have a set goal. But data

needed to compute the metric is collected and the metric is computed

Identify Metrics Categories

7


Process performance models help in effective planning thereby help the project

to predict the performance of the project. Based on the project goals, project

would select the appropriate Process Performance Models available and

document the same in the metrics plan.

For eg if the project manager wants to monitor the effort variance of the project

so as to execute the project with in estimated effort, projects may choose to

use the Effort Variance process performance model. This model helps the

PL/PM determine optimum effort that needs to be planned and to be spent for

Project management, Reviews and Testing activities to achieve project Effort

Variance goal.

Identify process performance models

8


Goal metrics are the ones which quantify the project targets. There are

Mahindra Satyam mandated Goal metrics which are defined with

respect to effort, time, quality and, scope. Apart from the Mahindra

Satyam mandated metrics, PL/PM would capture additional metrics

when:

– There are any customer mandated metrics as per the Contract

– Corporate mandate (STARTRAC)

– Customer sets any Improvement targets for any of the project

performance parameters, like productivity improvement, defect

reduction, cycle time reduction, etc

Identification of Goal metrics

9


The metrics that affect the performance of goal metrics are called

control metrics which would be computed and tracked during the project

execution. Based on the statistical correlation analysis, relationship

between goal metrics and control metrics are identified.

Identification of Control Metrics

10


PL/PM shall

– Set the target values as per organization baselines/ customer targets /

corporate mandate.

The goal setting of the same is automated in process performance model

sheets which are derived based on statistical analysis.

Setting of Goals

11


In case if the goals for any particular metric is stringent (based on contractual

agreement/project FLCB performance targets) than the existing goals at

Unit/Organization level, then the strategy for achieving the same needs to be

documented in the metrics plan.

Documenting Strategy for achieving goals

12


Capture data required for computation of metrics (as per the metrics

which are specified in the metrics plan section) in Data Collection Form.

Data sources for these metrics are

– ONTIME for capturing effort

– OPTIMA for capturing schedule

– RESOLVE for capturing defects

– RISK tool for capturing risks.

Collect Data

13


PL analyzes the project’s metrics and consolidates the analysis results

– For maintenance - bug fixing, maintenance - minor enhancements

and maintenance - production support projects

• at end of every month considering data for all work requests closed in

the entire month

– For development

• at the end of each phase

• at end of each module / iteration / project


14


If metrics analysis reveals that certain metric(s) is beyond the expected range,

a causal analysis is conducted to identify the root cause

The root cause analysis is conducted by the entire project team and facilitated

by the PL and QR

Appropriate corrective and preventive actions will be identified

The results of the metrics analysis will be recorded in the Metrics Analysis

Report


15


PL sends the collected data and analysis outputs to PM for ratification

– PM also reviews metrics analysis results as part of project reviews

PL submits a copy of the ratified data collection form to the respective QR

– every month by the end of 5th working day of the month for maintenance -

bug fixing, maintenance - minor enhancements and maintenance -

production support projects

– within 5 working days of the scheduled date for data consolidation for all

other projects

QR validates the data and uses it for Unit level metrics analysis


16


In case any metrics are operating outside the expected range

– identified corrective and preventive actions will be implemented

– the project's performance will be brought back to be within the set

norms

– the project risks may be revisited at this stage, as appropriate

Implement Corrective Actions

17


At the end of the project, a final metric analysis has to be done

This compares the project's actual performance against the set goals

In case of deviation outside the norms, a causal analysis has to be done

The consolidated data for complete project and all the metrics analysis

reports are to be submitted to Quality group for use in baselining and

incorporation in the process database

Submit End of Project Data

18


Better Project Planning - data from past project is used in planning the

new project and in setting realistic goals

Controlling a project's performance - Metrics are used to take corrective

actions in a timely manner

Analyzing and improving organization processes - the capability of the

organization processes is measured using metrics, changes in capability

of the processes are tracked and the improvement opportunities are

identified

Objective Met

Documents

© Mahindra Satyam 2009 Project Metrics QMS Training