Lean Agile Intelligence Facilitators Guide

Table of Contents

•Setup• Improvement & Measurement Model•Team Level•Strategic Objectives & Desired Outcomes•Self-Assess• Identify Tactical Goals•Measure

•Organization Level•Business Unit Level•Program Level•Self (Individual Role) Level•Appendix (Advanced Calculations)

Setup - Terminology

Lean Agile Intelligence Terminology

Organization Lean Agile Intelligence unique instance for an enterprise’s assessments and usersOrganization Structure Hierarchical structure that enables grouping of “Teams” Team A group of users that will take a “Self-Assessment”Group A collection of “Teams” Organization Members Users invited to an Organization

Organization Admin Controls setup of the Lean Agile Intelligence unique instance, and has access to all functionalitySuper User Ability to build “Assessment Templates,” conduct “Self-Assessments,” and view all team “Results”Team Member Participates in “Self-Assessments” and can only view “Results” for “Teams” they are assigned toPractices An Agile or Lean Technique Agility Stage The different levels of maturity for each “Practice” Agility Stage Criteria Criteria provided to teams in each “Agility Stage” to help assess themselves Assessment Template A group of “Practices” that can be used for “Teams” to conduct a “Self-Assessment”Self-Assessments The act of the “Team” assessing themselves using an “Assessment Template”Self-Assessment Votes The “Agility Stage” vote provided by each “Team Member”Assessment Results The “Results” of a given assessments or group of assessments viewed in the Lean Agile Intelligence Dashboard

Setup: Organization Structure

Create Group• “Groups” consist of multiple teams and allow

organization users to see aggregated results across multiple teams

• Some examples of “Groups” are Business Units, Component Units, or Programs

Create Team• A “Team” is any group of users that will take a

“Self-Assessment” together• They can be used to define any type of team in

the “Organization” including development, leadership, or operations

Setup: Invite Members To Organization

Invite Members• “Members” of an “Organization” are those that will participate in an assessment and/or analyze

“Results”• Note in order for “Members” to become part of an “Organization” they have to be invited by the

“Admin” • If needed, an “Admin” can re-invite ”Members” by entering email addresses and selecting the “Re-

Invite” button

Setup: Assign Member Attributes

Status• Active: Member can access LAI and is

included in billing• Inactive: Member can no longer access LAI

and is not included in billing

Permissions• Admin: Permission to all functionality including

conducting “Self-Assessments” and “Organization” setup. Can view all “Team” results.

• Super User: Permission to build “Assessment Templates,” facilitate “Self-Assessments”, and view all “Team” results.

• Team Member (Default When Invited): Permission to participate in “Team” “Self-Assessments.” They can only view their “Team” results.

Team Role (Optional)

Teams• Members assigned to a “Team,” will receive

an email when that “Team” launches a “Self-Assessments”

• “Members” can belong to more than one “Team”

Setup: Simple vs Advanced Calculation

• Simple (Default): One level of Practice To Business Outcome impact. No weighting is applied in Practice to Business Outcome Impact Ratio calculation and Business Outcome aggregated scores. Business Outcome aggregated score is the average of all practices answered that impact the outcome.

• Advanced: Three levels (Must Do Well, Should Do Well, Nice if Done Well) of Practice To Business Outcome impact. Weighting (Must Do Well (5x), Should Do Well (3X), Nice if Done Well (1X)) is applied in Practice to Business Outcome Impact Ratio calculation and Business Outcome Agility Stage average score. Business Outcome Agility Stage average score (0-4) is a weighted average that takes into account the number of practices that impact the outcome, the average agility stage vote for each practice, and the magnitude of the impact.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Lean Agile Intelligence Improvement & Measurement Model

Enterprise

Unit

Program

Team

Self

For Every Level of Today’s Agile Organization……

Measure Strategic Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

Lean Agile Intelligence Improvement & Measurement Model: Team Level

Measure Strategic Objectives

Self-Assess

Tactical Goals

Consider Team Context• What outcome are we looking to achieve

given our context?• Do we have clear priorities and does it align

to the organization's goals for the year?• What do we need to focus on to help us get

there?• What are some of the team challenges? • How are we going to measure that outcome?

Consider Organization Context• What is the purpose and mission?• What are the strategic goals and how can we

contribute?

Strategic Objectives: Assessment Templates

Frameworks• Assessment Templates derived from the

core reference guide of the following frameworks:

• Scrum• Kanban• XP• SAFe• Essential SAFe• Lean Startup

Curated• Curated (framework agnostic) Assessment

Templates focus on specific areas of practice and are influenced by Agile and Lean thought leaders. Existing Templates include:

• Team Fundamentals• Team Culture• Spotify Team Health• DevOps• Technical Excellence• Scrum Plus• Enterprise Agility

Custom• Want the best of both worlds? Build

your own template using the Lean Agile Intelligence Assessment Template Builder.

• Pick and choose practices from our Framework and Curated assessments to tailor an assessment template unique to your objectives, culture, and challenges.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Answers to those questions will give you the insights needed to determine what business outcomes your assessment template should be geared towards and which practices it contains. Lean Agile Intelligence offers a variety of different assessment template types.

View an Assessment Template in the Builder by choosing an Assessment Template and Selecting “Open”

Strategic Objectives: Assessment Template BuilderMeasure Strategic

Objectives

Self-Assess

Tactical Goals

Add your own Custom Practices

Select Practices for your Template

Framework/Curated View of Practice Catalog

Name of TemplateOpen Existent Template

Practice Dimensions: Logical Grouping ofPractices

Practice to Business Outcome Impact Ratio: Weighted Ratio of Practices in the Template that Impact the Business Outcome

Impacted Outcomes

Practices in Template

Reference(s) Used To Create Practice Criteria

Save an ExistingTemplate and Customize it

Hover over practice impact ratio to see a breakdown of the number of practices in the assessment template and the weighting impacting the outcome.

Delete any customtemplate

Strategic Objectives: Practice CriteriaMeasure Strategic

Objectives

Self-Assess

Tactical Goals

Impacted Outcomes

Practice Name

Agility Stages

Agility Stage Criteria presented to the Team during “Self-Assessment”

Copy & Customize

Click a Practice to see the Criteria in each Agility Stage that will be presented to the Team during a Self-Assessment.

Strategic Objectives: Assessment Template Auto GeneratorMeasure Strategic

Objectives

Self-Assess

Tactical Goals

Customize Number Of Practices in Template

Choose/Weight the Outcomes that you want your Assessment Template Practices to Impact

Hover over the Business Outcome Names to see the LAI Definition

Choose to Include/ExcludeSAFe Practices

Lean Agile Intelligence will generate a tailored Assessment Template given your unique desired outcomes

Generate the Assessment Template when you have a total of 100% and the Assessment Template willopen in the Builder

• What practices will help us achieve our desired outcomes?

• How are we performing in those practices?• Who is best to provide this information?

Measure Strategic Objectives

Self-Assess

Tactical Goals

Self-Assess: Facilitator Checklist

• Ensure that all members of your team are active members of LAI, and are assigned to the correct teams.• Remind participants (team members) that they will be receiving a link from Lean Agile Intelligence to

participate in an assessment.• Remind participants (team members) of the Voting Guidelines; stage criteria should be read left to right.

When criteria is encountered that they feel their team does not meet, the previous stage should be selected.

• Encourage participants to record notes on “why” they voted for the selected Agility Stage on each practice.

• The assessment will have to be “launched” for the specific team in order for the assessment to be answered by team members.

• Decide if the team will get more value of taking the assessment as a group in real time, or individually, and then reviewing the results together.

• Facilitators can monitor the completion of individual assessments using the Self Assessment Platform. They will also receive an email when each participant has completed the assessment.

• When the individual facilitation type is used, facilitators should schedule a meeting to review the results when all votes are received. The Practice Details Results Tab should be used for this review. At this time practices can be marked as goals or impediments.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Self-Assess: Conducting Self AssessmentsMeasure Strategic

Objectives

Self-Assess

Tactical Goals

1. Choose Assessment Template & Launch

2. Select Type and Team 3. Launch Self-Assessment Platform

All Members who are assigned to the team will receive an email with a link to the “Self-Assessment” after the assessment is launched.

Self-Assess: Facilitation Measure Strategic

Objectives

Self-Assess

Tactical Goals

Group Assessment Type : Self-Assessment is conducted in real time with all Team Members present in the Self-Assessment Platform.

Lowest, Highest, & Average Agility Stage Votes Appear After All Votes Are Received orAdmin ends the Voting

Agility Stage Criteria used to Self-Assess

Team Members present in the Self-Assessment Platform

Number of People out of Total Participants that have provided an Agility Stage Vote for the Practice

Unique Link to Self-Assessment

Admin Controls

Jump Back to a PreviousPractice

Proceed to Next Practice:Can also be used to force Result Calculations although not all Votes are received

Suspend Assessment to resume at another time or Terminate Assessment

Participants can record notes on each practice by selecting this icon

If selected all team members will be able to view notes

Practice can be marked as a “Growth Goal” Practice can be marked as an “Impediment”

Clears All Votes

Agility Stage Criteria used to Self-Assess

Practice Name: Order is By Practice Dimension

Self-Assess: Facilitation Measure Strategic

Objectives

Self-Assess

Tactical Goals

Individual Assessment Type : Self-Assessment is completed separately by each Team Member. Note, Results will not be available until all Members have completed the Self-Assessment. New team members can be added via the ”Invite Members” section, even after an individual assessment has been launched. They will receive an email to take the assessment.

Practice Name: Order is By Practice Dimension

Agility Stage

Agility Stage Criteria used to Self-Assess

Voting Buttons

Team Members who are participating in theassessment. Those highlighted in white have completed the assessment

Jump Back to a Previous Practice

Suspend Assessment to resume at another time

Cancel For Entire Team: No Results will be saved

Saves and Calculates Team Results to be viewed in the Dashboard. This is used if you wantto end an assessment prematurely

Anyone can record notes by selecting this icon

Self-Assess: Facilitator & Team Member Notes

• It is encouraged that facilitators and team members add notes to each practice in the Self Assessment Platform providing context on “why” they voted for the selected Agility Stage.

• In order to prevent opinion anchoring and group think, notes are only viewable in Group mode once the facilitator selects the “Mark to View Notes” button.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Participants can record notes on each practice by selecting this icon

Facilitator should select this button when they want the team to see all team member notes

View Notes Icon is enabled when Facilitator Select “Mark to View Notes”

Measure Strategic Objectives

Self-Assess

Tactical Goals

• What short term tactical goals can we set to achieve our desired outcomes?

• Do we have any impediments that are out of control preventing us from improving in the practice?

• What leading metrics can we use to measure our progress?

Tactical Goals: Mark As Growth Goal

• Practices marked as “Growth Goals” are those that the team is attempting to advance to the next Agility Stage

• When using the Group Facilitation Type, the practice can be marked as a “Growth Goal” in the Self-Assessment Platform in real time.

• When using the Individual Facilitation Type the facilitator can mark practices as “Growth Goals” by opening the practice from the Practice Details Result Dashboard and selecting the “Mark as Growth Goal” button.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Mark Practice as “Growth Goal” during group assessment

Select Practice in Practice Details Results Dashboard to Mark it as a “Growth Goal”when reviewing individual assessment

results with the team

Tactical Goals: Mark As Impediment

• Practices marked as “Impediments” are those that the team cannot advance to the next Agility Stage because of a blocker that is out of their control.

• When using the Group Facilitation Type, the practice can be marked as a “Impediment” in the Self-Assessment Platform in real time.

• When using the Individual Facilitation Type the facilitator can mark practices as “Impediment” by opening the practice from the Practice Details Result Dashboard and selecting the “Mark as Impediment” button.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Mark Practice as “Impediment” during group assessment

Select Practice in Practice Details Results Dashboard to Mark it as a “Impediment”when reviewing individual assessment

results with the team

Tactical Goals: Results Practice Details Tab

Goals and Impediments can be viewed at the Group and Organization level by first selecting the selecting the Group on the left and then hovering over the goal or impediment you want to see. All teams in that Group or Organization will appear.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Hover to see teams in Group or Organization that haveImpediments in that Practice

Hover to see teams in Group or Organization that haveGrowth Goals in that Practice

Tactical Goals: Results Practice Details TabLean Agile Intelligence Practice Details tab provides teams a holistic view of team/group health, while also enabling teams to easily identify tactical goals that lead to their desired outcomes.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Practices that have been included in Self-Assessments Completed by the Team or Group. Click practices to see your response. Practice Sort Order is by Practice Dimension.

Current Agility Stage of the Team or Group. If Group, it is the average of all the Teams in the Group.

Agility Stage Trend since thelast time the Team or Group

voted on the Practice. Hover for previous stage.

Variability is the amount of consensus the team has on their Average Agility Stage. Hover for rating.

The Criteria of the current Agility Stage in which the Team votes averaged.

The Criteria of the nextAgility Stage in which the Team should inspire to get to.

Average of all the Practices answered by the Team or Group and the Trend since the last completed Assessment.

Indicates that the practice hasbeen marked as an “Impediment”

Indicates that a practice has been marked as “Growth Goal”

Notes from all Team Memberswill appear here.

Tactical Goals: Results Practice Details TabFacilitators can update “Notes” of a Practice or Mark them as “Impediments” or “Growth Goals” from the Practice Details Results Tab.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Practices that have been included in Self-Assessments Completed by the Team or Group. Click practices to add Notes or Mark Practice

Tactical Goals: Practice Results Ranking System

• Lean Agile Intelligence provides intelligence to help the teams identify practices to focus on and goals to set

• The Practices to Improve Gadget utilizes the Practice Results Ranking System, and displays the top four practices the team should focus on

Order of priority goes from left to right

Name of Practice

Outside colors and sizes represent the different Business Outcomes and the magnitude of the impact

Measure Strategic Objectives

Self-Assess

Tactical Goals

Measure Strategic Objectives

Self-Assess

Tactical Goals

• Did we meet our tactical goals and did we do what we said?

• Is it helping us achieve our desired outcome?• Do we have organization constraints that are

slowing us down? • Do we need to continue improving in these

practices, or should we try some others?

Measure: Determine Leading Indicators

• Team and groups should proactively pick the metrics that will help them track their progress towards their desired outcomes so they can baseline and incrementally measure progress

• Identify Leading Indicators that will help measure if you are on track to achieve your tactical goal

Measure Strategic Objectives

Self-Assess

Tactical Goals

Time to Market Customer Satisfaction

Employee Satisfaction

Innovation Responsiveness Reliability Predictability

Throughput(Velocity)

NPS Happiness Index # of New Products Released

Product/ Project Lead Time

Test Coverage Story Point Attainment

Build Time Value Points Team Health Assessment

Bug Fixing vs New Product

Development %

Feature Lead Time Builds Per Day Velocity Variation

Deployment Lead Time

Cost of Delay Code Complexity

New Environment Automation

Failed Deployments

Measure: Metrics Module

Lean Agile Intelligence Metrics Module, located on the Results page, provides the ability for teams to track their metric progress and see it in conjunction with their Assessment Results.

Define Name of Metric

Define 5 unique Metrics for each Team/Group and update Values and Trends

Measure Strategic Objectives

Self-Assess

Tactical Goals

Set Value of Metric

Set Trend of Metric

Metric Value

Metric Trend

Metric Name

Measure: Determine Lagging Indicators

• Team and groups should proactively pick the metrics that will help them track their progress towards their desired outcomes so they can baseline and incrementally measure progress

• Identify Lagging Indicators to see if your tactical improvements are moving the needle

Measure Strategic Objectives

Self-Assess

Tactical Goals

Time to Market Customer Satisfaction

Employee Satisfaction

Innovation Responsiveness Reliability Predictability

Number of Releases ROI Attrition New Customer % New Project/Product Cycle Time

Escaped Defects in Prod

On Time Delivery Rate

Project/Product Cycle Time

Revenue Yearly Surveys New MarketsEntered

New Feature Cycle Time

Availability

Feature Cycle Time Profit Number of Production

Deployments# of Prod

Deployments

Measure: Tracking Progress of Leading Indicators Measure Strategic Objectives

Self-Assess

Tactical Goals

Track leading indicators to see if the team is progressing towards the goal

Measure: Track Progress of Lagging Indicators Measure Strategic Objectives

Self-Assess

Tactical Goals

Track lagging indicators to see if the tactical improvement is leading to desired outcomes

Measure: Track Organization Patterns Measure Strategic Objectives

Self-Assess

Tactical Goals

Look at patterns across the organization to identify possible organization constraints

Measure: Team Insights Canvas

Date of the last assessment completed

Organization Structure Tree; lists clickable teams and groups

Number of practices for each business outcome that have been marked as an impediment or goal

Top 4 practices that had the most and least vote variation

Percentage of teams that have Completed an assessment in the indicated time frame

Select business outcome in the “Business Outcome Summary” to filter the summary by a specific business outcome

Number of assessment templatesused by the team or group

Team/Group/Organization Name

Practice to Business Outcome Impact Ratio: Ratio of Practices in the Result Setthat Impact the Business Outcome

Average of all practice scores that impact the outcome

Average Stage of all practices that impact the outcome and trendsince last assessment

Answered practices and scores by time period for each practice dimension

Team/Group Metrics and Trends

On group level, hover over practice marked as a goal or impediment to see what teams have marked this practice as a goal or impediment.

Overall Average of all practicesanswered

Trend Periods:Team – By assessmentGroup – By quarter

Measure Strategic Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

Lean Agile Intelligence Improvement & Measurement Model: Enterprise Level

Improvement Model – Enterprise Level• Lean Agile Intelligence provides a platform that enables leadership to assess their Agility,

and better understand changes necessary to achieve desired Business Outcomes

Measure Strategic Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

• The Enterprise Agility Assessment can be conducted with leadership to identify what Agile and Lean Practices they want to adopt given their desired business outcomes

• Team Assessments can then be deployed to teams so that patterns can be identified preventing the organization from reaching those goals

Legend for Agility Stage

Impacted Business Outcome

Average score (0-4) of all the practices that impact the business outcomes mapped to the LAI Agility Stages

Hover to see the average score

The percentages of practices in the assessment template that impact the business outcome

Improvement Model – Enterprise Level

Improvement Model – Business Unit Level• Lean Agile Intelligence provides a holistic view to help determine if your organization is

progressing towards its goals. Each team in a unit may use a different methodology or have different needs. By consolidating cross assessment and cross team results in a consumable and actionable format, organizational constraints, coaching needs, and investment opportunities can be identified.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

• Tailor team assessments unique to each teams methodology, objectives, and challenges using the Assessment Template Builder

• Conduct Quarterly Assessments, resulting in Measureable Goals

• Analyze constraint patterns across the organization that may be impacting teams

Improvement Model – Program Level• Large Enterprises often have several teams collaborating together on a large initiative.

There are a number of Agile at Scale practices available that will help facilitate this arrangement and deliver value to the customer sooner. These Agile at Scale practices are part of our Practice Catalog and can be used to assess multiple teams and aggregate the results.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Enterprise

Unit

Program

Team

Self

• Tailor an assessments that includes both Agile at Scale and team practices

• Conduct Quarterly Assessments, resulting in Measureable Goals for the program

Improvement Model – Self (Individual Role) Level• Do people have the training, knowledge, availability, and support they need to do

their job effectively? What are the growth goals of each individual that will make them and their team better? Lean Agile Intelligence can be used to conduct individual self assessments.

Measure Strategic Objectives

Self-Assess

Tactical Goals

Organization

Unit

Program

Team

Self

• Build Role Specific Assessments for POs, SMs, Team Members, and Leadership to identify areas individual growth

Appendix

Advanced Calculations

Setup: Simple Calculations vs Advanced

Status• Simple: One level of Practice To Business Outcome impact. No weighting is applied in Practice to Business

Outcome Impact Ratio calculation and Business Outcome aggregated scores. Business Outcome aggregated score is the average of all practices answered that impact the outcome.

• Advanced: Three levels (Must Do Well, Should Do Well, Nice if Done Well) of Practice To Business Outcome impact. Weighting (Must Do Well (5x), Should Do Well (3X), Nice if Done Well (1X)) is applied in Practice to Business Outcome Impact Ratio calculation and Business Outcome Agility Stage average score. Business Outcome Agility Stage average score (0-4) is a weighted average that takes into account the number of practices that impact the outcome, the average agility stage vote for each practice, and the magnitude of the impact.

Strategic Objectives: Assessment Template BuilderMeasure Strategic

Objectives

Self-Assess

Tactical Goals

Add your own Custom Practices

Select Practices For your Template

Framework View of Practice Catalog

Name of Template

Open Existent Template

Agility Dimensions: Practice Areas of Focus

Magnitude of Impact to Outcome. In simple calculations, only Directly impacted is used

Practice to Business Outcome Impact Ratio: Weighted Ratio of Practices in the Template that Impact the Business Outcome

Impacted Outcomes

Practices in Template

Reference(s) Used To Create Practice Criteria

Save, customize, and delete an Existing Template

Hover over practice impact ratio to see a breakdown of the number of practices in the assessment template and the weighting impacting the outcome.

Strategic Objectives: Practice CriteriaMeasure Strategic

Objectives

Self-Assess

Tactical Goals

Magnitude of Impact to Outcome

Impacted Outcomes

Practice Name

Agility Stages

Agility Stage Criteria presented to the Team during “Self-Assessment”

Copy & Customize

Click a Practice to see the Criteria in each Agility Stage that will be presented to the Team during a Self-Assessment.