JUDGES MEETING

1

Judges Meeting• The Judges Meeting

– Each Team will be assigned a date and time.• Each Senior Examiner will be expected to present

their process and findings in a standard format presentation.

• The Senior Examiner may appear in person, or by telephone (the presentation will be run for them at the Judges Meeting site).– The Support Senior, and/or SIT are welcome

and encouraged to sit in as a learning experience.

– Senior travel expenses are not reimbursed.

2

Judges Meeting Presentation

(Format Example)

3

Application Name and Number

4

Examination Team

5

Sm

arty

Pan

ts

Seni

or E

xam

iner

Mar

y S

mith

Su

ppor

t Sen

ior

John

Doe

Bill

Jon

es

Bar

by S

hrim

p

Han

g D

og

Roc

ky S

quirr

el

Bul

lwin

kle

Joe

Jets

on

Don

Wan

Num

ber o

f Pa

rtici

pant

s

Yrs As An Examiner 5 4 3 3 2 1 1 1 1 1 10

Years As A Senior Examiner 3 1

Other Assessment Experience X X X X

Previous Site Visit Experience X X X X

Completed Individual Evaluation X X X X X X X X X X 10

Prepared Category Summary X X X X X X 6

Participated in Consensus X X X X X X X X 8

Participated in Site Visit X X X X X X 6

Prepared Category Feedback X X X X X X 6

Examination Process Issues

• Anything that happened during the pre-Site Visit Examination Process that was out of the ordinary, or a process issue that should be brought to the attention of the Judges

6

Site Visit Process Issues

• Any special challenges, process upsets, or anything that occurred during (or after) the Site Visit that was or potentially was a problem, or any issue that should be brought to the attention of the Judges

7

Applicant Overview & Key Factors- SAMPLE

• Large Manufacturing operation facility located in San Diego

• 2,200 employees• 15 major product lines• Serve the west coast widget market• $37 million annual budget• Three market segments (educational,

government, and industrial widgets)• 1,200 suppliers• Regulated by EPA, OSHA, and FDA

8

Applicant Key Role Model Behaviors- SAMPLE

• Senior Leadership• Process Management• Community Involvement• Training

9

Applicant Key Opportunities for Improvement- SAMPLE

• Extent of deployment: not across all sites as appropriate

• Several practices but not always overall systematic approach

• Collecting lots of data, but no systematic approach to using results for evaluating performance and improvement

10

Site Visit

• Length of Site Visit (time actually on site)

• If multiple sites, those visited and the basis for their selection

• Approaches used to evaluate sites not visited

• Approximate number of employees interviewed (categories, shifts, etc.)– Interviews with Leadership and other

significant individuals/teams• Other relevant information affecting the

site visit 11

Major Site Visit Issues Going to Site Visit- Sample

• Absence of results• Absence of action plans: “available

on site”• Verify extent of deployment across all

sites as appropriate• Verify systematic approach to

improvements

12

Major Site Visit Findings- Sample

• Substantial competitive comparative data is lacking

• Scores were reduced in many data areas, due to the lack of competitive data

• Validated the deployment of refined Business and Support Processes

13

Site Visit Scoring Changes

14

Item No.

Pre- Site Visit

Post- Site Visit

Reason for Change

Items that changed a Score Band.

Score History

• Stage 1, Individual Examiner Average Score = 538

• Stage 2, Consensus Score = 554• Stage 3, Site Visit Final Score = 572

• Score Range = 551 – 650• Team Award Recommendation = Silver

15

Examination Process Strengths

• Examination Process Strengths in general or specific process strengths.

• Processes that worked unusually well in this examination.

16

Examination Process OFIs

• Opportunities where the Examination Process in general could be improved.

• Something that happened in this particular examination process that could have been handled better.

17

WRAP UP

• Questions?• Comments?

18

Thank You!

19