Goals, Measures, and Accountability Shelley H. Metzenbaum [email protected] U of MD Public Policy Env. Compliance Consortium Facility Reporting Project

Goals, Measures, and Goals, Measures, and Accountability Accountability Shelley H. Metzenbaum

[email protected] U of MD Public Policy

Env. Compliance Consortium Facility Reporting Project

State-EPA Symposium on Environmental Innovation and Results

January 2006

Metzenbaum - State-EPA Symposium on Environmental Innovation and Results Jan 24, 2006

Goals Boost Outcomes Goals Boost Outcomes and and

AccountabilityAccountability•FocusFocus•EnergizeEnergize•Encourage persistenceEncourage persistence•Stimulate discovery Stimulate discovery

andand•Clarify what will and won’t doClarify what will and won’t do


Measures Boost Measures Boost Outcomes Outcomes and and AccountabilityAccountability•MotivateMotivate• IlluminateIlluminate•CommunicateCommunicate• Inform choicesInform choices

andand•Report progress to publicReport progress to public• Inform advocacy and electoral choiceInform advocacy and electoral choice


Measurement Supports Measurement Supports Learning to Achieve Better Learning to Achieve Better OutcomesOutcomes

• DetectionDetection

• DiagnosticsDiagnostics

• DisseminationDissemination

• AssessmentAssessment

• Assumption ConfirmationAssumption Confirmation


DETECTIONDETECTION• Find problems needing attentionFind problems needing attention• Find solutions worthy of replicationFind solutions worthy of replication• Look for:Look for:

– Anomalies and outliersAnomalies and outliers– Direction and speed change Direction and speed change – PatternsPatterns– RelationshipsRelationships

• Measurement to trigger follow-up, Measurement to trigger follow-up, not always performance assessment not always performance assessment


DIAGNOSTICS:DIAGNOSTICS: Why? Look for causal Why? Look for causal connections.connections.

DISSEMINATIONDISSEMINATION : : Share goals, measures, Share goals, measures, lessons.lessons.

ASSESSMENT:ASSESSMENT:– Did it work? Replicate and expand.Did it work? Replicate and expand.– Did it fail? Stop and try again.Did it fail? Stop and try again.

ASSUMPTION CONFIRMATION ASSUMPTION CONFIRMATION


Accountability for Accountability for What? What? • OutcomesOutcomes

– Meeting target?Meeting target?

– Better than past?Better than past?

– Better than peers?Better than peers?

• Meeting output targetMeeting output target– Meeting target?Meeting target?

– Better than past?Better than past?

– Better than peers?Better than peers?• Outcome-focused way of working!Outcome-focused way of working!


Accountability for:Accountability for:• Outcome Emphasis w/TargetsOutcome Emphasis w/Targets• Measurement MasteryMeasurement Mastery• FeedbackFeedback• Interactive Inquiry Interactive Inquiry • Strategy CogencyStrategy Cogency• ExecutionExecution

Not for meeting a goal, beating the past, Not for meeting a goal, beating the past, or besting a peer !or besting a peer !


Bratton Accountability Bratton Accountability PrinciplePrinciple

“Nobody ever got in trouble because crime numbers on their watch went up. Trouble arose if commanders didn’t know why the numbers were up and didn’t have a plan to address the problems.”


Federal Role in Info Federal Role in Info AgeAge• Learning LeaderLearning Leader– Set a few strategic outcome-focused Set a few strategic outcome-focused

goals and enlist alliesgoals and enlist allies– Expect goal-setting by othersExpect goal-setting by others– Create and support a network that Create and support a network that

studies past experience and shares the studies past experience and shares the lessonslessons

• Basement Border Guard Basement Border Guard • Direct Delivery Back StopDirect Delivery Back Stop


To Learn More…To Learn More…• Forthcoming from IBM Center for the Forthcoming from IBM Center for the

Business of Government: “Creating Effective Business of Government: “Creating Effective Performance Accountability: Five Building Performance Accountability: Five Building Blocks and Six Essential Practices”Blocks and Six Essential Practices”

• www.complianceconsortium.org– Projects and ToolsProjects and Tools– ResourcesResources– Join us: Managing Environmental Join us: Managing Environmental

Information 2006Information 2006• http://governing.com/conf/mtech6re.htmhttp://governing.com/conf/mtech6re.htm

• www.facilityreporting.org (common reporting framework for performance leadership and other perf. focused programs)

• http://www.ksg.harvard.edu/visions/http://www.ksg.harvard.edu/visions/performance_management/memo.htmlperformance_management/memo.html

Documents

Goals, Measures, and Accountability Shelley H. Metzenbaum [email protected] U of MD Public Policy Env. Compliance Consortium Facility Reporting Project