Using a Developmental Using a Developmental Approach to Evaluating Approach to Evaluating

Innovative Extension Innovative Extension ProgramsPrograms

Kathleen Kelsey, Grape CoP

Oklahoma State University

Sarah Baughman, Network Literacy CoP

eXtension

1. Ongoing development or adapting an intervention to new conditions

2. Adapting effective general principles to a new context

3. Developing a rapid response to a major change

4. Pre-formative development of a potentially scalable innovation or getting an intervention ready for a summative evaluation

5. Major systems change and cross-scale evaluation to provide feedback about how the intervention is unfolding and how it may need to be adapted for broader application.

(p. 21-22)

PlanningPlanningWhy Developmental Approach?Why Developmental Approach?Grapes

• Collaborative approach of community of practice

• Exploration of what is being developed and what is emerging

• Sustainability or what’s next

Network Literacy

• CoP leaders looking for a more “flexible” evaluation process that allowed for outcomes to emerge and change

• Ultimately looking for system change

• Social media significant part of programming requiring rapid response

Finding an Evaluator Finding an Evaluator Why Us?Why Us?

Grapes Network Literacy

• Staff evaluator for larger MFLN

• Willingness to try different approach

Working with the evaluatorsWorking with the evaluators

Data CollectionData Collection

Reporting Reporting

Grapes

• Informal• Continuous• Included formal annual

reports for grant

Network Literacy

• Combination of informal reporting through conversations with leadership team

• Formal reporting to MFLN and Department of Defense on monthly basis

Cycling Lessons LearnedCycling Lessons Learned

• Critical friend role

Network Literacy

• Incorporates the informal and formal reporting into leadership team work

• Challenge to get membership and leadership of CoP to take action

• Heavy investment of time and effort

Where we are now and what we Where we are now and what we might changemight change

• Year 3 for Grape CoP, year 2 for Network Literacy

• NetLit still emerging based partly on challenges reaching target DoD audience

• Grapes ready to begin formative evaluation