Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
SETIG Systems (Un)Conference
Update
AEA 2016
2015 Follow-up Survey
7%
23%
23%
48%
Yes,frequently
Notimeoropportunity, butwouldliketo(orplanto)
Notatall
Yes,occasionally
Over half of 2015 participants are using new knowledge or skills learned from the (Un)Conference.
(n=31)
Connecting with like-minded colleagues who are interested
in learning together and sharing
resources about systems.
Great conversation
with other evaluators
about systems evaluation.
The fostering of a community, which is
definitely promoted by the kind of event you organized, is very
important - keep on doing it!
Being new to systems evaluation the most useful things … were
[the] basics... and being able to "listen in" on the
conversations in various rooms by those
with more experience and expertise.
29%
71%
Yes
No
Fewer participants connected with someone they met through the 2015 (Un)Conference.
(n=31)
11%
0%
11%
22%
56%
5ormore
4people
3people
2people
1person
For those that did connect, the majority connected with one person.
(n=9)
• connecting with like-minded others • the informal unconference environment • great resources shared • a novel way to learn and connect
• length (three days too much) • encourage more active participation and
conversation • develop clearer focus
Western Hemisphere
69 attendees
Eastern Hemisphere
29 attendees69
51
80
127
191
188
220
249
2016
Day3
Day2
Day1Attended
2016 Western Hemisphere attendance was lower than the previous year. And registration continues to be double actual attendance.
2015
Registered
The Eastern Hemisphere session met more participants’ expectations.
76%
24%
Americas
92%
8%
DownUnderWestern Hemisphere Eastern Hemisphere
n=46 n=24
n=24n=46
4%
4%
8%
4%
15%
4%
4%
4%
4%
4%
6%
8%
20%
47%
25%
50%
50%
30%
50%
49%
58%
49%
63%
46%
42%
38%
33%
27%
38%
Stronglydisagree Disagree Neutral Agree StronglyAgree
Registration processstraightforward
Received informationneeded prior to
(Un)Conference
None or few problems with (Un)Conference
software
I increased my knowledge of the topic
People still experience problems with the technology.
4%
4%
11%
4%
11%
8%
27%
8%
16%
13%
42%
33%
47%
50%
40%
9%
16%
54%
27%
42%
45%
87%
Stronglydisagree Disagree Neutral Agree StronglyAgree
Feel more connected to
colleagues
Good valuefor time spent
Would attend another
(Un)Conference
n=24n=46
The Eastern Hemisphere session had more positive outcomes.
2.0
3.3
3.3
4.2
2.0
3.7
1.7
2.4
3.3
3.8
4.5
4.3
4.4
4.5
4.3
3.2
3.0BasicsofSystemsinEvaluation:GettingOrientedBridgingtheKnow-DoGap:PraxisforSystems-orientedEvaluation
DesigningaSystems-basedEvaluation:ChallengesandStrategies
UsingaComplexAdaptiveSystemsApproach:Real-lifeExamples
DistinguishingSystemsEvaluation:WherearetheBoundaries?
DesigningUsefulSystemsVisualizations:Tools&Strategies
AssistingtheDesignofComplexPrograms:Real-lifeExamples
IdentifyingSystemLeveragePoints:HelpfulApproaches
Similarities&DifferencesbetweenDesignvs.SystemsThinking:AppliedtoEvaluation
ImportingToolsfromtheDesignWorldintoSystemsEvaluation:ThinkBig!
SupportforaSystemsApproach:StrategiesforPromotingBuy-in
Some Western hemisphere sessions were rated higher than others. The first session was usually rated higher than the second.
4.2
5.0
5.0
3.8
4.8
4.0
4.7
4.0
5.0
4.0
4.0
5.0
4.0
BasicsofSystemsinEvaluation:GettingOriented
Systemsthinkingandcomplexitymethods&toolswemightuseinevaluation
Thinkingsystemicallywhentacklingavalueformoneyinevaluation
AsystemicapproachtoevaluatingWhānauOrainaPasifikacontext
UsingaDevelopmentalEvaluationApproachinSystemsEvaluation
Theculturalfitofsystemsthinkinginindigenousevaluationcontexts
Eastern hemisphere sessions, both first and second, were rated more highly. Suggestions for improvement
Have fewer breakout rooms to ensure rooms are full.
Add brief position statements to each room to help set the tone for discussion.
Ensure each room has a facilitator to take the lead with topic suggestions and shape discussions, especially in sessions with a lot of beginners.
Use a technology which is less likely to be blocked by some employer firewalls, i.e. government. Encourage and support more people to attend and fully participate in the (Un)Conference.
Participants want to learn more about… Actual techniques and methods for systems evaluations.
How design, evaluation, and systems thinking overlap.
What defines systems thinking from regular evaluation.
How to balance different values that stakeholders bring when tough decisions need to be made about resource allocations.
Determining the boundaries of a system and how to facilitate that conversation with clients.
…Process lots of new insights I can
add into my work - far more than one.
…Connect more regularly to the Systems group at AEA in some way. Brief occasional meetings aren't a
substitute.
Going forward participants will….
2016 Committee Members Bethany Laursen Judy Oakden Jan NogaKylie HutchinsonGinger Fitzhugh Jenny LawlorJen NunezAlana Robilliard
Special thanks to Heather Britt Brandon Coffee-Borden Bob Williams