SETIG Systems (Un)Conference

Update

AEA 2016

2015 Follow-up Survey

7%

23%

23%

48%

Yes,frequently

Notimeoropportunity, butwouldliketo(orplanto)

Notatall

Yes,occasionally

Over half of 2015 participants are using new knowledge or skills learned from the (Un)Conference.

(n=31)

Connecting with like-minded colleagues who are interested

in learning together and sharing

resources about systems.

Great conversation

with other evaluators

about systems evaluation.

The fostering of a community, which is

definitely promoted by the kind of event you organized, is very

important - keep on doing it!

Being new to systems evaluation the most useful things … were

[the] basics... and being able to "listen in" on the

conversations in various rooms by those

with more experience and expertise.

29%

71%

Yes

No

Fewer participants connected with someone they met through the 2015 (Un)Conference.

(n=31)

11%

0%

11%

22%

56%

5ormore

4people

3people

2people

1person

For those that did connect, the majority connected with one person.

(n=9)

• connecting with like-minded others • the informal unconference environment • great resources shared • a novel way to learn and connect

• length (three days too much) • encourage more active participation and

conversation • develop clearer focus

Western Hemisphere

69 attendees

Eastern Hemisphere

29 attendees69

51

80

127

191

188

220

249

2016

Day3

Day2

Day1Attended

2016 Western Hemisphere attendance was lower than the previous year. And registration continues to be double actual attendance.

2015

Registered

The Eastern Hemisphere session met more participants’ expectations.

76%

24%

Americas

92%

8%

DownUnderWestern Hemisphere Eastern Hemisphere

n=46 n=24

n=24n=46

4%

4%

8%

4%

15%

4%

4%

4%

4%

4%

6%

8%

20%

47%

25%

50%

50%

30%

50%

49%

58%

49%

63%

46%

42%

38%

33%

27%

38%

Stronglydisagree Disagree Neutral Agree StronglyAgree

Registration processstraightforward

Received informationneeded prior to

(Un)Conference

None or few problems with (Un)Conference

software

I increased my knowledge of the topic

People still experience problems with the technology.

4%

4%

11%

4%

11%

8%

27%

8%

16%

13%

42%

33%

47%

50%

40%

9%

16%

54%

27%

42%

45%

87%

Stronglydisagree Disagree Neutral Agree StronglyAgree

Feel more connected to

colleagues

Good valuefor time spent

Would attend another

(Un)Conference

n=24n=46

The Eastern Hemisphere session had more positive outcomes.

2.0

3.3

3.3

4.2

2.0

3.7

1.7

2.4

3.3

3.8

4.5

4.3

4.4

4.5

4.3

3.2

3.0BasicsofSystemsinEvaluation:GettingOrientedBridgingtheKnow-DoGap:PraxisforSystems-orientedEvaluation

DesigningaSystems-basedEvaluation:ChallengesandStrategies

UsingaComplexAdaptiveSystemsApproach:Real-lifeExamples

DistinguishingSystemsEvaluation:WherearetheBoundaries?

DesigningUsefulSystemsVisualizations:Tools&Strategies

AssistingtheDesignofComplexPrograms:Real-lifeExamples

IdentifyingSystemLeveragePoints:HelpfulApproaches

Similarities&DifferencesbetweenDesignvs.SystemsThinking:AppliedtoEvaluation

ImportingToolsfromtheDesignWorldintoSystemsEvaluation:ThinkBig!

SupportforaSystemsApproach:StrategiesforPromotingBuy-in

Some Western hemisphere sessions were rated higher than others. The first session was usually rated higher than the second.

4.2

5.0

5.0

3.8

4.8

4.0

4.7

4.0

5.0

4.0

4.0

5.0

4.0

BasicsofSystemsinEvaluation:GettingOriented

Systemsthinkingandcomplexitymethods&toolswemightuseinevaluation

Thinkingsystemicallywhentacklingavalueformoneyinevaluation

AsystemicapproachtoevaluatingWhānauOrainaPasifikacontext

UsingaDevelopmentalEvaluationApproachinSystemsEvaluation

Theculturalfitofsystemsthinkinginindigenousevaluationcontexts

Eastern hemisphere sessions, both first and second, were rated more highly. Suggestions for improvement

Have fewer breakout rooms to ensure rooms are full.

Add brief position statements to each room to help set the tone for discussion.

Ensure each room has a facilitator to take the lead with topic suggestions and shape discussions, especially in sessions with a lot of beginners.

Use a technology which is less likely to be blocked by some employer firewalls, i.e. government. Encourage and support more people to attend and fully participate in the (Un)Conference.

Participants want to learn more about… Actual techniques and methods for systems evaluations.

How design, evaluation, and systems thinking overlap.

What defines systems thinking from regular evaluation.

How to balance different values that stakeholders bring when tough decisions need to be made about resource allocations.

Determining the boundaries of a system and how to facilitate that conversation with clients.

…Process lots of new insights I can

add into my work - far more than one.

…Connect more regularly to the Systems group at AEA in some way. Brief occasional meetings aren't a

substitute.

Going forward participants will….

2016 Committee Members Bethany Laursen Judy Oakden Jan NogaKylie HutchinsonGinger Fitzhugh Jenny LawlorJen NunezAlana Robilliard

Special thanks to Heather Britt Brandon Coffee-Borden Bob Williams