Open Ended Responses:

How do we analyze?

Mid-Evaluation MeetingGeneva, Switzerland24-25 March 2010

2

Open Ended Text AnalysisHow can we analyze text?

First, we will need to retrieve responses from the Zoomerang output

Second, we will establish a recording system of all responses (A, B, D, 1, 2, 3, etc.)

Third, we will need to categorize responses into recurring concepts or themes.

Forth, we will need consensus in order to produce final analysis.

3

Open Ended Text AnalysisWhat will our process be?

Three team members will be assigned to each open ended question (from both the survey and the interview).

One person will be designated the “lead” for each question.

Each person will complete their individual analysis of the text by reading through responses and sorting them into common themes or categories.

The individual responses will then be synthesized by the team lead into one analysis.

The synthesized analysis will be circulated back to the other two team members for approval/discussion if necessary.

The final product will be accepted by the rest of the evaluation team as the final analysis of the specific question unless major concerns are raised.

4

Open Ended Text AnalysisDraft Example: John & Megan reviewed the current

responses for survey question #24

5

Open Ended Text AnalysisEach person came up with different categories but there was

some overlap in common themes.

6

Open Ended Text AnalysisFinal consensus is needed if this was the actual analysis.

In order to move forward with this example, the two different lists would need to be compared and synthesized (by the team lead as proposed).

Then, we would have a complete and final analysis of this specific question.

7

Open Ended Text Analysis

What do you think???