Shejeh Salam MELP approved

This publication was produced for review by the United States Agency for International Development. It was prepared by DT-GLOBAL.

SHEJEH SALAM

MONITORING, EVALUATION & LEARNING PLAN (MELP) PERIOD: SEPTEMBER 2020-OCTOBER 2025

Monitoring, Evaluation & Learning Plan | Shejeh Salam i

SHEJEH SALAM

MONITORING, EVALUATION & LEARNING PLAN (MELP) PERIOD: SEPTEMBER 2020-OCTOBER 2025

Dates: September 30, 2020 to October 1, 2025

Contract: 72066820c00003

SHEJEH Salam Address: Kololo Road, Juba, next to the Immigration Office

Contracting Officer’s Representative: Victor Lako

DISCLAIMER:

The authors’ views expressed in this document do not necessarily reflect the views of the United States Agency for International Development or the United States Government.

Monitoring, Evaluation & Learning Plan | Shejeh Salam ii

TABLE OF CONTENTS

LIST OF ACRONYMS III

INTRODUCTION AND OVERVIEW 1 GOALS AND OBJECTIVES OF SHEJEH SALAM 2

LOGICAL MODELS 3 THEORY OF CHANGE 3

RESULTS FRAMEWORK 4

INDICATOR SELECTION, REVISION, AND PERFORMANCE MONITORING 5

MANAGEMENT OF THE SHEJEH SALAM MEL PLAN 19 SHEJEH SALAM APPROACH TO CLA AND MEL 19

ACTIVITY, CLUSTER AND PROGRAM-LEVEL MEL MANAGEMENT 20

DATA QUALITY ASSURANCE 23

DATA ANALYSIS AND REPORTING 26

PERFORMANCE REPORTING SCHEDULE 27

MEL TEAM MANAGEMENT 27 ROLES AND RESPONSIBILITIES 27

MEL ORGANIZATIONAL CHART 28

ANNEX 1: DATA COLLECTION TOOLS AND FEEDBACK LOOPS 29

ANNEX 2: PERFORMANCE INDICATOR REFERENCE SHEETS 31

Monitoring, Evaluation & Learning Plan | Shejeh Salam iii

LIST OF ACRONYMS ADS Automated Directives System COP Chief of Party CO Contracting Officer COR Contracting Officer’s Representative CSO Civil Society Organization DO Development Objective DQA Data Quality Audit ERF Environmental Review Form FAA Fixed Award Agreement FAF Foreign Assistance Framework FAR Federal Acquisition Regulations FGD Focus Group Discussion GIF Grant Idea Form GIS Geospacial Information System GL Green Light GUC Grants Under Contract IKGA In-kind Grant Agreement IP Implementing Partner IR Intermediate Result M&E Monitoring & Evaluation MEL Monitoring, Evaluation, and Learning MELS Monitoring, Evaluation, and Learning Support NGO Non-Governmental Organization PDO Program Development Officer PIRS Performance Indicator Reference Sheet PMP Performance Management Plan PVO Private Voluntary Organization RFQ Request for Quote RTL Regional Team Leader SOW Scope of Work SRS Strategy Review Session STTA Short-Term Technical Assistance STCM Sudan Transition and Conflict Mitigation program TAP Transition Activity Pool US United States USAID United States Agency for International Development YL Yellow Light

Monitoring, Evaluation & Learning Plan | Shejeh Salam 1

INTRODUCTION AND OVERVIEW This Monitoring, Evaluation, and Learning Plan (MELP) has been developed based on the contract between USAID and DT Global, contract number 72066820c00003dated August 12, 2020 to support the successful implementation of the Shejeh Salam activity. The writing of this AMELP adheres to the mandatory and non-mandatory requirements, guidance and instruction found in USAID ADS Chapter 201“Operational Policy for the Program Cycle,” USAID, Shejeh Salam documents and DT Global best practices.

This MELP documents the Theory of Change (TOC) and details the specific indicators and methodology that will be employed to test and validate it over the life of the program. The MEL Plan feeds into the evidence base for all decision-making processes, integrating planning, implementation, management, and monitoring. This is a management tool designed to be used by the Shejeh Salam management team, implementers, and donors to ensure a quality process for assessing and reporting progress toward achieving results. The Shejeh Salam MEL Plan serves to:

1. Define specific performance indicators at output and outcome levels and delineate baselines and targets;

2. Specify data quality and management processes as a reference for Shejeh Salam staff and to meet quality standards for data and data management;

3. Provide insights into the validity of the TOC and Logical Framework;

4. Incorporate relevant data collection requirements into activities to meet USAID reporting requirements and management information needs;

5. Articulate the program’s strategy for learning with a continuous feedback loop;

6. To support program accountability through the systematic collection of data; and

7. To facilitate the production of evidence-based analysis to be communicated to internal and external audiences.

The MEL Plan contributes to the accuracy and effectiveness of the performance monitoring system by assuring that comparable data will be collected on a regular and timely basis. The MEL Plan supports reliable data collection by documenting the frequency and schedule of data collection and assigning responsibilities and designations within the Activity rather than specific individuals.

In all of its programs, DT Global places an emphasis on continuous quality improvement and a consistent “feedback loop” between implementation, monitoring, and stakeholder teams, to continually enhance performance and maintain accountability and responsiveness to beneficiaries. To maximize Shejeh Salam’s impact, all DT Global interventions and related activities will be built on a solid, evidence-based foundation, along with local buy-in and ownership. The MEL approach for Shejeh Salam builds on DT Global's extensive experience in South Sudan (formerly as AECOM), on behalf of USAID and other donors. The Shejeh Salam approach builds on lessons learned and systems design that have proven effective in this unique context. Using the approach of continuous process and implementation monitoring, coupled with up-to-date situational analysis, enables the team to respond proactively to shifting priorities and circumstances on the ground.


REVIEWING AND UPDATING THE MONITORING, EVALUATION, AND LEARNING PLAN

The MEL Plan serves as a ‘living’ document that the Shejeh Salam team regularly uses to guide overall activity performance. As an internal quality control measure, the MEL Plan will be reviewed (and revised if needed) at least annually to incorporate activity learning. The following questions are considered during the review process:

● Are the performance indicators functioning as intended in the design process?

● Have any of the critical assumptions underlying the logical framework, indicators, and targets changed during implementation? These assumptions may include contextual shifts that may influence changes in implementation that may call for revision of this MELP.

● What data/information gaps exist and what processes can be improved or added to fill them?

● What is the quality of the data at present, and how can data quality be improved, safeguarded, and preserved?

As per ADS 201, the Chief of Party (COP) will submit any proposed changes to the MEL Plan along with the rationale for those changes, to USAID for review and approval.

GOALS AND OBJECTIVES OF SHEJEH SALAM

The overarching goal of Shejeh Salam is as follows:

The USAID/South Sudan Goal is to ‘Strengthen the foundation for a more self-reliant South Sudan.’ In furtherance of this Goal, USAID/South Sudan has aligned Shejeh Salam with its Mission Objective 3 ‘Improved Social Cohesions in Targeted Areas.’ This serves as Shejeh Salams overarching Goal.

To achieve progress against these Goals, Shejeh Salam will be working toward the achievement of the following four objectives:

1) Local actors are building crossline interdependence and intra-community cohesion to promote peace processes and peaceful co-existence

2) Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes

3) Key partners are providing trauma awareness services to communities

4) Print, radio, and other media are providing accurate, fair and thorough information to mitigate the destructive impact of rumor and misinformation

CONTEXT ANALYSIS

Currently South Sudan is in a transitional period following the signing of the Revitalized Agreement on the Resolution of Conflict in South Sudan (R-ARCSS) on September 12, 2018. The transitional period formally started February 2020 and is meant to continue for 36 months. This agreement formally ended the war between the government and the Sudan People’s Liberation Army/Movement in Opposition (SPLA/M-IO), and other opposition groups. This agreement has largely ended war-related violence which had plagued much of the country from December 2013 up until the signing of R-ARCSS, although some opposition groups, such as the National Salvation Front (NAS), remain outside of the agreement and conflict between them and the government is an ongoing source of violence in parts of the Equatoria region. The IO are now operating as the largest opposition block within the transitional government. The government, IO, and the South Sudan Opposition Alliance (SSOA – a coalition of smaller opposition parties) have split the administration of the country between them, with all of them


appointing different numbers of governors, ministers and county commissioners. Communities are still split between loyalty to the IO and the government, as well as other factions – and there remains great communal mistrust throughout the country due to the war. In the absence of large-scale war, cattle raiding and revenge killing have once again taken center stage as the predominant form of inter-communal conflict. Banditry and insecurity are also rife in much of the country, due as much to a poor economy as to the proliferation of small arms.

LOGICAL MODELS Logical models are critical to effectively monitoring and evaluating any program. The following theory of change, results framework, logical framework, and inputs matrix together make up the foundation for this work with the purpose of guiding implementation and connecting logic with actions to produce results. The theory of change is the development hypothesis which Shejeh Salam seeks to test over the life of the program. Comparatively, the results framework serves as a more structured representation of the TOC that connects inputs to outputs, outcomes, strategic objectives and the program goal; through it, the causal linkages between inputs and goals are delineated. Lastly, the logical framework connects inputs and indicators to the outcomes and objectives of the program as they are written in the results framework. Each of these models supports overall analysis of program progress towards enhancing stability by highlighting a different logical dimension of the Shejeh Salam approach.

THEORY OF CHANGE Table 1: Shejeh Salam Theory of Change

If… Then… Therefore…

If South Sudanese communities:

• have opportunities for peaceful interaction. • are represented by active civil society. • are aware of the impact of trauma on

themselves and their society. • and have access to professional and

unbiased media…

then communities will:

• experience the mutual benefits of social and economic interaction. • collectively participate in and advocate

for peace locally and nationally. • be psychologically prepared to engage in

peacebuilding. • be better informed and more resilient

to elite manipulation…

therefore: South Sudanese society will have the awareness, incentives, and capacities to protect and promote the peace and reconciliation process.

Assumptions Related to the Theory of Change:

• The benefits afforded by intra- and inter-communal interactions will outweigh the perceived benefits of violence and competition. • Civil society will take advantage of networking and capacity building opportunities to establish a common voice

advocating for peace and reconciliation. • Communities with greater access to information and trauma services will have increased resistance to violence • and co-optation by elites and will be more able to make and sustain intercommunal and intra-group agreements.

Risks Related to the Theory of Change:

• Incentives for violent resolution of conflicts (community norms, protection of family) are greater than incentives for non-violent resolution of conflicts, making support for peace mechanisms difficult. • Increasing stability will increase ‘strongmen’ power, solidify unequal gender roles, and entrench ethnic

marginalization in communities. • Increased trauma awareness re-traumatizes citizens. • Increased empowerment of media houses catalyzes government crackdown on media and access to reliable

information fuels grievances.


RESULTS FRAMEWORK

USAID/South Sudan Goal: Strengthen the foundation for a more self-reliant South Sudan

USAID/South Sudan Intermediate Result 3.1: Drivers of inter/intra communal conflicts mitigated

USAID/South Sudan Intermediate Result 3.2: Inclusive community networks strengthened

USAID/South Sudan Intermediate Result 3.3: Enhanced civil society capacity for inclusive civic engagement, particularly for women & youth

USAID/South Sudan Mission Objective 3, and Shejeh Salam Goal:

Improved Social Cohesion in targeted areas

Shejeh Salam Objective 1: Local actors are building crossline interdependence and intra- community cohesion to promote peace processes and peaceful co-existence

Shejeh Salam Objective 2: Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes

Shejeh Salam Objective 3: Key partners are providing trauma awareness services to communities

Shejeh Salam Objective 4: Print, radio, and other media are providing accurate, fair and thorough information to mitigate the destructive impact of rumor & misinformation

Shejeh Salam IR 1.1: Improved capacity of a wide range of local actors to engage constructively & to successfully mitigate perceived conflict issues

Shejeh Salam IR 1.2: Increased mutual interdependence resulting from infrastructure & livelihoods projects

Shejeh Salam IR 3.1: Stakeholders recognize signs of trauma and distress and are able toapproach intra- and inter-community engagement and dialogue with increased sensitivity

Shejeh Salam IR 2.1: Civil society and faith-based organizations, individuals and groups work together for effective peacebuilding, civic education, and reconciliation activities that resonate socially & culturally

Shejeh Salam IR 4.1: Community members access independent media outlets and participate in peaceful and purposeful debate, and are able to resist misinformation, disinformation and hate speech

Shejeh Salam IR 2.2: Citizen actors participate in processes supporting transitional justice and enhancing communities’ perceptions of justice that assist formal & informal peacebuilding efforts

Program level critical assumptions:1. Permissive security environment, 2. Permissive operational environment, 3. Program can continue addressing priorities without

undue interference from the government or opposition, 4. No negative local level conflicts arise as a result of

R-ARCSS implementation

Cross-Cutting Results

1. Increase gender and other minorities participation and empowerment in peace processes

2. Increase youth empowerment and livelihoods

Monitoring, Evaluation and Learning Plan | Shejeh Salam 5

INDICATOR SELECTION, REVISION, AND PERFORMANCE MONITORING

In developing the performance and context indicators for this MEL Plan, consultations were held with USAID/South Sudan. Indicators are reflective of the Missions Performance Management Plan (PMP) requirements, drawing from both the Foreign Assistance Framework Standard indicators, as well as from custom indicators designed to track progress against Shejeh Salam efforts. The third and final set of indicators are context, designed to be measured at routine intervals primarily for informational purposes. These metrics will provide Shejeh Salam and USAID with insight into trends, dynamics, and perceptions on the ground- invaluable for adaptive management and context aware intentional design of activities. Each of the indicator types are detailed below.

STANDARD FOREIGN ASSISTANCE FRAMEWORK INDICATORS

This MELP has 12 Standard-F indicators covering Peace and Security, Democracy and Human Rights, and Cross-Cutting Gender and Youth.

CUSTOM INDICATORS

The MELP has 13 custom indicators at both output as well as outcome-level. The outcome level indicators measure changes in community perceptions about peace and conflict, others cover the “before” and “after” effects of Shejeh Salam’s (i) trauma awareness activities, and (ii) CSO capacity building activities.

CONTEXT INDICATORS

The MELP has one context indicator, which has utilized Everyday Peace Indicators (EPI) to construct an index that combines several measures of a successful peacebuilding program. This success is based on the community's own expression of success because community members report on each of these dimensions of success. The EPI approach is based on the premise that local communities are best placed to identify changes in their own circumstances, rather than relying on external ‘experts’ to identify indicators for them. The MELP context indicator is “Social Cohesion or Community Peace Index” and has five dimensions of success, namely; effort causes participants and communities to develop their own peace initiatives, effort results in the creation or reform of political institutions to handle grievances that genuinely drive the conflict, effort prompts people increasingly to resist violence and provocations to violence, effort results in an increase in people’s security and in their sense of security, and effort results in meaningful improvement in inter-group relations.

For each of these dimensions, the Index has one indicator as follows; % of community members reporting that they are part of, or aware of, a recently developed local mechanism to deal with conflict prevention, resolution or mitigation, % (out of USAID 13) of counties with a functional mechanism for conflict prevention, dialogue and conflict resolution, % of community members (respondent or household member) reporting that they do not believe that violence is a viable way to resolve disputes, in Shejeh Salam targeted areas, % of individual respondents reporting increased personal safety and security, and the % of community members reporting initiation or increased relationship with other communities through trade or cultural ties. While the indicator on perception of personal safety is given a weight of 0.28, each of the other four has a weight of 0.18.

While there is only one context indicator in this MELP’s Indicator Performance Table and in the Reference Sheets, there are a number of other context indicators that will be collected through (i) the Shejeh Salam’s baseline (June 2021), mid-line (June 2023), and end-line survey (June 2015), and (ii) through USAID Mission Household Survey whose baseline is scheduled for July 2021. The role of


context indicators is to provide analytical context to the performance indicators. These two surveys will provide several context indicators to the analysis of Shejeh Salam MELP performance indicators. It has to be appreciated that while USAID Household Survey indicators’ estimates cover entire county/state, Shejeh Salam estimates for the same indicators only measure the impact in relation to targeted locations where its activities are intensified. The following are the context indicators to be collected through Shejeh Salam baseline/midline/endline surveys, and those through USAID Household Survey.

Shejeh Salam Survey at baseline, midline and endline:

• % of population (15+yrs) with regular access to radio within or outside their household

• % of population (15+yrs) who listen to (i) radio regularly (ii) radio news regularly

• % of population (15+yrs) reporting that their most trusted source of information is (i) Radio, (ii) Social media (iii) Relatives, (iv) Friends, (iv) leaders

• % of population (15+yrs) that (i) own a smart mobile phone, (ii) have access to a smart mobile phone, (ii) that sometimes or always rely on Social Media for civic information.

• % of population (or households) that have faced certain conflict type/s in the last six months preceding the survey in Shejeh Salam targeted areas

• % of population (or households), among those that have faced certain conflict type/s in the last six months, that reported that the conflict was resolved through dialogue, traditional leaders or by faith-based organizations in Shejeh Salam targeted areas

• % of population (or households) with a member suffering from one or more forms of trauma in the past one month (baseline data to come from USAID Household Survey, midline to be carried out by Shejeh Salam using USAID Household Survey methodology, and endline to be carried out by Shejeh Salam if USAID will not have a household survey)

USAID Mission Household Baseline Survey

• % of population (or households) that have faced certain conflict type/s in the last six months preceding the survey (the indicator estimate will be for entire county/cluster while Shejeh Salam estimate will only tell the story of the targeted areas or where activities are intensified)

• % of population (or households), among those that have faced certain conflict type/s in the last six months, that reported that the conflict was resolved through dialogue, traditional leaders or by faith-based organizations (the indicator estimate will be for entire county/cluster while Shejeh Salam estimate will only tell the story of the targeted areas or where activities are intensified)

• % of population (or households) with a member suffering from one or more forms trauma in the past one month (the indicator estimate will be for entire county/cluster. Therefore, there will be no estimate for Shejeh Salam targeted areas but the Household Survey Baseline will give Shejeh Salam insights on which counties have a larger or smaller trauma burden)

• % of population (or households) that (i) own a smart mobile phone, (ii) have access to a smart mobile phone, (ii) that sometimes or always rely on Social Media for civic information. (This is a suggestion for the USAID Household Survey where the indicator estimate will be for entire county/cluster while Shejeh Salam estimate will only tell the story of the targeted areas or where activities are intensified)


INDICATOR TARGETS

To the extent possible indicator targets are linked as fractions of other indicators’ targets in order to have an internally integrated rationale for justifying target levels- for instance, trauma awareness is set at 40% of all those participating substantively in Shejeh Salam activities. Each target is also justified by documenting how it is arrived at, or estimated. As it should be, targets have been aligned with available budget and other realities such as having slightly lower targets for the final project year to reflect reduced activity towards close out. All targets, unless those specified for very few case/s, relate to the absolute (not cumulative) numbers planned for each reporting year. This MELP has used the targets that Shejeh Salam provided to USAID for PPR reporting for the selected Standard-F indicators but have made a few adjustments (mostly upwards) to reflect better understanding in work planning. For the outcome-level indicators, some relevant information from the VISTAS Activity has also helped to shape some baselines and targets.

Monitoring, Evaluation & Learning Plan | SHEJEH SALAM 8

TABLE 2: INDICATOR SUMMARY TABLE

[CLUSTER always referring to each of the five conflict dynamics that together contain the 13 USAID focus COUNTIES as follows; Southern Unity Cluster: Mayendit, Leer, Panyijar; Eastern Equitoria Cluster: Kapoeta North and Budi; Western Bahr-el Ghazal Cluster: Wau, Jur River; Upper Nile Cluster: Ulang, Baliet; Jonglei Cluster: Akobo, Duk, Pibor, Uror. The sixth cluster is Juba/roving Cluster. Unless otherwise specified, all targets are absolute, i.e. not cumulative. All indicators, apart from the Social Cohesion Index which is a context measure, are for measuring Shejeh Salam performance in terms of outputs and outcomes]

Performance Indicator Title

Indicator Definition And [Unit of Measurement]

Data Source

Dis-aggregation (if any)

Year 1 (Oct 2020-Sep

2021) Target

Year 1 (Oct

2020-Sep 2021) Actual

Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

GOAL: Improved Social Cohesion in targeted areas

(1) Social Cohesion/ Community Peace Index

An index made up of five indicators, each of which measuring one of 5 (five) specified outcomes of successful peacebuilding program [Fraction]

Survey Overall, Cluster, Ethnic Group, Gender, Age (Youth, Older)

N/A TBD N/A N/A Baseline + 10%

N/A N/A YR3 +10%

Objective 1: Local actors are building crossline interdependence & intra- community cohesion to promote peace processes & peaceful co-existence

(26) Number of infrastructural activities/projects supported by Shejeh Salam to enhance the work performance of local actors and partners (these are additional to the interdependence ones captured by indicator 10)

This is a custom indicator that counts all construction-based activities or projects across all four Shejeh Salam objectives. This is cumulative because some of these projects may require continuous support for perhaps more than one year [Number]

Routine County, Cluster, Shejeh Salam Objective

TBD Shejeh Salam total=0





(2) % local community members reporting increased trust towards those that they have had a strained past or conflict, in Shejeh Salam targeted areas, in the past 18 months

A community perception measure [Percentage]

Survey Trust Type (overall, in local peace processes, in members of same community, in members of different ethnic group) Cluster, Ethnic Group; Gender, Age (Youth, Older)


N/A N/A YR3 +10%




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

(3) % of community members, in Shejeh Salam targeted areas, reporting that key conflicts (namely; cattle raid/theft, revenge killing, child abduction, or rape) have reduced in the past 18 months

A community perception measure of trends in conflicts. It is expected that with more impactful interventions the incidence of conflicts would reduce over time. [Percentage]

Survey Conflict Type (overall, for example, domestic violence, rape, age-set fighting, cattle raid, cattle theft, child abduction, revenge killing, fight over resources /boundaries, political, general crime) Cluster, Ethnic Group, Gender, Age (Youth, Older)


N/A N/A YR3 +10%

Intermediate Result 1.1: Improved capacity of a wide range of local actors to engage constructively & to successfully mitigate perceived conflict issues

(4) PS.6.2-4: Number of people participating in USG-supported events, trainings, or activities designed to build mass support for peace and reconciliation

An output indicator among the State Department’s Standard-F indicators. Shejeh Salam has divided the indicator into two broad categories, Substantive =those generated by PS.6.2-3 activities, Mass= those generated by PS.6.2-2. The official PIRS has not gone to into these details. [Number]

Routine ALL (will be further disaggregated by gender and youth)

2,500 19,000 20,000 24,000 16,000

SUBSTANTIVE participation associated with activities counted under PS.6.2-3 activities (1. includes trauma awareness numbers estimated at about 40% of these targets. But trauma awareness has its own targets elsewhere, 2. numbers will be further gender disaggregated

1,000 3000 4,000 4,000 2,000




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

targets for GNDR-10)

MASS participation associated with activities counted under PS.6.2-2

1,500 16,000 20,000 20,000 14,000

(5) GNDR-10: Number of local women participating in a substantive role or position in a peacebuilding process supported with USG assistance

An output indicator among the State Department’s Standard-F. A sub-set of PS.6.2-4. Target set as 35% of those participating under PS.6.2.3. [Number]

Routine Ethnic Group, Cluster, Age (Youth, Older)

350 1,050 1,400 14,00 700

(6) DR.3.1-1: Number of USG-assisted consensus-building processes resulting in an agreement

An output indicator among the Standard-F list. Agreements can take the form of interim or final plans of action, constitutions, constitutional amendments, draft legislation, legislation on electoral frameworks issues, statutes, regulations, or peace agreements. [Number]

Routine Cluster 10 30 30 30 20

(7) PS.6.2-2: Number of USG-funded events, trainings, or activities designed to build support for peace or reconciliation on a mass scale

An output indicator among the State Department’s Standard-F list> The indicator aims at capturing events that involve mass participation. [Number]


(8) PS.6.2-3: Number of USG supported events, trainings, or activities designed to build support for peace or reconciliation

Output indicator among State Department’s Standard-F list. This indicator counts dialogues, peace meetings and other substantive engagement of





Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

among key actors to the conflict

parties to a conflict. [Number]

(9) % local community members who believe that traditional authorities are playing their role in conflict prevention, resolution or mitigation.

Though a custom performance indicator aimed at assessing the outcome of Shejeh Salam work, it is potentially influenced by other partners working in the same communities. [Percentage]

Survey Gender, Ethnic Group, Cluster


N/A N/A YR3 +10%

Intermediate Result 1.2: Increased mutual interdependence resulting from infrastructure and livelihoods projects

(10) Number of new, or existing infrastructural investments (such as market structures, market access roads, abattoirs) or other relevant livelihood support by Shejeh Salam aimed at fostering positive interdependence among and between communities (Cumulative)

A custom output indicator that counts units that are different in objectives or physical locations. Data is cumulative because some investments may need more continuous support in one way or other. [Number]

Routine Cluster, Ethnic Group (those served), County

0 2 3 4 4

(1) % of community members reporting having initiated or increased interaction or relationship (in the past 18 months) with members for whom they had strained relationship or past conflict, in Shejeh Salam targeted areas

A custom performance indicator for measuring the outcome of Shejeh Salam peacebuilding work. This is because it will be assessed in Shejeh Salam intervention intensive areas. The indicator is also one of the five elements of the Social Cohesion or Community Peace Index because it is possible that there could be many partners working in same space with Shejeh

Survey Cluster, Ethnic Group, Gender, Age (Youth, Older)


N/A N/A YR3 +10%




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

Salam- hence it is also a measure of context. [Percentage]

Objective 2: Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes

(26) Number of infrastructural activities/projects supported by Shejeh Salam to enhance the work performance of local actors and partners, and for building interdependences between communities (targets under objective excludes those for interdependence)

This is a custom indicator that counts all construction-based activities or projects across all four Shejeh Salam objectives. This is cumulative because some these projects may require continuous support for perhaps more than one year [Number]







(11) CBLD-9: % of USG-assisted organizations with improved performance

This is standard-F indicator. Shejeh Salam will identify the areas of capacity gaps through an assessment tool developed to reflect the types of capacity gaps that local CSOs have, and make action plans to address these. The tool may contain elements that may vary from the standard elements in the F-indicator PIRS. Shejeh Salam will compute the indicator with Numerator= Number of CSOs showing at least one step positive change along the capacity grid for more than half of the attributes assessed.

Before and after assessment

Type of grant (in-kind, FAA)

N/A TBD 90% 90% 90% 90%




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

(12) Youth-5: % of youth who participate in civic engagement activities following soft skills/life skills training or initiatives from Shejeh Salam assisted programs

This is a Standard-F indicator assessing the immediate outcomes of the skills training. The denominator is another standard F- (Youth-1: Number of youths provided with soft skills training. [Percentage]

Routine Assessment

Gender, Cluster, Ethnic Group

50% 55% 60% 65% 70%

(13) Number of R-ARCSS related issues monitored, or advocated for, by the Shejeh Salam-supported “National Coalition of CSOs” or Umbrella CSO

This is a custom output indicator that counts the number of issues or recommendations being monitored after agreement with partner to be supported by Shejeh Salam. Since no awards have been granted at the time of this MELP, it will be difficult to obtain a baseline. [Number]

Routine Level of Advocacy (national level, State, community-level for example, those linked to conflict triggers, prevention or mitigation)

TBD TBD TBD 0 0

(14) % of community members, reporting a having heard/seen a Shejeh Salam-related peace or civic education message in the past 12 months

A custom perception indicator of Shejeh Salam outcomes. It has several dis-aggregations representing the multiple program aspects being monitored. The 5-year targets are based on VISTAS similar indicator but adjusted downwards by 10% to reflect the much smaller Shejeh Salam compared to VISTAS [Percentage]

Survey Heard/seen Message-Overall Message had Impact- Overall, Type (1. Peace, 2. governance or civic-related for example, peace agreement, Peace message) Source (1. attending a dialogue or peace meeting, 2. Radio, 3. Radio Tamazug, 4. Internews Radio Drama, 5. Listener

N/A N/A

TBD TBD

N/A N/A

N/A N/A

TBD TBD

N/A N/A

N/A N/A

66% 83%




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

Group, 6. Banner or Billboard, 7. Social Media, 8. Friend) Gender, Age (Youth, Older), Ethnic Group, Cluster

Intermediate Result 2.1: Civil society and faith-based organizations, individuals, and groups work together for effective peacebuilding, civic education, and reconciliation activities that resonate socially and culturally

The following Standard-F indicators will also be used to measure this result but they have been reflected fully in other overlapping results and are therefore not repeated here; PS.6.2-4, GNDR-10, PS.6.2-1, DR.3.1-1, PS.6.2-3, PS.6.2-2

(15) DR.3.2-5: Number of individuals receiving civic education through USG-assisted programs

This is standard-F indicator is a count of (unique in any given reporting year) reached through civic education supported by USAID. Most of these numbers will come from radio listener groups as well as dissemination of peace agreement. [Number]

Routine Ethnic Group, Gender, Age (Youth, Older), County, Cluster

2,600 3,100 4,100 4,100 600

(16) DR.4.2-2: Number of civil society organizations (CSOs) receiving USG assistance engaged in advocacy interventions

This is standard-F indicator is a count of CSOs engaged in advocacy among those receiving Shejeh Salam support. Although the indicator is not a percentage, the analysis will show the intention to reach 100% of the target – where the target is the total number provided with support. [Number]

Routine Type of grant (in-kind, FAA), Cluster, County

8 13 18 18 6

Intermediate Result 2.2: Citizen actors participate in processes supporting transitional justice and enhancing communities’ perceptions of justice that assist formal & informal peacebuilding efforts




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

(17) Number of partners supported to engage on Transitional Justice Issues (e.g. Transitional Justice Working Group (TJWG) work with Ministry of Justice)

This is a custom output indicator that captures efforts towards advocacy activities for Shejeh Salam-supported CSOs working on transitional justice issues.

Routine None 2 3 3 3 1

Objective 3: Key partners are providing trauma awareness services to communities

(26) Number of infrastructural activities/projects supported by Shejeh Salam to enhance the work performance of local actors and partners, and for building interdependencies between communities (targets under objective excludes those for interdependence)








(18) Number of people provided with trauma awareness services

This is a custom indicator to measure Objective 3 specifically 40% of substantive [Number]

Routine Ethnic Group, Gender, Age (Youth, Older), Shejeh Salam Objective (1, 2, 4), Module

400 1200 1600 1600 400

(19) % of community members with awareness of trauma in Shejeh Salam targeted areas

A custom outcome-level performance indicator that assess level of community engagement with trauma related programs in Shejeh Salam targeted areas. Targets will be determined after baseline. [Percentage]

Survey Type [Knowledge of trauma -those that can identify the most common trauma symptoms, causes and effects, Presence of trauma in the community those able to relate trauma to any conflict or violent reactions within the

TBD TBD TBD TBD TBD




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

community, level of trauma-related interventions -those that report that trauma issues are being addressed “somewhat” or “significantly” by the various actors), Ethnic Group, Gender, Cluster

Intermediate Result 3.1: Stakeholders recognize signs of trauma and distress and are able to approach intra- and inter-community engagement and dialogue with increased sensitivity

(20) Change (% points from before to after) in Individual trauma-related knowledge/attitude/practice after Shejeh Salam interventions

This is a custom indicator that measures the immediate outcome of Shejeh Salam trauma awareness activities. It will be measured immediately before and after a Shejeh Salam activity using a small, 6-10, sample of representative and randomly selected participants so that the numbers captured semi-annually or annually can be used to compute the indicators depending on volume of data [Percentage]

Ad Hoc Assessment

Type (Knowledge % that adequately identifies key trauma symptoms, causes and effect- for VISTAS before=52% and after=74%, a 22% change) Attitude % that believe trauma can heal (for VISTAS before=78%, after=88%, a 10% change) Practice Behavior/Practice % that showed improvement in more than half of psychosocial dimensions after trauma awareness training), Ethnic Group, Gender,

20% 10% 5%

20% 10% 5%

20% 10% 5%

20% 10% 5%

20% 10% 5%




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

Cluster- (VISTAS 58%

Objective 4: Print, radio, and other media are providing accurate, fair and thorough information to mitigate the destructive impact of rumor and misinformation

(26) Number of infrastructural activities/projects supported by Shejeh Salam to enhance the work performance of local actors and partners, and for building interdependences between communities (targets under objective excludes those for interdependence)








(14) % of community members, reporting a having heard a Shejeh Salam-related peace or civic education through radio in the past 12 months

A custom perception indicator of Shejeh Salam outcomes. It has several dis-aggregations representing the multiple program aspects being monitored. The disaggregation on impact relate to “Yes” for those who answered “Somewhat” and “Significant” to the question, the message that I received made a difference in my viewpoints or actions- a 93% target for year 5 going by VISTAS survey. [Percentage]

Survey Heard Shejeh Salam message (Radio Tamazug, Internews Radio Drama, Shejeh Salam Listener Group)

N/A TBD N/A N/A 50% N/A N/A 76%

Shejeh Salam message heard had impact

N/A TBD N/A N/A 63% N/A N/A 93%

Intermediate Result 4.1: Community members access independent media outlets and participate in peaceful and purposeful debate, and are able to resist misinformation, disinformation and hate speech




Data Source



2021) Target

Year 1 (Oct


Baseline


2022) Target


2022) Actual


2023) Target


2023) Actual


2024) Target


2024) Actual


2025) Target


2025) Actual

(21) DR.5.2-2: Number of journalists trained

A standard-F indicator as a simple cumulative count of unique individual journalists trained [Number]

Routine Gender 10 25 25 25 10

(22) DR.5.3-1: Number of non-state news outlets assisted by USG

A standard-F indicator as a simple cumulative count of independent radio stations supported [Number]

Routine Cluster, Languages 2 4 6 8 2

(23) DR.5.3-2: Number of USG-assisted media-sector civil society organizations (CSO) and/or institutions that serve to strengthen independent media or journalists

A standard-F indicator as a simple count [Number]

Routine None 0 2 2 2 1

(24) Number of radios distributed.

A custom output -simple count [Number]

Routine County, Cluster 600 700 1000 1000 0

(25) Number of radio listener groups established/strengthened

A custom output -Radio listener group defined as having 10 people listening together at least once a week. Target at least a third of those given radios. [Number]

Routine County, Cluster 200 250 350 350 0

Monitoring, Evaluation and Learning Plan | SHEJEH SALAM 19

MANAGEMENT OF THE SHEJEH SALAM MEL PLAN The MEL Director, in coordination with the COP, is responsible for management and operationalization of this MEL Plan. The MEL unit will work closely with the DCOP, Regional Program Managers, and other field team members to implement and track the progress against performance and context indicators, as well as ensure standards of quality are consistently adhered to. The following section describes the Shejeh Salam approach to management and actioning of the approaches and tools discussed within this plan. Shejeh Salams approach to the operationalization of this MEL Plan is grounded in Collaboration, Learning, and Adaptation (CLA) practices outlined in ADS 201.3.5.19 and detailed throughout USAID resources such as the Learning Lab.

SHEJEH SALAM APPROACH TO CLA AND MEL

Shejeh Salam will use a CLA framework to guide everything we do is simply best practice and this belief is demonstrated throughout this MEL Plan. The concepts, methods, and tools in support of CLA – strategic collaboration, continuous learning, and adaptive management – lie at the heart of how we will use evidence to drive adaptation and learning and to further Shejeh Salam objectives. CLA provides the framework needed to assess program effectiveness and inform adaptive modifications to our approaches and activity design. This will enable us to continuously inform USAID and pivot our programming in a responsive and timely manner.

Monitoring & Evaluation (M&E) is an independent line of activity within a continuous feedback loop, which includes analysis and planning. It is used to design and implement an information gathering process and encourages reflective learning processes in order to generate insights on how to improve strategic planning and operations. In the context of a conflict or transitional environment, the approach to M&E must be flexible in terms of methods and timing, but not so in terms of accountability or rigor.

Shejeh Salam will utilize a collaborative, evidence-based approach to operationalizing CLA throughout the project lifecycle. The three components of our approach are:

1. Flexible and Adaptable MEL systems

2. Using evidence to proactively test theories of change

3. Defined formal and informal feedback loops for regular communications, collaboration, and engagement between Shejeh Salam, USAID/South Sudan, local and national stakeholders, and other implementing partners

The exact nature of M&E and CLA activities to be carried out at each of these three levels is outlined from Page 20 under “Activity, Cluster and Program-level MEL Management”

DEVRESULTS

At the core of Shejeh Salams operationalization of CLA is DevResults, a comprehensive, data-driven MEL and activity management platform. DevResults will be the hub for all the project’s activity and programmatic inputs and outputs – performance and contextual monitoring data, survey and stakeholder consultation data, and analytics -- facilitating communications and collaboration among Shejeh Salam staff, USAID, Shejeh Salam partners, and the Home Office Program Management Unit (PMU). All Shejeh Salam data streams will reside in this platform and be accessible to these teams to reinforce the importance of the One-Team approach. The ability for USAID and Shejeh Salam to collaborate and share information through DevResults will enable efficiencies and promote responsive, evidence-based adaptation. Program and Activity-level M&E data that is managed in DevResults is


described in detail in the following sections below. Key features of the Shejeh Salam DevResults platform include:

✔ User friendly interface that will require only a modest amount of training for individuals to be able to use it effectively

✔ Ability to aggregate and analyze data streams from across Shejeh Salams activity portfolio, enabling learning and adaptive management at the field level and QA/QC support from DT Global’s home office

✔ Built-in dashboarding, mapping and data visualization capabilities that Shejeh Salam can create and customize in-house and share in real-time with USAID

✔ Using role-based permissions, access to data, dashboards and visualizations, etc. can be granted to clients and partners outside of DT Global to facilitate efficiencies in reporting and communications

✔ Ability to be integrated with external systems and & data collection and analysis software that Shejeh Salam will be utilizing (Kobo, SurveyCTO, PowerBI, Arc-GIS)

✔ Built-in basic data validation and user-defined logic checks

✔ Geospacial Information System (GIS) capabilities

DEVRESULTS MANAGEMENT & OVERSIGHT

The COP will have the overall oversight of DevResults but with devolved roles to the various members of the team. From a technical standpoint, the Database Manager will oversee the system maintenance. The MEL Manager (with support of MEL Director) will oversee the results-framework related data system. The grant management component will be coordinated by the Database Manager with direction from the COP, DCOP Technical, Technical Directors/Advisors, Regional Program Managers, and Grant and Procurement Specialists. The DevResults vendor will provide back-up and training as appropriate.

ACTIVITY, CLUSTER AND PROGRAM-LEVEL MEL MANAGEMENT

ACTIVITY (GRANT)-LEVEL MEL

The management of Activity-Level MEL is aligned with the Activity Manual, for example, there are different MEL roles for each stage in the grant development, implementation and closure process. The originator of the grant works with the MEL team to define the Theory of Change, and to assign the MELP output indicators that the grant will contribute. The grant originator then engages the MEL team to articulate the grant-related outcomes that will be captured including the method and frequency. The outputs and outcomes along with the indicators and data capture method constitute the grant MEL plan.

This MEL plan is recorded in the activity database and the plan’s findings are part of the Activity Evaluation Form filled out at activity completion. The activity-level

Activity MEL Tools Activity MEL Plan (submitted with grant document) Activity Notes Activity Tracking Sheet (Output tracker) Activity Evaluation Form MEL Data Collection Methods Attendance Sheets Photographs Key Informant Interviews Focus Group Discussions


M&E plan is meant to structure data collection efforts at the activity level, ensuring they are ‘right-sized’ and sufficient. If applicable, it includes any information that should be collected prior to an activity for comparison at the end of the activity. The plan is tailored for each activity and states, at a minimum, outputs and output indicators, outcomes and outcome indicators, the means of verification, timing, and resources needed to monitor and evaluate the activity. With regard to MELP indicators that are reported by a particular grant, an Activity Tracking Sheet will be used for recording the indicator value in real time (such as the number of radios distributed on a certain date). All the data from these tracking sheets, across grants, will be aggregated for Quarterly Reporting to USAID as well as for Shejeh Salam program learning and action. These aggregation processes will take place within DevResults.

As part of its Activity-Level MEL, Shejeh Salam will institute community-based light Focus Group Discussions and Key Informant Interviews with local level actors to gather feedback on the relevance and performance of selected grants at certain intervals- mostly at the beginning and at the middle or at the end of the grant. Information will be recorded in Activity Evaluation Forms or Activity Notes. This community feedback aspect will be part of a light outcome harvesting scheme described below.

Note that in addition to ongoing monitoring, every grant closeout process includes an evaluation.

Annex 1 outlines Shejeh Salams MEL tools and feedback loops that will ensure the data collected will be used in a meaningful way. All data unless otherwise noted will be stored in DevResults.

In support of the methods provided in the proceeding section, Shejeh Salam will use an inclusive approach to data collection. Shejeh Salam has developed protocols to guide our team and our partners in ensuring data collected is inclusive of women, youth, and marginalized groups. These protocols include:

● Train MEL staff, program staff, community monitors, and grantees on inclusive data collection including gender, youth, and marginalized community sensitivity principles and data collection protocols.

● Select data collection and assessment team members who can work with women, youth, and marginalized groups.

● Design assessments and data collection tools to be unbiased and easily understood by all respondents.

Example Activity Level MEL Plan Output Objective: To hold a three-day peacebuilding training each month for six months Output Indicators: • # of people attending each training • # of topics covered in the training Means of Verification: • Attendance sheets uploaded to the

activity file • Photographs uploaded to the activity

file • Meeting Agenda uploaded to the

activity file Outcome Objective: Trainees agree on joint action plans for community peacebuilding at the end of each meeting Outcome Indicators: • Number of items agreed on in the

joint action plans • Number of joint action plan points

that are implemented/attempted Means of Verification: • Copies of the Joint Action Plans

uploaded to the activity file • Key Informant Interviews – five

participants will be called one month after the activity to discover what items of the joint action plan are moving forward

Responsible Party: • The grantee will collect attendance

sheets, photographs, meeting agendas and joint action plans and will share them with the SHEJEH SALAM activity focal point

• The MEL Specialist will conduct the phone call KII and record results in activity notes

Timeline: • All of the items will be collected

during each of the six peacebuilding trainings, except for the KII which will be conducted one month after each training.


● Ask questions that incorporate considerations of the needs and sensitivities of women, as well as youth and marginalized groups.

● Ensure that data collection protocols are inclusive to all groups in their timing and location

CLUSTER-LEVEL MEL

Beyond the activity level monitoring, Shejeh Salam seeks to understand and document the collective effects of the various grants at Cluster level. It is at the cluster level where many dynamics interplay including the role of the various actors in intervening to deal with a complex set of conflicts. Thus, it is at the cluster level that the concepts of Outcome Harvesting (OH) and Most Significant Change (MSC) would be most appropriate. The Shejeh Salam predecessor program (VISTAS) conducted various thematic cluster evaluations at a time when the concepts of layering, sequencing and clustering were beginning to define integration of activities within a complex landscape.

Collaborating with locally engaged stakeholders and partners, Shejeh Salam will define outcomes, significance of the outcomes, and identify through workshopping and KIIs, how Shejeh Salam contributed. Through MSC, Shejeh Salam will collect ‘stories’ from beneficiaries, grantees, and community members that describe what they feel is the most significant difference they have experienced in relation to Shejeh Salam efforts. This approach will enable Shejeh Salam to identify instances of contribution to impact as well as success stories. In order to adequately harvest these cluster-based outcomes, Shejeh Salam will consolidate the outcomes captured at grant/activity level as complements to annual cluster evaluations. These annual cluster evaluations utilize mixed-methods to identify and document/quantify the various intended and unintended outcomes for each of its five programming clusters. These evaluations may include, but not limited to, the following enquiries:

(i) Effectiveness of layering, sequencing and clustering of Shejeh Salam grants internally and with external partners;

(ii) Changes in the context as a result of actions of the many (if they are there) actors operating in the same conflict dynamics, or as a result of changes in external environment;

(iii) Most significant behavioral changes in individuals, groups and partners in relation to Shejeh Salam objectives- these should touch on any changes in gender-related aspects such as the participation of women, youth and marginalized groups in peace processes, or in their representation in the ultimate positive peacebuilding outcomes; and

(iv) Sector-specific analyses such those for media, infrastructure, trauma awareness, gender, youth, and peacebuilding.

The timing of these cluster evaluations will be such that they become part of the analytical information to be used during the Annual Rolling Assessments or Strategic Review Sessions that precede the development of a new Annual Work Plan.

PROGRAM-LEVEL MEL

Shejeh Salam program-level MEL processes assess the contributions made towards the performance of Shejeh Salam programmatic objectives and the overall goal. Program-level influence and outcomes are determined by aggregating evidence of lower-level outcomes and outputs from activities and documenting higher-level effects (e.g. cluster of activities), coupled with the changes in contextual dynamics occasioned by the joint contributions of Shejeh Salam and other actors working in the same space. This multifaceted approach seeks to draw observations about the relationship between the actions taken and the changes observed, in addition to evaluating whether the actions were effective means to achieve the program goal. Using theories of change at each level of analysis allows Shejeh


Salam to assess on-going programming in a highly dynamic environment, define success based on changes observed, and identify emerging solutions.

Shejeh Salam will employ various approaches to MEL as described below that may be implemented at either the activity or program-level but will be analyzed and utilized at the program level to facilitate cross-activity learning and adaptive management.

Shejeh Salam has sub-contracted a MEL firm to collect Shejeh Salam performance outcome indicators as well as to collect some context indicators that will help to support the analysis of MELP performance indicators. These survey-based indicators will be collected at baseline, midline and endline surveys in the 13 USAID priority counties nested within the five Shejeh Salam clusters. The sub-contractor is also tasked with collecting qualitative information that explains the ‘why’ for some of the trends observed in the quantitative survey indicators for both context and performance measures.

MULTI-LEVEL MEL ACTIVITIES

These issues cut across various levels of MEL from activity, cluster and program levels.

Stakeholder Mapping Stakeholder mapping is a critical method to use and revisit regularly in an operational environment such as South Sudan, with numerous development, humanitarian, international, and local actors working in the same space. On an ongoing basis Shejeh Salam will revisit the stakeholder mapping created during start-up at regular intervals, to identify and if necessary, respond to changes in the stakeholder landscape. Stakeholder mapping is informally conducted at all levels including at the program level, cluster and activity levels. At program level these stakeholder engagements take the form of rolling assessments and strategic review sessions, while at cluster level they could be key informants and at activity level they could be community members within a Focus Group Discussion. Capacity Building Assessments and Monitoring For any grants/activities that Shejeh Salam envisions a long-term substantive engagement (estimated as grants of nine months or more), the grantee will be provided with capacity building in selected technical and/or operational areas based on gaps identified through an in-depth capacity assessment. Shejeh Salam will then reutilize the tool at the conclusion of an activity with the grantee, in order measure improvements in their capacity. While all partners will undergo a capacity assessment including the Financial Management Capacity assessment, and capacity building plans developed, Shejeh Salam will not utilize the in-depth capacity assessment for all partners as it is not likely to be a relevant tool for certain partners and also because Shejeh Salam’s level of engagement with the grant might be minimal. These activities will still be included in capacity building elements that are right-sized to their needs – which will be reported on alongside the activity in activity notes and activity evaluations.

DATA QUALITY ASSURANCE

Data quality assurance is built into Shejeh Salam systems and processes throughout the data life cycle. The specific functions of various data quality control mechanisms for the program can be referenced in this section, demonstrating how each component of Shejeh Salams MEL system supports overall data quality. Shejeh Salam follows USAID’s five standards for data quality: reliability, timeliness, precision, integrity, and validity.

The MEL Director will be responsible for overseeing and enforcing processes, while the MEL Manager will conduct routine data quality checks. Once a year, an internal data quality assessment (DQA) will be conducted based on USAID guidelines to complement, not replace, the USAID conducted DQA. Shejeh Salam will revisit PIRS statements, indicator selection, and data quality assurance processes to determine where updates or improvements need to be made. All data will be compared against the five standards


of data quality: validity, reliability, timeliness, integrity, and precision. Lastly, a data quality incident log is kept for record of incidents and will be used during internal DQAs to determine whether any quality assurance processes have gaps, issues, or could be improved in any way.


THE ROLE OF DEVRESULTS IN DATA QUALITY ASSURANCE

DevResults has a host of built-in quality control features to mitigate most user-error issues that often arise during data entry and analysis. QA/QC features found in DevResults include:

✔ Built-in data validation in all data entry fields ✔ Built in data validation in all entry fields

✔ User-defined logic checks ✔ Detailed change logs for all data, records, tools, and indicators

Since DevResults is web-based, Shejeh Salams home office support team will be able to provide additional oversight and QA/QC to all Shejeh Salam data, in a timely and ongoing manner. Table 3 below provides Shejeh Salams approach to data quality assurance.

Table 3. Ensuring Standards of Data Quality

Data Quality Parameter Measures taken to ensure quality Individual

responsible Validity – data should clearly and adequately represent the intended result

• Identification of primary sources of data on activities • Deliberate design of ToCs developed for each grant • Comprehensive agreed-upon definitions in the PIRSs

MEL Director/MEL Manager- with inputs/actions from RPMs

Reliability – data should reflect stable and consistent data collection processes and analysis methods over time

• Data is managed using a relational database with built-in checks (DevResults)

• Activity checklists are consistently utilized and adhered to • Indicators are defined in the PIRSs • Processes for data quality assurance and data collection are applied

consistently across program activities • Surveys/form design are carefully vetted and design changes must go

through control of MEL Manager • Timing is clearly specified and adhered to for data management • All staff interacting with the MEL system are trained on processes

and procedures


Integrity – data collected should have safeguards to minimize the risk of transcription error or data manipulation

• Utilization of ‘auditable’ electronic data collection tools with embedded user-error mitigation functions when possible

• Individuals responsible for one step in the data management system are always different individuals than those responsible for the next step

• Substantiating documentation is most often tied to the payment for deliverables and audited by the Finance team

• Random site visits are conducted by MEL staff


Precision – data have a sufficient level of detail to permit management decision making; for example, the margin of error is less than the anticipated change

• Surveys are carefully and thoughtfully designed and appropriate in the given culture and context such that 1) individuals feel safe and free to provide true and accurate answers, and 2) questions are clear and straightforward such that individuals can be responsive to their meaning

• Indicators are responsive to the context and its limitations, clear and direct, and easy to measure



Timeliness

• All data is reported within the reporting period in which the activities take place

• Data is reported in shape of activity notes on weekly basis • Data is available on DevResults immediately upon data entry

MEL Director/Database Manager- with inputs/actions from MEL Manager

DATA ANALYSIS AND REPORTING

Shejeh Salams emphasis on data quality assurance enables reliable data analysis to regularly inform management decisions, adjustments, and planning. The MEL team will analyze data and continuously share and discuss findings with relevant teams in order to 1) make decisions regarding needs-driven future programming, and 2) modify programming strategies to continually improve quality.

At the end of every quarter and every year, Shejeh Salam MEL team will disseminate data on indicator performance versus targets internally within the Shejeh Salam in order to explain any variation from targets and the reasons behind those variations- with the final data and explanatory notes sent to USAID as part of the contractual Quarterly reporting. With regard to wider dissemination among stakeholders and donors, Shejeh Salam will share such information as will be found appropriate especially that coming from baseline/midline/endline surveys, cluster evaluations, rolling assessments and USAID Mid-Term Reviews.

As stated, DevResults will serve as the data management and analysis hub for Shejeh Salam. This hub is supported by compatible ‘heavier’ analytical tools that will augment DevResults reporting capabilities when the need for a deeper level of analysis arises. Just as with Shejeh Salams approach to data collection, various complementary methods will be used to analyze the information collected. Methods used will depend upon data type; examples include:

DEVRESULTS. The DevResults platform offers on-demand, bespoke mapping and data dashboarding capability that will enable ongoing communication of progress, reach, and grants status, among other metrics.

POWERBI. Shejeh Salam is considering using Microsoft's PowerBI – a desktop-based tool for modelling, analyzing, and visualizing data. PowerBI is integrated into Shejeh Salam's Microsoft 365 IT environment, meaning that the team can use the tool to create on-demand dashboards easily accessible by the entire team. PowerBI can link directly to the DevResults datasets as well as other databases. Finally, PowerBI offers basic predictive analytics tools and can link to scripting languages Python and R for more advanced analyses.

GIS DATA AND MAPPING. Shejeh Salam will collect data on infrastructure and activity intervention sites, reportable events and points of interest. Shejeh Salam will perform data capture with significant input from local authorities, communities, CSOs and partners that is structured, geo-referenced and consists of location/date/time-stamped photographs, and video and audio files. This will include map access to community data and reports, multiple base-map display options, project and activity-specific data, and printable map exports with selectable layers. GIS data will be stored and visualized in either DevResults or PowerBI. In cases requiring advanced geospatial analysis, the team will utilize free and open-source GIS software such as QGIS and R. Once requested by USAID, and if data is available, Shejeh Salam will provide any GIS data to USAID MEL contractors.


PERFORMANCE REPORTING SCHEDULE TABLE 4: PERFORMANCE REPORTING SCHEDULE

Report Name Due Date Responsible

Activity Notes Weekly Minimum Activity Focal Points/MEL Specialist

Quality Assurance Plan 30 days after last month of the Quarter MEL Director

Quarterly Progress Report 30 days after last month of the Quarter

CoP through Deputy Chief of Party with support from MEL Team

Annual Progress Report October 1 of every year CoP through Deputy Chief of Party with support from MEL Team

MEL TEAM MANAGEMENT

ROLES AND RESPONSIBILITIES

The MEL team will be managed in a manner that builds management capacity and therefore the role will be distributed across the various levels. There will also be a role for Home Office MEL support. The table below and the following organizational demonstrate this distribution of management role.

Table 6: M&E Roles and Responsibilities across the MEL system

Field Team in targeted areas

● Collect data using data collection tools ● Follow the guidelines for good data collection as provided by the MEL team ● Use data for decision-making and activity adaptation

MEL Director in Juba

● Coordinates the overall MEL effort ● Ensures comprehensive and quality analysis and reporting ● Mentor all MEL Manager, Database Manager and MEL Specialists ● Supports the COP in managing the MEL subcontractor

MEL Team in Juba

● Design and update the MEL system and plan ● Develop monitoring methodologies and data collection tools ● Oversee the smooth functioning of the MEL system’s tasks and staff ● Ensure data quality ● Train and mentor staff, as appropriate ● Support the CLA initiatives, learning events, etc. ● Support external DQA and TPM efforts ● Conduct data analysis ● Assist with report drafting ● Offer specialized training to the MEL team, when needed, and provide guidance when

challenges arise.

COP in Juba

● Oversight over MEL activities and responding to Mission requests ● Ensure that activity data is included correctly in reports ● Ensure that data is used for decision-making and shared among staff ● Ensure that the processes described herein are complied with.

MEL Team in Home Office

● Assist the MEL team with discrete tasks on a need basis ● Mentor the MEL team for better performance, when applicable ● Ensure that high standards are maintained, and activities are consistent with best

practices in the field ● Provide specialized assistance in finalizing the MEL Plan and offer specialized training to

the MEL team, when needed, and provide guidance when challenges arise.


MEL ORGANIZATIONAL CHART

Chief of Party

MEL Director

MEL Subcontractor

MEL Team – Home Office

MEL Manager Database Manager

RPMs

MEL Specialist

– Juba

MEL Specialist

– Wau

MEL Specialist – Akobo

MEL Specialist – Bentiu


ANNEX 1: DATA COLLECTION TOOLS AND FEEDBACK LOOPS Data Collection

Tool (Level) Method Interval Purpose

Activity Notes (activity)

Narrative Live- as an event occurs

Taken during every program meeting and uploaded to DevResults in order to (1) track ongoing implementation & progress of activities including quantitative indicators, (2) capture learning in real time, (3) document delays/challenges across activities in order to be able to identify inefficiencies, common themes that need addressed, and (4) for compliance, enable Shejeh Salam to have a documented history of the activity so that if issues arise with sub-contractors/grantees, we can reference specific site visits/conversations/etc. for follow up.

Activity Tracking Sheet

Completing a Matrix

Live -as an event occurs

For recording the outputs indicator data. Each grant will be assigned its MELP output indicators for which it will be recording each time an event (such as radio distribution) takes place. All the data across grants is then entered into DevResults, and at the end of each quarter, the numbers are aggregated for Quarterly Reporting to USAID as well as for Shejeh Salam program learning and action.

Combination of Activity Notes and Activity Evaluation Form

FGDs: women, youth, marginalized people, traditional leaders. KIIs: community leaders, partner representatives

Pre-activity; mid-activity; post-activity

To capture community feedback on Shejeh Salam activities as well as capture any changes (intended and unintended) in behavior of individuals, community groups, or grantees, in relation to Shejeh Salam objectives.

CSO Capacity & Sustainability Assessment (activity)

OCAT- KIIS with CSO representatives

Pre-activity; post-activity

To assess whether the grantee has the technical & operational capacity to successfully achieve their SOW & maintain achievements post-activity.

Primary Information Capture Tools

Observation; verification

Ongoing Per event/ facility

Attendance/sign-in sheets; Infrastructure/site visit verification form, distribution lists. Photos, and so forth. These are stored in DevResults.

Activity Evaluation (activity)

Observation; verification; feedback KIIs

Dependent on activity duration

Designed to analyze data captured through different processes including the achievement of planned outputs, expected and unexpected outcomes, best practices, and lessons learned.

Base/mid/endline performance and context monitoring

Survey; KIIs; FGDs Bi-annually Subcontractor will conduct baseline, mid-line, and end-line demographic surveys (which will be partially informed by the contextual monitoring described above). Evaluations will provide a description of the possible effect the activity has achieved in the local communities across the Shejeh Salam program zones and look at gender, youth, and marginalized population inclusion.


Data Collection Tool (Level) Method Interval Purpose

Activity Review Meetings

Meeting Monthly

Quarterly Performance Indicator Review

Meeting Quarterly At the end of every quarter, Shejeh Salam will review its program level (MELP indicators) achievements against the set targets to discuss what worked well and what needs attention or follow-up. Critical analysis of target vs. actual and deviations will be carried out. A table of performance versus with notes explaining any significant variation from targets will annexed to each quarterly report to USAID.

Rolling Assessments Workshop Every 6 months

To bring together Shejeh Salam, USAID, partners and stakeholder counterparts to reflect on both implementation and context, and collaboratively adapt programming responsively. The RA will enable Shejeh Salam to work toward contextually relevant and clearly articulated objectives & ensure we are responsive to US foreign policy; the up-to date conflict dynamics; shifting local and national problem sets and priorities; & have an understanding of capable & relevant capable partners.

Pause & Reflect/Strategic Review Sessions (SRS)

Workshop Annually Internal Shejeh Salam reflection opportunity. Will be carried out, with USAID participation, in advance of USAIDs mid-term reviews. If USAID requests, these SRS may be combined with USAID Mid-Term Review through a joint Shejeh Salam sessions in order to triangulate information from the two sources.

USAID Mid-term review

Mixed methods Mid-Term Led by USAID/South Sudan will provide Shejeh Salam team with feedback for appropriate action or for adaptive management.

Partner Forums/Collaboration meetings

Workshop/ Meeting

Ad-hoc Bring together implementing partners/actors at the State and County levels, both USAID and external, to share data, lessons learned and coordinate activities.

Third-Party Monitoring (TPM)

Site visits; KIIs Ongoing USAID/South Sudan’s TPM platform implementing partner (IP) will routinely conduct external verification of Shejeh Salam activities. Shejeh Salam will ensure that any related requests are responded to in a timely and coordinated manner.


ANNEX 2: PERFORMANCE INDICATOR REFERENCE SHEETS Each AMELP indicator has a Performance Indicator Reference Sheet (PIRS) that provides detailed indicator definition, methods and frequency of data collection among other features. For standard (F) indicators these PIRS are provided from the State Department Operating Framework and any changes made are only to the extent of applying to the precise country situation but no fundamental change can be made because F indicators are normally aggregated across countries. The following PIRS are for each of the 25 MELP indicators [Note: Performance Indicator Reference Sheets (PIRS) for Standard-F indicators are based on how they appear originally from sources. Once USAID reviews the MELP and agree on how Shejeh Salam will be customizing the F indicators, then Shejeh Salam will modify these to suit the context without losing the intent of the indicator].

Performance Indicator Reference Sheet

Goal: Improved Social Cohesion in targeted areas

Objective: All objectives contribute Context Indicator 1: Social Cohesion/Community Peace Index Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): This is a composite/index, outcome-level, indicator that measures the change in context at community level by assessing five markers of a successful peacebuilding program. The table below lays out each of these five dimensions of a successful peacebuilding program and assign a marker or indicator to measure each. Shejeh Salam will collect data for each of these five indicators at the baseline, mid-line and end-line. The key issue to point out is that this indicator changes, negatively or positively, as a result of the actions or interventions of many partners who work in the same space. It is also influenced by external factors. It is nevertheless an important indicator for Shejeh Salam to keep in its radar because it is what it, jointly with other partners, aspires to see change positively over time.

A successful peacebuilding program is one where the efforts …

Indicator Weight

(1) Cause participants and communities to develop their own peace initiatives. This underlines the importance of ‘ownership’ and ‘sustainability’ of action and efforts to bring about peace, as well as creating momentum for peace, involving more people.

(a) % of community members reporting that they (respondent or other household member) are part of, or aware of, a local (community-led) conflict prevention, resolution or mitigation mechanism that was developed within the last 12 months in Shejeh Salam targeted areas.

0.18

(2) Results in the creation or reform of political institutions to handle grievances that genuinely drive the conflict. Moving beyond impacts at the individual or personal (attitudinal, material or emotional) level to the socio-political level (institutions, structures, systems).

(b) % of USAID focus counties (13) with a functional mechanism for conflict prevention, dialogue and conflict resolution. A county will be deemed to have a functional mechanism when 50% or more of the community members in Shejeh Salam targeted areas that answer “Agree” or “Strongly Agree” to the statement. “I can always turn to the County leadership, police, courts, or other structure for help in case of an imminent conflict or for redress in case of any violation or insecurity”

0.18


(3) Prompts people increasingly to resist violence and provocations to violence. ‘More People’ develop the ability to resist the manipulation and provocations of negative ‘key people’ – warlords, spoilers, et cetera

(c) % of community members who do not believe that violence is a viable way to resolve disputes, in Shejeh Salam targeted areas

0.18

(4) Results in an increase in people’s security and in their sense of security. Is there positive change both at the socio-political level (in people’s public lives) and at the individual/personal level as people gain a sense of security?

(d) % of community members reporting that their personal safety and security has increased over the last 12 months, in Shejeh Salam targeted areas. Those answering “Agree” or “Strongly Agree” to the statement. “my security or that of my family, has improved in the past year”

0.28

(5) Results in meaningful improvement in inter-group relations, for example. changes in group attitudes, public opinion, social norms, and public behaviors. Have we built relationships between conflicting groups, in terms of transforming polarizing attitudes, behaviors and interactions to more tolerant and cooperative ones?

(e) % of community members reporting having initiated or increased interaction or relationship (in the past 18 months) with members for whom they had strained relationship or past conflict, in Shejeh Salam targeted areas. Relationship could be of any type-trade, cultural (marriage, sport, camps), or even membership of same peace committee.

0.18

Social Cohesion/Community Peace Index = 0.18a+0.18b+0.18c+0.28d+0.18e

Unit of Measure: Fraction Disaggregated by: Overall, Cluster, Ethnic Group, Gender, Age (Youth, Older) Justification & Management Utility: This indicator captures the change in some dimensions of social cohesion as a result of many actors (including Shejeh Salam) working in the same conflict dynamics or space.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: Survey at Shejeh Salam Baseline, Mid-Line, and End-Line. Data Source: Shejeh Salam Survey Report. Method of data acquisition by Shejeh Salam: From the MEL Sub-Contractor Frequency and timing of data acquisition by USAID: Baseline, Midline, Endline Estimated cost of data acquisition: High. The survey will be carried out in many remote locations Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: A secure internet-based information management system managed by DT-GLOBAL known as DevResults.

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: It is a new indicator Known Data Limitations and Significance (if any): Being an index composed of five other indicators, any bias or other error, will be additive and making analysis unreliable. Actions Taken or Planned to Address Data Limitations: The individual indicators of the index have been well developed and simplified, and the MEL contractor that will be selected will be a well-established agency with intensive and extensive data collection experience in South Sudan. Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments: Internal reviews and refining the survey tool

PLAN FOR DATA ANALYSIS, REVIEW, & REPORTING

Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role.


Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Review of Data: Baseline, midline and endline reports Reporting of Data: Scheduled reports

OTHER NOTES Notes on Baselines/Targets: Since no baseline data exists, a nominal 10% points increase is targeted from baseline to mid-line to end-line.

Other Notes: N/A PERFORMANCE INDICATOR VALUES

Year Target Actual Notes March 2021 N/A Since no baseline data exists, a nominal 10% points

increase is targeted from baseline to mid-line to end-line.

March 2023 10% increase March 2025 10% increase

THIS SHEET LAST UPDATED ON: December 2020



Objective 1: Local actors are building crossline interdependence and intra- community cohesion to promote peace processes and peaceful co-existence Custom Indicator 2: % local community members reporting increased trust towards those that they have had a strained past or conflict, in Shejeh Salam targeted areas, in the past 18 months Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): This outcome indicator measures the level of change in attitude towards peace by assessing perceptions of trust or reduced fear as a result of Shejeh Salam (or other actors) interventions. The statement put to the respondent is; “My, or my family/household’s, trust in people for whom I/we had strained past relationship or conflict, has increased significantly over the last 18 months”. Members for which a relationship was strained or in conflict can be both intra or inter-ethnic. It does not include normal disagreements common among family members. Those answering “I don’t know, don’t wish to answer” are removed from the analysis. Numerator: Number answering “strongly agree” or “agree” are counted (not counted are those answering “No change”, “Disagree” and “Strongly Disagree”) Denominator: Number of respondents minus those answering “I don’t know, don’t wish to answer” Unit of Measure: Percent Disaggregated by: Cluster, Ethnic Group, Intra versus Inter Ethnic, Gender, Youth vs Older. Justification & Management Utility: This indicator captures the change in attitude as a result of Shejeh Salam interventions with potential influence of other actors.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: Survey at Shejeh Salam Baseline, Mid-Line, and End-Line. Data Source: Shejeh Salam Survey Report. Method of data acquisition by Shejeh Salam: From the MEL Sub-Contractor Frequency and timing of data acquisition by USAID: Baseline, Mid-Line, End-Line Estimated cost of data acquisition: High. The survey will be carried out in many remote locations


Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: A secure internet-based information management system managed by DT-GLOBAL known as DevResults.

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: It is a new indicator Known Data Limitations and Significance (if any): Though desirable, it will not be feasible to implement a full random sampling scheme in all situations because the number of respondents may not be very large as it may be limited to those supported by the Shejeh Salam program. In many other cases the time and financial resources may not allow the construction of the full sampling frame as it would require expensive scientific pop-based surveys Actions Taken or Planned to Address Data Limitations: Sampling will be purposeful to include areas of intense Shejeh Salam activities Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments: Internal reviews and refining the survey tool

PLAN FOR DATA ANALYSIS, REVIEW, & REPORTING Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role. Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Review of Data: Baseline, midline and endline reports Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: Although a similar indicator was collected by VISTAS program, the time taken between the two Activities as well as other dynamics it is not appropriate to set firm targets until a baseline is set in March 2021.


Year Target Actual Notes March 2021 N/A A nominal 10% point increase has been

set until a baseline is established in March 2021





Objective 1: Local actors are building crossline interdependence and intra- community cohesion to promote peace processes and peaceful co-existence Custom Indicator 3: % of community members, in Shejeh Salam targeted areas, reporting that key conflicts (namely; cattle raid/theft, revenge killing, child abduction, or rape) have reduced in the past 18 months Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): This outcome indicator measures the change in conflict incidence for the key types of conflicts. The indicator is assessed through sampling of community members in areas where Shejeh Salam has had intensive activities over a period of about two years. The following question is posed to the respondents sampled from Shejeh Salam intervention areas; Over the last one or two years what can you say has happened in your community with regard to the following conflicts; Cattle raid/theft, Age-Set fighting, Dispute over land/water resources, Political dispute, Killing (revenge, other killing), Child abduction, Rape, Other (specify)?


The responses are; [decreased significantly] [somewhat decreased] [no change, remained the same] [somewhat increased] [increased significantly] [Don’t know- can’t tell, can’t answer] Numerator= Number responding [decreased significantly] or [somewhat decreased] in 1 or more conflicts Denominator= All respondents excluding those responding [Don’t know- can’t tell, can’t answer] Unit of Measure: Percent Disaggregated by: Overall, Cluster, Conflict Type, Ethnic Group, Justification & Management Utility: This is the highest level of outcome expected through the work of Shejeh Salam program along with other actors. Simply put, it measures the level of reduction in conflict. However, data interpretation must be cautious in that this indicator is very contextual and is perception-based and therefore may not be used to generalize the situation in South Sudan where many factors contribute, positively and negatively to the peace situation.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: Survey at Shejeh Salam Baseline, Mid-Line, and End-Line. Data Source: Shejeh Salam Survey Report. Method of data acquisition by Shejeh Salam: From the MEL Sub-Contractor Frequency and timing of data acquisition by Shejeh Salam: Baseline, Mid-Line, End-Line Estimated cost of data acquisition: High. The survey will be carried out in many remote locations Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: A secure internet-based information management system managed by DT-GLOBAL known as DevResults.

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: It is a new indicator Known Data Limitations and Significance (if any): The interpretation must be cautious in that this indicator is very contextual and is perception-based and therefore may not be used to generalize the situation in South Sudan where many factors contribute, positively and negatively to the peace situation. Actions Taken or Planned to Address Data Limitations: Refining the survey tool Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments: Internal reviews

PLAN FOR DATA ANALYSIS, REVIEW, & REPORTING Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role. Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: Although a similar indicator was collected by VISTAS program, the time taken between the two Activities as well as other dynamics it is not appropriate to set firm targets until a baseline is set in March 2021.







Goal Improved Social Cohesion in targeted areas Intermediate Result 1.1

Improved capacity of a wide range of local actors to engage constructively & to successfully mitigate perceived conflict issues

Indicator 4 PS.6.2-4 Number of people participating in USG-supported events, trainings, or activities designed to build mass support for peace and reconciliation

Definition

This indicator registers number of men and women identified with a party or parties to the conflict attending events or activities, both public and private, related to building support for peace and reconciliation. Count each person only once per year. The number of events, trainings or activities designed to build support for peace and reconciliation on a mass scale should be reported under indicators PS.6.2-2.

Primary SPS Category or Area Linkage

Peace and Security 6.2, Peace and Reconciliation Process

Linkage to Long-Term Outcome or Impact

The desired long-term outcome is increased support for peace and reconciliation processes as an approach to resolve conflict. This is an output indicator that measures the number of people involved in the peace process and reconciliation funded by USG assistance. Many theories of change posit that if more of the population is involved in the peace process there will be greater support and peace will be more likely.

Indicator Type Output

Reporting Type Number of people

Use of Indicator

This indicator would be reported on a yearly basis by the USAID program office or whatever administrative organization is responsible for aggregating information for Missions and collected by the program management staff.

Reporting Frequency Quarterly reporting

Data Source Shejeh Salam grantees submitting attendance sheets for all relevant activities Disaggregate(s) By Sex: Male and Female, Youth and Older

Goal Improved Social Cohesion in targeted areas

Intermediate Result 1.1


Indicator 5 GNDR-10: Number of local women participating in a substantive role or position in a peacebuilding process supported with USG assistance

Definition

For this indicator, a peacebuilding process refers to formal (diplomatic or official) or informal (grassroots, civil society) activities aimed at preventing or managing violent conflict, resolving conflict or the drivers of conflict, and to sustaining peace following an end to violent conflict. This indicator is intended to capture the participation of local women in peacebuilding processes; to be counted in this indicator, women should be from the relevant conflict country, area, or region. This indicator does not count the participation of women in U.S. or other third-party delegations to peace processes. To be counted in this indicator, participants should have a substantive role in the peacebuilding process or initiative, meaning a participant has realistic opportunities to share information and represent her own perspectives or those of a group she represents; to help define issues, problems, and solutions; and to influence decisions and


outcomes associated with the process or initiative. To the extent practicable, individuals should be counted only once per fiscal year under this indicator. Examples: • persons serving on a local peace committee • persons representing a group or organization with official consultative status to a peace negotiation • person serving as an official delegate to a peace process

Primary SPS Linkage

This indicator is a standard gender indicator and links primarily to Program Areas PS.6 (Conflict Mitigation and Stabilization) and DR.3 (Political Competition and Consensus-Building); however, it also may be relevant for activities under other Program Areas.


Women’s participation in peacebuilding activities is posited as an important mechanism for increasing the gender-sensitivity of processes and outcomes, and for improving the overall strength and sustainability of such processes by ensuring focus on a broader set of issues relevant to preventing, managing, and resolving conflict and by bringing the skills and capacities of women to bear in these processes.

Indicator Type Output Reporting Type Number

Use of Indicator

Information generated by this indicator will be used to monitor and report on achievements linked to broader outcomes of gender equality and female empowerment and will be used for planning and reporting purposes by Agency-level, bureau-level and in-country program managers. Specifically, this indicator will inform required annual reporting or reviews of the USAID Gender Equality and Female Empowerment Policy; Women, Peace, and Security Act of 2017; and the U.S. Strategy to Prevent and Respond to Gender-Based Violence Globally, as well as Joint Strategic Plan reporting in the APP/APR, and Bureau or Office portfolio reviews. Additionally, the information will inform a wide range of gender-related public reporting and communications products, and facilitate responses to gender-related inquiries from internal and external stakeholders such as Congress, NGOs, and international organizations.


Data Source Shejeh Salam grantees submitting attendance sheets for all relevant activities Disaggregate(s) None




Indicator 6 DRL.12 Number of USG-Assisted consensus-building processes resulting in an agreement (DR.3.1-1)

Definition

Consensus-building processes include: national, sub-national, and local dialogues, as well as referenda, and peace Consensus-building processes include: national, subnational, and local dialogues, as well as referenda, and peace processes. Agreements can take the form of interim or final plans of action, constitutions, constitutional amendments, draft legislation, legislation on electoral frameworks issues, statutes, regulations, or peace agreements. Each part of the consensus-building process that results in an agreement may be counted separately, each as one unit. For example, if an operating unit works on an interim and


final action plan, which then result in an agreement, these can be counted as two processes. This may involve informal agreements.


Consensus-building processes increase the likelihood that parties will reach agreement. Such processes are a critical part of fostering an environment that is tolerant or inclusive of people of all faiths or non-belief. Over the long-term, consensus-building will result in an increase in mutual understanding and a decrease in societal conflict and instability, contributing to the development of a consensual, deliberative and participatory culture of democracy.

Indicator Type Outcome Reporting Type Number of processes

Reporting Frequency Quarterly

Data Source Shejeh Salam grantees submitting the outcomes (agreements) of all consensus-building processes in written form to Shejeh Salam

Disaggregate(s) Types of processes: number of processes related to LGBTI issues; number of processes related to women's rights issues; and number of processes related to religious freedom.

Goal Improved Social Cohesion in targeted areas Intermediate Result 1.1


Indicator 7 PS.6.2-2: Number of USG-funded events, trainings, or activities designed to build support for peace or reconciliation on a mass scale

Definition

This indicator registers the number of USG-funded activity activities – such as a trainings or events -- that aim to build popular support for peace or reconciliation among the general population. Each activity, event, or training counts as one unit. Individual training sessions are not counted, but the overall training is. To be counted, an activity, training, or event must be time-limited in duration (e.g., a two day conflict mediation training, a community soccer game to promote social cohesion, or a community dialogue on managing resource-related conflict issues). If a broader activity includes a training (or an event of some kind), only the broader activity should be counted. Generally, any event designed for the purpose of disseminating a message to the general public (as opposed to only key leaders) can be considered to support peace and reconciliation on a mass scale. The number of people attending these events, trainings or activities designed to build mass support for peace and reconciliation should be reported under indicators PS.6.2-4.




The long-term outcome desired is to build popular support for peace processes. Many theories of change posit that if there is more grassroots level support for a peace process, the potential for peace will increase. By creating activities that have these aims, projects contribute to these outcomes. Activities designed to reduce the frequency of sexual and gender-based violence or to help perpetrators and victims recover from the trauma of such violence, could fall under the definition.


Reporting Type Number of events, trainings and activities


Use of Indicator

This indicator would be reported by Shejeh Salam grantees on a monthly basis and aggregated through DevResults. It is used for Shejeh Salam program management as well as for reporting to USAID/South Sudan


Data Source Shejeh Salam grantees submitting attendance sheets and photographs for all relevant activities

Disaggregate(s) None




Indicator 8 PS.6.2-3: Number of USG supported events, trainings, or activities designed to build support for peace or reconciliation among key actors to the conflict

Definition

This indicator registers any USG funded activity – such as a training or event -- that aims to build support for peace and reconciliation among key actors of a conflict. Key actors are identified through assessments and include those individuals who individually or through an organization have or could soon have the capacity to mobilize others for violent action, peaceful intervention, or stabilization. To be counted, an activity, training, or event must be time-limited in duration (e.g., a two day conflict mediation training, a community soccer game to promote social cohesion, or a community dialogue on managing resource-related conflict issues). If a broader activity includes a training (or an event of some kind), only the broader activity should be counted. The number of events, trainings or activities designed to build support for peace and reconciliation on a mass scale should be reported under indicators PS.6.2-2.




The desired long-term outcome is increased support for peace and reconciliation processes as an approach to resolve conflict. This is an output indicator that measures the USG contribution to activities designed to build support for the peace process among elites or individuals/groups mobilizing/leading others in the conflict. Many theories of change posit that if there is more interest in peace among key parties to the conflict then the potential for peace will increase. By creating activities that have these aims, projects contribute to these outcomes.


Reporting Type Number of events, trainings and activities

Use of Indicator

This indicator would be reported by Shejeh Salam grantees on a monthly basis and aggregated through DevResults. It is used for Shejeh Salam program management as well as for reporting to USAID/South Sudan


Data Source Shejeh Salam grantees submitting attendance sheets for all relevant activities





Intermediate Result 1.1: Improved capacity of a wide range of local actors to engage constructively & to successfully mitigate perceived conflict issues Custom Indicator 9: % local community members who believe that traditional authorities are playing their role in conflict prevention, resolution or mitigation. Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): Though a custom performance indicator aimed at assessing the outcome of Shejeh Salam work, the indicator is also potentially contributed to by other partners who may be working on the same theme and in the same communities. The statement posed is: “Traditional authorities operating in your community have been playing their role their peacebuilding role effectively” Numerator: Number answering “strongly agree” or “agree” are counted (not counted are those answering “Not sure”, “Disagree” and “Strongly Disagree”) Denominator: Number of respondents minus those answering “I don’t know, don’t wish to answer” Unit of Measure: Percent Disaggregated by: Cluster, Ethnic Group, Gender, Youth vs Older. Justification & Management Utility: This indicator captures the perception of the community with regard to the role of traditional authorities as preventers of conflicts or fair interlocutors when conflicts occur. Disaggregating data by youth versus older respondents may bring out insights into whether the youth, who most of the times are the ones used in fighting, respect the authorities of traditional leaders who are in most cases expected to deal with conflict mitigation.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: Survey at Shejeh Salam Baseline, Mid-Line, and End-Line. Data Source: Shejeh Salam Survey Report. Method of data acquisition by Shejeh Salam: From the MEL Sub-Contractor Frequency and timing of data acquisition by USAID: Baseline, Mid-Line, End-Line Estimated cost of data acquisition: High. The survey will be carried out in many remote locations Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: A secure internet-based information management system managed by DT-GLOBAL known as DevResults.

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: It is a new indicator Known Data Limitations and Significance (if any): None Actions Taken or Planned to Address Data Limitations: N/A Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments: Internal reviews and refining the survey tool

PLAN FOR DATA ANALYSIS, REVIEW, & REPORTING Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Presentation of Data: Narrative and indicator matrix. Review of Data: Baseline, midline and endline reports Reporting of Data: Scheduled reports.

OTHER NOTES


Notes on Baselines/Targets: Although a similar indicator was collected by VISTAS program, the time taken between the two Activities as well as other dynamics it is not appropriate to set firm targets until a baseline is set in March 2021.








Intermediate Result 1.2: Increased mutual interdependence resulting from infrastructure and livelihoods projects

Custom Indicator 10: Number of new, or existing infrastructural investments or other relevant livelihood supported by Shejeh Salam aimed at fostering positive interdependence among and between communities (Cumulative)

Geographic Focus: South Sudan DESCRIPTION

Precise Definitions(s): An infrastructure investment could include support to small market infrastructure, market access roads, abattoirs, refurbishment or rehabilitation of critical buildings important for service delivery, training centers, and other facilities. The indicator is cumulative because in some cases the support may be continuous for a period of time even more than one year depending on the nature of support. Unit of Measure: Number of investment units supported Disaggregated by: Cluster, County Justification & Management Utility: This indicator reflects Shejeh Salam’s commitment to improving relationships between and within communities through trade and improved access to service delivery. By supporting these initiatives, Shejeh Salam aims to promote peaceful interaction in conflict-affected areas of the country.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: The target for this indicator is set at the beginning of each activity and recorded in DevResults. Shejeh Salam has direct access to the data because it is the that decides the investments to be supported by the various grantees. Data Source: Shejeh Salam has direct access to the data because it is the that decides the investments to be supported by the various grantees. Method of data acquisition by USAID: Scheduled contractual quarterly progress reports submitted by Shejeh Salam to the USAID COR. Frequency and timing of data acquisition by USAID: Quarterly, submitted 30 days after each quarter. Estimated cost of data acquisition: Low Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: September 2021 (internal) Known Data Limitations and Significance (if any): None Actions Taken or Planned to Address Data Limitations:


Date of Future Data Quality Assessments: TBD by USAID Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly reports, and Cluster Evaluations to be filed by the regional teams, led by the Monitoring and Evaluation Team. Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: Targets are set in discussion with the Shejeh Salam team, based on available funding and regional priorities.


Year Target Actual Notes September 2021 0 Not possible to execute this in year 1 September 2022 5 1 per cluster September 2023 7 1 or 2 per cluster September 2024 11 2 or 3 per cluster September 2025 13 2 or 3 per cluster




Objective 2 Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes

Indicator 11 CBRD-9: Percent of USG-assisted organizations with improved performance

Definition

This indicator measures whether USG-funded capacity development efforts have led to improved organizational performance in organizations receiving organizational capacity development support. Key concepts: Capacity is the ability of people, organizations and society as a whole to manage their affairs successfully. Capacity development is the process of unleashing, strengthening and maintaining such capacity. Capacity is a form of potential; it is not visible until it is used. Therefore, performance is the key consideration in determining whether capacity has changed. Organizations with improved performance will have undergone a deliberate process undertaken to improve execution of organizational mandates to deliver results for the stakeholders it seeks to serve. Indicator Formula: This indicator should only be used when conditions (a) and (b), as described below, are met. Targets should be set and results should be reported using this formula for the overall indicator and each of the disaggregates: Numerator = number of organizations with improved performance Denominator = number of USG-assisted organizations receiving organizational capacity development support Targets for both the numerator and denominator should be set for the aggregate; they do not need to be set for the disaggregates. Results should be reported for both numerator and denominator for the aggregate and disaggregate types. Denominator calculations for the process of organizational capacity development: Organizations should only be counted in the denominator if they have undergone an intentional and demand-driven performance improvement process detailed in points (a) and (b) below. (a) The activity theory of change, award documents, work plan, or other relevant documentation reflects that resources (human, financial, and/or other) were allocated for organizational capacity development. (b) An organization demonstrates that it has undergone and documented a process of performance improvement, including the following four steps: (i) Obtaining input from the supported organization and/or any other relevant stakeholders to define desired performance improvement priorities, (ii) Analyzing and assessing performance gaps (the difference between desired performance and actual performance), (iii) Selecting and implementing performance improvement solutions (or the development interventions), and (iv) Using a performance improvement metric for which the organization will monitor and measure changes in performance. Numerator calculations for organizational performance improvement: Organizations should only be counted in the numerator if they are eligible to be counted in the denominator and have additionally demonstrated measurable improved performance. In addition to meeting conditions (a) and (b) above, organizations must meet the following condition: (c) An organization demonstrates that its performance on a key performance metric has


improved. Use of Approaches and/or Tools and Performance Metrics: USAID Operating Units (OUs) and/or implementing partners should work with organizations being supported to select their preferred approach and tools for facilitating the process of organizational performance improvement (e.g., university accreditation process, ISO professional farmer organization guidelines, OCA tool, etc.) and for monitoring and measuring changes on a key performance metric (e.g., increased sales, reduced staff turnover, increased efficiency of service delivery, etc.). Some tools, such as the OPI tool, are helpful for both facilitating the process of identifying performance improvement priorities and for measuring changes in performance. Regardless, OUs should ensure that any monitoring/measurement is conducted in a way that ensures data validity and reliability for a key metric of performance, rather than capacity.

Primary SPS Linkage CBLD


USAID is reorienting its strategies, partnership models, and program practices to achieve greater development outcomes and strive toward a future where foreign assistance is no longer necessary. The approach, outlined in the Agency’s Policy Framework, emphasizes the concept of “self-reliance”—defined as the capacity and commitment of a country to plan, finance, and implement solutions to solve its own development challenges in an effective, inclusive, and accountable way. The Policy Framework states that “self-reliance of communities and organizations within a country underpin countrywide self-reliance.” Capacity development also is a key component of USAID’s Acquisition and Assistance (A&A) Strategy and Effective Partnering and Procurement Reform (EPPR) recommendations. The A&A Strategy states that “USAID will shift from viewing successful local capacity building as an organization’s ability to receive and manage federal funding directly to measuring success by the strengthened performance of local actors and local systems in achieving and sustaining demonstrable results.”

Indicator Type Outcome

Reporting Type Percent

Use of Indicator

This is an Agency-wide cross-cutting indicator that applies to all sectors and standardized program areas including: peace and security; democracy and governance; health; education and social services; economic growth; and humanitarian assistance.

Reporting Frequency Annual

Data Source Shejeh Salam assessment tools


Objective 2 Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes

Indicator 12 Youth-5: Percentage of youth who participate in civic engagement activities following soft skills/life skills training or initiatives from USG assisted programs

Definition

Youth: Individuals aged 10 - 29 years of age Soft skills/life skills: a broad set of skills, competencies, behaviors, attitudes, and personal qualities that enable people to effectively navigate their environment, work well with others, perform well, and achieve their goals. This includes management, leadership, social, and/or civic engagement skills.


For the purpose of this indicator, training is defined as an intervention/session (virtual and/or in person) that has learning objectives and focuses on enhancing a certain skill. A focus group, mentoring or coaching activity, apprenticeship, or internship can be considered under training if within the listed skills topics. Individuals will be considered trained if they complete 80% of the training. Individuals completing less than 80% will not be counted. For the purpose of this indicator, initiatives are defined as interventions (virtual and/or in person) including but not limited to individual sensitization events or participation in a youth council or club. Initiatives such as media campaigns can only be counted if participants are able to be contacted within 3 months after the event for data collection. The initiative does not have to focus on social or leadership skills. Civic engagement activities include but are not limited to: registering to vote, voting, advocacy work with community and governmental leaders, or volunteerism This can be local, regional, or country specific. The civil society activity does not have to be of a certain amount of time, nor does it have to be repeated. Do not count persons who only attend training/initiative or who only participate in civil society activities. The person must have completed both the training/initiative and participated in civil society activities to be counted. Do not count civil society activities that are performed as part of the initial training or initiative. Count each person regardless of multiple trainings/initiatives or participation in multiple civil society activities. The time between training/initiative and participation should not be greater than six months. The denominator is all persons who received the training related to the activity, and the numerator is all person who participated in new civic engagement activities within six months of the event (registering to vote, voting, advocacy work with community and governmental leaders, volunteerism, etc. This can be local, regional, or country specific. The civil society activity does not have to be of a certain amount of time, nor does it have to be repeated.) Missions should report the numerator and denominator as required disaggregates along with the percentage.

Primary SPS Linkage

Cross-cutting Youth indicator


This indicator is linked to the USAID 2012 Youth in Development Policy outcome that youth fully participate in democratic and development processes, play active roles in peacebuilding and civil society, and are less involved in youth gangs, criminal networks, and insurgent organizations.

Indicator Type Outcome

Reporting Type Percent

Use of Indicator

This indicator will be used to monitor progress towards the Agency 2012 Youth in Development Policy. The Agency will be able to qualify and quantify its efforts to strategically plan and program for youth, particularly in countries that are experiencing a youth bulge. This indicator will allow for more specific quantifiable results than those captured in the Youth Key Issue Narrative.

Reporting Frequency

Annual

Data Source Data for this indicator will be collected six months after relevant USG-funded training/programming. The survey may be read to program beneficiaries who are illiterate. Each COTR or AOTR would be responsible for ensuring that implementers


collect these data. • Reports from grantees • Qualitative methods such as Focus Groups or Interviews, and Surveys

Disaggregate(s)

Number of youth who have participated in civil engagement activities (Numerator) Number of youth who have participated soft skills/life skills training or USG initiatives (Denominator) Number of males age 10-18 Number of females age 10-18 Number of males age 19-29 Number of females age 19-29 Geographic location (urban versus rural)



Objective 2: Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes

Custom Indicator 13: Number of R-ARCSS related issues monitored, or advocated for, by the Shejeh Salam-supported “National Coalition of CSOs” or “Umbrella CSO”


Precise Definitions(s): This is a custom output indicator that counts the number of distinct clauses within the R-ARCSS agreement being monitored with CSOS partners to be supported by Shejeh Salam. Since no awards have been granted at the time of this MELP, it will be difficult to obtain a baseline. The specific clauses will be identified through analysis with each partner. Unit of Measure: Number of issues or recommendations Disaggregated by: National level issues, State issues, those linked community-level conflict triggers Justification & Management Utility: Although USAID (read Shejeh Salam) does not support the Government of South Sudan directly, it supports CSOs that engage government. Shejeh Salam engagement with the Peace Agreement is critical because the issues therein affect State and Community level issues that are of great interest to Shejeh Salam grassroots interventions.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: The target for this indicator is set at the beginning of each activity and recorded in DevResults. Shejeh Salam has direct access to the data because it is the that decides the investments to be supported by the various grantees. Data Source: Shejeh Salam has direct access to the data because it works with the CSOs to come up with the issues to be monitored. Method of data acquisition by USAID: Scheduled contractual quarterly progress reports submitted by Shejeh Salam to the USAID COR. Frequency and timing of data acquisition by Shejeh Salam: Quarterly, submitted 30 days after each quarter. Estimated cost of data acquisition: Low Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: September 2021 (internal)


Known Data Limitations and Significance (if any): None Actions Taken or Planned to Address Data Limitations: Date of Future Data Quality Assessments: TBD by USAID Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly reports.

Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: Targets will be discussed with the implementing CSO which is yet to be identified and awarded.


Year Target Actual Notes September 2021 TBD Target to be set in consultation with the CSO to be awarded September 2022 TBD Target to be set in consultation with the CSO to be awarded September 2023 TBD Target to be set in consultation with the CSO to be awarded September 2024 0 The agreement will have expired September 2025 0 The agreement will have expired




Objective 2: Civil society actors are advocating for peace, justice, reconciliation, and reform; and participating in political and civic processes Custom Indicator 14: % of community members, reporting a having heard/seen a Shejeh Salam-related peace or civic education message in the past 12 months

Geographic Focus: Targeted areas of South Sudan DESCRIPTION

Precise Definition(s): The indicator assess the coverage of Shejeh Salam-related peace messages in the community in multiple ways- and hence the several data dis-aggregations. The question to be posed to the respondent are the following; In the past 12 months, have you heard or seen any of the following messages from the following sources;

From where did you hear the message?

What message did you hear?

At least one of the messages that you heard positively changed your views or actions about conflict and its methods of resolution?

Dialogue/peace meeting at known Shejeh Salam locations [Yes] [No][Not aware]

If [Yes], what message? [peace] [civic]

[Strongly Disagree] [Disagree] [Not Sure] [Agree][Strongly Agree]

Large public meeting at known Shejeh Salam locations [Yes][No}[Not aware]




Radio Listener Groups in known Shejeh Salam locations [Yes][No] [Not aware]


[Strongly Disagree] [Disagree][Not Sure] [Agree][Strongly Agree]

“Internews Radio Drama” [Yes][No] [Not aware]



Radio Tamazuj [Yes][No][Not aware]



Other Shejeh Salam-related source [Yes][No] [Not aware]



The indicator is estimated as follows; Heard message _Overall: % that have heard any Shejeh Salam-related message from any of the Shejeh Salam-related sources Numerator= Number that responded with any [Yes] for any of the Shejeh Salam sources Denominator = Number of all respondents who gave any response Message had impact _Overall: % reporting that Shejeh Salam message had impacted their life Numerator= Number that responded with [Agree] or [Strongly Agree] to any of the messages on the statement “message positively changed your views or actions about conflict and its methods of resolution” Denominator =all respondents who gave a response to the statement. Other indicator dis-aggregations are derived in a similar manner. These include; Message Type (1. Peace, 2. governance or civic-related e.g. peace agreement, Peace message), Source (1. attending a dialogue/peace meeting, 2. Attending a Shejeh Salam-related large community meeting, 3. Radio Tamazug, 4. Internews Radio Drama, 5. Shejeh Salam Listener Group, 6. during Film screens), Gender, Age (Youth, Older), Ethnic Group, Cluster. Unit of Measure: Percent Disaggregated by: Heard Message versus Message had impact, Message Type, Cluster, Ethnic Group, Gender, Age (Youth vs Older), Message Source. Justification & Management Utility: Shejeh Salam will supply hundreds of radios to the clusters it is working in. These radios will be preloaded with peace and civic education messages. Radio listener groups will be encouraged and supported so that one radio can be listened to by at least a group of 10 community members. Shejeh Salam will also support independent radio stations which will also be broadcasting Shejeh Salam-related messages. Shejeh Salam will also be conducting several dialogue and peace meetings to bring communities together, as well as organizing large community meetings to disseminated various peace agreements. Although no hard evidence is collected on impacts of the imparted messages, the community perception on impact will be captured as a proxy for impact.

PLAN FOR DATA ACQUISITION BY USAIDShejeh Salam Data collection method: Survey at Shejeh Salam Baseline, Mid-Line, and End-Line. Data Source: Shejeh Salam Survey Report. Method of data acquisition by Shejeh Salam: From the MEL Sub-Contractor Frequency and timing of data acquisition by Shejeh Salam: Baseline, Mid-Line, End-Line Estimated cost of data acquisition: High. The survey will be carried out in many remote locations Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: A secure internet-based information management system managed by DT-GLOBAL known as DevResults.

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: It is a new indicator Known Data Limitations and Significance (if any): None


Actions Taken or Planned to Address Data Limitations: N/A Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments: Internal reviews and refining the survey tool

PLAN FOR DATA ANALYSIS, REVIEW, & REPORTING Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Presentation of Data: Narrative and indicator matrix. Review of Data: Bi-annually Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: A similar indicator was collected by VISTAS program and achievements captured at the end of VISTAS have been used but adjusted downwards by 10% points to reflect the smaller overall Shejeh Salam budget compared to VISTAS. Better targets may be set after obtaining in March 2021. The % that had heard VISTAS related message was 76% and the % that reported that message had impact was 93%. The interim 5-year targets set for Shejeh Salam will be set at 66% for ‘heard message’ and 83% for ‘message had impact’


Year Target Actual Notes March 2021 N/A The % that had heard VISTAS related message was

76% and the % that reported that message had impact was 93%. The interim 5-year targets set for Shejeh Salam will be set at 66% for ‘heard message’ and 83% for ‘message had impact’

March 2023 Hear Message=TBD Message had impact=TBD

March 2025 Heard Message=66% Message had impact=83%


Goal Improved social cohesion in targeted areas


Civil society and faith-based organizations, individuals, and groups work together for effective peacebuilding, civic education, and reconciliation activities that resonate socially and culturally

Indicator 15 DRL.7 Number of individuals receiving civic education through USG-assisted programs (DR.3.2-5)

Definition Any individuals that receive civic education through print, broadcast, or new media, as well as via in-person contact can be counted. Civic education also includes curriculum-based trainings, community-based trainings in underserved areas, public service announcements on electronic media, written materials, internet-based information and messages using new media or technology (in this usage primarily, but not exclusively social networking sites like Facebook and Twitter). Grantees should list the different types of media or other contacts used in their programs, along with the objectives of the civic education programming in their country context.

Link to Long-Term Outcome or Impact

The provision of civic education in developing democracies will help ensure that individuals have the information they need to be effective participants in the democratic process, contributing to the development or maintenance of electoral democracy


Unit of Measure

Number of individuals reached


Data Source Review of project/program documents from implementers; Attendance sheets and independently collected audience estimates can also be used to demonstrate coverage. Given the data limitations, implementing partners should detail in their M&E Plan the data collection/calculation methodology for each method used, along with efforts being taken to avoid multiple counting.

Known Data Limitations

Consistency issues related to receiving reliable data on voter outreach from implementing partners. Indicator is limited in its ability to measure multiplier effects. There is a high potential for double counting.

Disaggregate(s) Number of female, male, or other; participants self-identifying as LGBTI (if possible, further disaggregate by L-G-B-T-I); youth (age: 10-29); persons with disabilities; ethnic minorities; indigenous persons; and religious minorities.



Civil society and faith-based organizations, individuals, and groups work together for effective peacebuilding, civic education, and reconciliation activities that resonate socially and culturally

Indicator 16 DRL.4 Number of civil society organizations (CSOs) receiving USG assistance engaged in advocacy interventions (DR.4.2-2)

Definition Civil society organizations (CSOs), individuals working in an individual capacity, or civil society networks that receive DRL assistance to initiate or participate in advocacy interventions. Advocacy should be understood as a means for individuals, constituencies, or organizations to shape public agendas, change public policies, and influence other processes that impact their lives. Advocacy does not involve one march, meeting or poster, but a series of strategic, interconnected, integrated activities designed to achieve a goal. It may include a wide range of activities, such as, lobbying, public interest litigation, letter writing campaigns, or civil disobedience. Advocacy interventions tend to: • Be strategic (a deliberate, planned action, not random); • Involve a set of actions that are sustained in order to build and direct pressure; • Be designed to persuade; • Be targeted; • Involve alliance building. Implementing partners should specify the type of advocacy interventions in their M&E plan and use narrative reporting to describe the scale/scope of the advocacy interventions, target audience, and intended outcomes. This type of information can be disaggregated during quarterly reporting, if implementing partners would like to categorize advocacy targets (e.g. public, influencers (media, lobbyists, non-profits), decision-makers) and scope (e.g. awareness-raising, strategic communications, policy change). If an advocacy intervention includes a component where advocates are participating in legislative proceedings or engaging in advocacy with sub-national governments, commissions or regulatory bodies, please account for this component by reporting under DRL.5 (DR4.3-1). Other components within an advocacy intervention (e.g. public awareness-raising, publications) can be reported within this indicator. If the CSO is receiving advocacy training, please report the outcome under DRL.4 (DR.4.2-2).


Link to Long-Term Outcome or Impact

Supporting local civil society to conduct advocacy improves the likelihood that nongovernmental stakeholders have a voice in public decision-making and other political processes.


Unit of Measure

Number of CSOs

Data Source Data may include, but is not limited to: local partners’ advocacy plans or strategies, implementation plans; recording of press conferences; copy of testimony or press releases; advocacy campaign materials; direct observation of advocacy initiative.


Indicator only measures the number of interventions supported. It does not measure the relevance or appropriateness of the advocacy approach or whether the correct target was identified. Please include this type of information within narrative reports (see Definition).

Disaggregate(s) Type of CSO: groups working on LGBTI issues; women's rights groups; indigenous people's groups; disability rights groups; or groups working on religious freedom.



Intermediate Result 2.2: Citizen actors participate in processes supporting transitional justice and enhancing communities’ perceptions of justice that assist formal & informal peacebuilding efforts.

Custom Indicator 17: Number of partners supported to engage on Transitional Justice Issues (e.g. support for implementation of South Sudan’s Transitional Justice Working Group (TJWG)’s Action Plan with Ministry of Justice)


Precise Definitions(s): A simple count of the number of CSOs supported by Shejeh Salam to pursue transitional justice issues.

Unit of Measure: Number of CSOs/partners Disaggregated by: National level issues, State issues, those linked community-level conflict triggers Justification & Management Utility: Although USAID (read Shejeh Salam) does not support the Government of South Sudan directly, it supports CSOs that engage government. The indicator captures efforts towards advocacy activities for Shejeh Salam-supported CSOs working on transitional justice issues, especially within the Ministry of Justice.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: The target for this indicator is set at the beginning of each activity and recorded in DevResults. Shejeh Salam has direct access to the data because it is the that decides the investments to be supported by the various grantees. Data Source: Shejeh Salam has direct access to the data because it is the one that awards grants. Method of data acquisition by USAID: Scheduled contractual quarterly progress reports submitted by Shejeh Salam to the USAID COR. Frequency and timing of data acquisition by USAID: Quarterly, submitted 15 days after each quarter. Estimated cost of data acquisition: Low Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: September 2021 (internal) Known Data Limitations and Significance (if any): None


Actions Taken or Planned to Address Data Limitations: Date of Future Data Quality Assessments: TBD by USAID Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly reports.

Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: Although no awards have been made Shejeh Salam has done preliminary analysis on the number of partners it may support across the years.


Year Target Actual Notes September 2021 2 September 2022 3 September 2023 3 September 2024 3 September 2025 1



Objective 3 Key partners are providing trauma awareness services to communities

Indicator 18 Number of people provided with trauma awareness services

Definition

This is a custom indicator to measure achievement of objective 3. Trauma awareness may be provided as standalone but in most cases it will be integrated into other Shejeh Salam activities especially in peace dialogues. Approximately 40% of all participants of substantive nature stemming from activities under PS.6.2-3 will be provided with trauma awareness services.


The desired long-term outcome is increased coverage of trauma awareness services in order to make individuals and communities less prone to trauma-induced aggression that hinder them from effective interactions and engagement in peacebuilding efforts.


Reporting Type Number of people

Use of Indicator

Indicator will be used to assess the scale, and extent of integration, of trauma awareness services in Shejeh Salam target areas.

Disaggregate(s) Module, Shejeh Salam objective, Gender, Ethnic Group



Goal: Improved Social Cohesion in targeted areas OBJECTIVE 3: Key partners are providing trauma awareness services to communities Custom Indicator 19: % of community members with awareness of trauma in Shejeh Salam targeted areas Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): This measures the prevailing state of trauma awareness within the community, including a sense of penetration of trauma-related interventions by Shejeh Salam and other actors in Shejeh Salam targeted areas. The indicator measures three dimensions; Knowledge-% with adequate knowledge of trauma in the community The interview would give a brief introduction of trauma is without going into many details but ensuring that a participant understands the concept. Then the interviewer would ask about some slightly in-depth knowledge of trauma. For each of symptoms, causes and effects, a checklist of both correct and incorrect terms defining it will be given. A respondent must be able to identify more than half of the correct items, and allowed to pick wrongs ones but these must be less than half of the incorrect ones. To be counted as having adequate knowledge of trauma, one must knowledge of all three, symptoms, causes and effects of trauma. not pick must pick at most less than half of the incorrect ones for each of symptoms and for causes and for effects. Example; Symptoms [correct= aggression, isolation, irritable; incorrect= defeating someone in a wrestling match, dancing, happiness]- to be counted as having knowledge of symptoms, the participant must pick 2 or more in the correct list and not more than 1 item in the incorrect list. Numerator= Number with knowledge of all three (symptoms, causes, and effects) Denominator= All respondents who answered the questions fully Trauma in the community- %, among those with any/minimum knowledge of trauma, able to relate trauma with aggression behavior and conflict The interviewer will quickly determine those that have some knowledge of trauma by picking those that will have qualified on any knowledge of either symptoms, causes or effects and pose the follow-up statement; “Trauma is one of the significant contributors to escalation of violence in the households and in communities. Numerator= Number with [very much so][to some extent yes] Denominator=Number with [very much so][to some extent yes][I am not sure, I don’t know][I don’t think so][certainly no] Trauma interventions in the community- %, among those with any/minimum knowledge of trauma, reporting that there are some trauma related interventions in the community. The interviewer will quickly determine those that have some knowledge of trauma by picking those that will have qualified on any knowledge of either symptoms, causes or effects and pose the follow-up statement; “what would you say is the scale of trauma detection, management or referral interventions in the community? Numerator: Number with [adequate interventions exist and by many actors][some, but inadequate by a few actors] Denominator: Number with [adequate interventions exist and by many actors][some, but inadequate by a few actors] [Not sure, can’t answer][I understand the question and there are such activities in my community] Unit of Measure: Percent Disaggregated by: Cluster, Gender, Ethnic Group, Age (Youth, Older)

Justification & Management Utility: The indicator is both performance as well as context because Shejeh Salam trauma awareness training extended to individuals is expected to cascade into the general community. It is also context because the scale of Shejeh Salam activities, focused on training of individuals, may not be that high that they will cause major changes at the community level. However, it is expected that the indicator will register changes over the five-year period. Therefore, relatively lower targets will be set because of these reasons.


PLAN FOR DATA ACQUISITION BY Shejeh Salam Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Data collection method: Assessment Tool Data Source: Primary data collection through assessments carried out by Shejeh Salam staff Method of data acquisition by Shejeh Salam: Master trainers reports Frequency and timing of data acquisition by Shejeh Salam: Semi-annually Estimated cost of data acquisition: Medium-since data collection will be piggy- backed on scheduled trauma awareness sessions. However, additional MEL specialists or data collectors will be needed. Individual Responsible at Shejeh Salam: Shejeh Salam trauma awareness trainers and MEL Staff Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: This is a new indicator Known Data Limitations and Significance (if any): The fact that one is being tested on the knowledge of a concept that has to be explained first in itself has data quality issues. So it will depend on the skill of the interviewer to be able to communicate effectively without giving out the answers. Literacy also is a factor as many community members may understand trauma in their own way but not the way it may be introduced by the interviewer. There are also potential for confounding of trauma with deep-rooted cultural beliefs- example, many may associate mental illness due to traumatic experience as caused by witchcraft and therefore they may not offer such condition as an effect of trauma. Actions Taken or Planned to Address Data Limitations: Shejeh Salam will ensure that the MEL contractor uses data collectors who understand the cultural and other attributes of the community. Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role. Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: No baseline data exist and targets will therefore be set upon obtaining the baseline in March 2021.

PERFORMANCE INDICATOR VALUES Year Target Actual Notes

March 2021 N/A March 2023 TBD March 2025 TBD




Goal: Improved Social Cohesion in targeted areas Intermediate Result 3.1: Stakeholders recognize signs of trauma and distress and are able to approach intra- and inter-community engagement and dialogue with increased sensitivity Custom Indicator 20: Change (% points from before to after) in Individual trauma-related knowledge/attitude/practice after Shejeh Salam interventions Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): This measures the immediate outcomes of Shejeh Salam trauma awareness activities. It will be measured immediately before and after a Shejeh Salam activity using a small, 6-10, sample of representative and randomly selected participants so that the numbers captured semi-annually or annually can be used to compute the indicators depending on volume of data acquired. The indicator measures three dimensions of change; (1) Knowledge of common symptoms, causes and effects of trauma in individuals, (2) Attitude about trauma, (3) Practice change in form of changes in the key trauma-induced psychosocial states in a participant. Knowledge A checklist will be provided to the interviewer for each of the common symptoms, causes and effects of trauma but in each category, there will be an odd number of untrue statement/terms. For a participant to be considered to have knowledge of any of the category, s/he will need to pick more than half of the correct items in the checklist and must pick less than half of the incorrect ones at most. Example; Symptoms [correct= aggression, isolation, irritable; incorrect= defeating someone in a wrestling match, dancing, happiness] To de counted as having knowledge of symptoms, the participant must pick 2 or more in the correct list and not more than 1 item in the incorrect list.

(1) Participant

Did the participant demonstrate knowledge of trauma? i.e. was s/he able to pick two thirds or more of the correct symptoms, causes, or impacts of trauma but not picking more than a quarter of the incorrect ones?

(5) Did the participant get three YES responses, i.e. a YES each for symptoms, causes, and impacts?

(2) Symptoms

(3) Causes (4) Effects

1 [YES] [NO] [YES] [NO] [YES] [NO] [YES] [NO] … [YES] [NO] [YES] [NO] [YES] [NO] [YES] [NO] N [YES] [NO] [YES] [NO] [YES] [NO] [YES] [NO]

Numerator=Total number of YES responses in column 5 n Denominator=Total number trained and interviewed N

Attitude For this dis-aggregation/dimension, a plain statement will be put across to the participant; Individuals, families, and communities can heal from trauma? Numerator=Number answering [strongly agree] or [agree] Denominator= Number responding with [strongly agree][agree][Not sure, don’t know][disagree][strongly disagree] Behavior/practice This is the most involving part of the assessment and also potentially difficult to capture actual changes because the trauma awareness sessions are not counselling sessions and the interviewer is also not a counsellor or a clinician. It nevertheless is a useful proxy measure of the actual change in the person’s immediate behavior towards others. The tool has 10 dimensions: Isolation: □ Feeling very isolated from others □ Feeling somewhat isolated from others □ Not sure what I feel □ Feeling somewhat willing to interact with others □ Feeling very willing to


interact with others, Violence: □Feeling very violent □Feeling somewhat violent □Not sure what I feel □ Feeling somewhat positive □ Have positive thinking, Revenge: □ Feeling revengeful □Feeling somewhat revengeful □Not sure what I feel □Feeling somewhat forgiving □ Feeling very forgiving, Pain: □ Constant headaches □ Headache Sometimes □Not sure □ Have less pain □ Pain is gone, Faith: □Low faith □ Somewhat low faith □Not sure □Somewhat prayerful □Very prayerful, Aggression: □ Feeling aggressive □ Feeling somewhat aggressive □Not sure □Somewhat less aggressive □ In good relations with others, Attention: □Very absent-minded □Somewhat absent-minded □Not sure □ Somewhat attentive □ Very attentive all the time, Anger: □Feeling very angry □Feeling somewhat angry □Not sure what I feel □ Feeling somewhat self-controlled □ Feeling self-controlled, Lack of sleep: □I lack sleep □Somewhat lack sleep □Not sure □ Somewhat adequate sleep □ Have adequate sleep, Hopeful: □ I feel very hopeless □I feel somewhat hopeless □Not sure what I feel □I feel somewhat hopeful □I feel very hopeful Numerator= Number of participants demonstrating any positive change, from the pre-test to the post-test, in more than half of the dimensions responded to- i.e. any movement from left to the right in the continuum for any dimension among those that the participant has given a response. A participant will only be included in the analysis if s/he responded to 6 or more of the 10 dimensions. Denominator= Will include only those participants that responded to 6 or more of the dimensions. Unit of Measure: Percent Disaggregated by: Cluster, Gender, Ethnic Group, Shejeh Salam Objective, Age (Youth, Older) Justification & Management Utility: The indicator assesses effectiveness of the trauma awareness training on the knowledge of symptoms, causes, and impacts of trauma. It is useful because the first step in behavior change is the acquisition of the necessary knowledge. It also assesses change in behavior which is crucial for effective engagement especially when participating in peace dialogues or meetings or in allowing linkage with other communities for trade or other livelihood activities.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data Analysis: Data used to inform rolling assessments, and scheduled reports including Quarterly and Annual reports, and cluster analyses provided to Regional Teams for adaptive management. Data collection method: Assessment Tool Data Source: Primary data collection through assessments carried out by Shejeh Salam staff Method of data acquisition by Shejeh Salam: Master trainer reports Frequency and timing of data acquisition by Shejeh Salam: Semi-annually Estimated cost of data acquisition: Medium-since data collection will be piggy- backed on scheduled trauma awareness sessions. However, additional MEL specialists or data collectors will be needed. Individual Responsible at Shejeh Salam: Shejeh Salam trauma awareness trainers and MEL Staff Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: This is a new indicator Known Data Limitations and Significance (if any): The assessment of the behavior component of the indicator may potentially present difficulties because the trauma awareness sessions are not counselling sessions and the interviewer is also not a counsellor or a clinician. It nevertheless is a useful proxy measure of the actual change in the person’s immediate behavior towards others as this becomes necessary during peace dialogues and other community interactions such as in trade and other livelihood activities. Actions Taken or Planned to Address Data Limitations: Shejeh Salam will make all efforts to utilize the master trainers who were trained in this type of data collection during the VISTAS program. Date of Future Data Quality Assessments: September 2022 Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role. Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly.


Reporting of Data: Scheduled reports. OTHER NOTES

Notes on Baselines/Targets: A similar indicator was assessed during VISTAS and had the following performance; Knowledge 22% change (from 52% before to 74% after), Attitude 10% change (from 78% to 88%) and behavior change occurred in 58% of the participants. Because it is more difficult, as expected, to change behavior compared to knowledge and attitude a 5% change will used as the target while knowledge and attitude will have targets of 20% and 10% points change respectively.

PERFORMANCE INDICATOR VALUES Year Target Actual Notes

September 2021 Knowledge=20%, Attitude=10%, Behavior=5%








Community members access independent media outlets and participate in peaceful and purposeful debate, and are able to resist misinformation, disinformation and hate speech

Indicator 21 DRL.10 Number of journalists trained and supported (DR.5.2-2)

Definition

Count journalists, editors, and related production staff for news and public information media. Implementing partners should qualify this indicator in their narrative, if possible (i.e., by noting the operating context, the type of human rights work focused on by journalists). Training refers to all training or education events whether short-term or long-term, in country or abroad. It includes pre-service and in-service training for journalists, editors, and related production staff for news and public information media. The level of training includes basic, technical, university, mid-career, and certification training. If implementing partners are working with other human rights defenders—who investigate, document, educate, advocate, organize, communicate, pressure, and/or work to hold accountable those who violate the liberties of others—use DRL.1 (DR.6.12). Support includes training, grants or other support designed to improve human rights information services and reporting for citizens. People attending the same type of training, but on different subjects, can be counted twice. Narrative reports should indicate the type of training, who the training is for, level of training, duration of training, what constitutes completion. It is required that training follow a documented curriculum with stated objectives and/or expected competencies; all data should be sex dis-aggregated; and where possible, training should meet national or international standards.


Like human rights defenders, journalists are on the frontlines of human rights protection. They are a key aspect to government accountability and contribute to transparency by reporting violations of human rights standards. To the extent journalists are trained and supported to improve their abilities to investigate and report on human rights violations, rights could be more easily respected and ensured.



Reporting Type Number of journalists

Data Source Training attendance sheets. Implementing partners should determine whether training registration sheets or attendance sheets can be used. This will depend on country context and the need to protect human rights defenders in-country. Direct observation can also be used to note the number trained.


If using training attendance sheets, participants are sometimes uncomfortable providing detailed demographic information. If using direct observation, disaggregates on demographic characteristics cannot be applied, as participants must self-identify with regard to gender or ethnicity.

Disaggregate(s) Number of female, male, or other; participants self-identifying as LGBTI (if possible, further disaggregate by L-G-B-T-I); youth (age: 10-29); persons with disabilities; ethnic minorities; indigenous persons; and religious minorities.




Indicator 22 DR.5.3-1 Number of non-state news outlets assisted by USG

Definition

Non-state-controlled news outlets include privately-owned, community, or independent public service media outlets. Types of platforms include: television, radio, print or Internet media outlets that produce news and public affairs related contents. Media outlets should be defined as organizations (i.e. two or more people), but do not need to be formally registered in their countries. Individual human rights defenders (e.g. journalists, bloggers) assisted by the USG should not be counted (see DR.6.1-2).

Primary SPS Linkage DR.5.3 Outlets and Infrastructure


Indicator measures USG activity aimed at strengthening independent sources of professional and objective news and information through USG assistance such as training, grants or other support designed to improve the quantity and quality of professional and objective news available to the public.


Reporting Type Number of news outlets

Use of Indicator

Proxy for level of effort by USAID and U.S. Department of State to support the development of independent media. DRL also uses this indicator for internal learning on USG media efforts and to help with reporting on media-related taskers, such as during World Press Freedom day.





Indicator 23 DR.5.3-2: Number of USG-assisted media-sector civil society organizations (CSO) and/or institutions that serve to strengthen the independent media or journalists

Definition To qualify CSOs and institutions must endeavor to defend free media rights, provide professional journalism or media training, lobby on behalf of independent media sector


interests, and/or otherwise serve to strengthen the functioning of independent media and/or journalists as at least one substantive component of their mission or agenda. Examples include: journalists unions, media industry associations, mid-career journalist training centers, university journalism schools, press councils, media rights monitoring groups, or any CSO which serves to strengthen or support the independent media and/or journalists as part of its mission.

Primary SPS Linkage DR.5.3 Outlets and Infrastructure


Media-sector CSOs protect freedom of the press and expression, raise the professional quality of journalism, lobby for independent media industry interests, and/or otherwise strengthen the functioning of the independent media, thereby bolstering the media’s Fourth Estate checking functions, better informing all democratic processes, and contributing to transparency.


Reporting Type Number of CSOs and support institutions

Use of Indicator

Used by USAID and U.S. Department of State as a proxy measure for level of effort, and diversity of media sector approaches. DRL uses this indicator for internal learning on USG media efforts and to help with reporting on media-related taskers, such as during World Press Freedom Day. It will help DRG and USG assess progress made towards Stand with Civil Society.

Disaggregate(s) N/A


Goal: Improved social cohesion in targeted areas

Intermediate Result 4.1: Community members access independent media outlets and participate in peaceful and purposeful debate, and are able to resist misinformation, disinformation and hate speech Custom Indicator 24: Number of radios distributed by Shejeh Salam in the communities Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): Simple count of the radios distributed to the community. A radio may be pre-loaded with Shejeh Salam-related peace message. Unit of Measure: Number Disaggregated by: Cluster, Gender. Justification & Management Utility: Access to radio, within or outside household, is low in South Sudan. Yet it is the main source of peace and civic education related messages. Increasing radio access is the long-term goal.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: Inventory Data Source: Shejeh Salam radio distribution lists Method of data acquisition by Shejeh Salam: Internal distribution lists Frequency and timing of data acquisition by USAID: Quarterly Estimated cost of data acquisition: While the effort of distributing radios in remote places may be medium, the cost of data collection is low Individual Responsible at Shejeh Salam: MEL Manager


Location of Data Storage: DevResults DATA QUALITY ISSUES

Date of Initial Data Quality Assessment: This is a new indicator Known Data Limitations and Significance (if any): None Actions Taken or Planned to Address Data Limitations: Date of Future Data Quality Assessments: TBD by USAID Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role. Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets:





Goal: Improved social cohesion in targeted areas

Intermediate Result 4.1: Community members access independent media outlets and participate in peaceful and purposeful debate, and are able to resist misinformation, disinformation and hate speech Custom Indicator 25: Number of radio listener groups established through Shejeh Salam efforts Geographic Focus: Targeted areas of South Sudan

DESCRIPTION Precise Definition(s): A listener group is made up of about 10 community members listening to one radio at least once a week. Unit of Measure: Number Disaggregated by: Cluster Justification & Management Utility: Listener groups are effective way of ensuring better understanding of content and hence increased impacts of messages. They also help to increase radio access as well as higher coverage of peace and civic education messages.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: Shejeh Salam grantee lists of listener groups. Data Source: Shejeh Salam grantee lists of listener groups.


Method of data acquisition by Shejeh Salam: Shejeh Salam grantee lists of listener groups Frequency and timing of data acquisition by Shejeh Salam: Quarterly Estimated cost of data acquisition: low Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: This is a new indicator Known Data Limitations and Significance (if any): None Actions Taken or Planned to Address Data Limitations: Date of Future Data Quality Assessments: TBD by USAID Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly and Annual reports, and Cluster Evaluations to be conducted by the Regional Teams with the Monitoring and Evaluation Team in a leading role. Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly Reporting of Data: Scheduled reports

OTHER NOTES Notes on Baselines/Targets: It is estimated that a third of all radios distributed will have a listener group. There is no data to support this targeting but Shejeh Salam will make efforts to have higher performance.






All Shejeh Salam objectives

Custom Indicator 26: Number new, or existing physical infrastructural projects supported by Shejeh Salam aimed at enhancing the work performance of local actors or partners, or for fostering positive interdependence among and between communities (Cumulative)


Precise Definitions(s): An infrastructure investment could include anything to do with physical construction or other facility aimed at enhancing the work performance of local actors or partners. This could involve supporting construction and equipping of office facility for a radio station, or offices for a local peace association, or refurbishing of local authority courts and so forth. These physical investments also include those constructed under Shejeh Salam Intermediate Result 1.2 for fostering community interdependence such as small market infrastructure, market access roads, abattoirs, refurbishment or rehabilitation of critical buildings


important for service delivery, training centers, and other facilities. The indicator is cumulative because in some cases the support may be continuous for a period of time even more than one year depending on the nature of support. Unit of Measure: Number of investment units supported Disaggregated by: Cluster, County Justification & Management Utility: This indicator reflects Shejeh Salam’s commitment to supporting the ability of local actors or partners improving relationships between and within communities through trade and improved access to service delivery. By supporting these initiatives, Shejeh Salam aims to promote peaceful interaction in conflict-affected areas of the country.

PLAN FOR DATA ACQUISITION BY Shejeh Salam Data collection method: The target for this indicator is set at the beginning of each activity and recorded in DevResults. Shejeh Salam has direct access to the data because it is the that decides the investments to be supported by the various grantees. Data Source: Shejeh Salam has direct access to the data because it is the that decides the investments to be supported by the various grantees. Method of data acquisition by Shejeh Salam: Scheduled contractual quarterly progress reports submitted by Shejeh Salam to the USAID COR. Frequency and timing of data acquisition by Shejeh Salam: Quarterly, submitted 30 days after each quarter. Estimated cost of data acquisition: Low Individual Responsible at Shejeh Salam: MEL Manager Location of Data Storage: DevResults

DATA QUALITY ISSUES Date of Initial Data Quality Assessment: September 2021 (internal) Known Data Limitations and Significance (if any): None Actions Taken or Planned to Address Data Limitations: Date of Future Data Quality Assessments: TBD by USAID Procedures for Future Data Quality Assessments:


Data Analysis: Rolling assessments, AEFs, and scheduled reports including Quarterly reports, and Cluster Evaluations to be filed by the regional teams, led by the Monitoring and Evaluation Team. Presentation of Data: Narrative and indicator matrix. Review of Data: Quarterly. Reporting of Data: Scheduled reports.

OTHER NOTES Notes on Baselines/Targets: Targets are set in discussion with the Shejeh Salam team, based on available funding and regional priorities.


Year Target Actual Notes September 2021 0 Not possible to execute this in year 1 September 2022 5 1 per cluster September 2023 7 1 or 2 per cluster September 2024 11 2 or 3 per cluster September 2025 13 2 or 3 per cluster



U.S. Agency for International Development

www.usaid.gov

Documents

Shejeh Salam MELP approved