19
2011 Impact Evaluation Tanzania Floresta-Plant With Purpose Key Points major changes in target communities are increased savings & income caused largely by the impact of VICOBA groups, and a decline in values, caused mainly by outside influences such as globalization top three institutions working most closely with communities are VICOBA, the church/religion, and Floresta Floresta target households show improved conditions in economic, environment, and spiritual indicators compared to non-target households 50% of Floresta member households say they have sufficient savings to meet household needs for 6 months, compared to only 6% of non-member households 90% of Floresta member households have planted some trees in the past 12 months, compared to 52% of non-member households Areas immediately around Floresta target villages show positive vegetation change, compared to the larger region which shows negative vegetation change due to drought almost all Floresta-trained households have shared their knowledge with friends and neighbours, and 94% of households say their neighbours are applying this knowledge Acronyms BRAC-Bangladesh Rehabilitation Assistance Committee KINAPA-Kilimanjaro National Park KNCU-Kilimanjaro Native Coffee Union MODIS-Moderate Resolution Imaging Spectroradiometer NBS-National Bureau of Statistics TANESCO-Tanzania Electrical Supply Company TASAF-Tanzania Social Action Fund NASA-National Aeronautics & Space Agency NDVI-Normalized Difference Vegetation Index SACCOS-Savings and Credit Cooperatives VEP-Village Education Project VICOBA-Village Community Bank Introduction Measuring progress is a critical step in the development process. Trees are planted, loans are made, trainings are done, but how do these activities affect farmers? Do they make a difference? Is the condition of rural families improving? Measuring change is not easy, and being able to attribute change to one factor or other, such as program activities, is even more difficult. This study measures the economic, environmental, and spiritual condition of rural families in Tanzania, in the region of Kilimanjaro and where possible, connects change in those conditions to Floresta-Tanzania program activities.

2011 Impact Evaluation - Tanzania

Embed Size (px)

DESCRIPTION

Plant With Purpose's triennial assessment and impact evaluation. Most recently conducted in 2011.

Citation preview

Page 1: 2011 Impact Evaluation - Tanzania

2011 Impact EvaluationTanzania

Floresta-Plant With Purpose

Key Points

➢ major changes in target communities are increased savings & income caused largely by the impact of VICOBA groups, and a decline in values, caused mainly by outside influences such as globalization

➢ top three institutions working most closely with communities are VICOBA, the church/religion, and Floresta

➢ Floresta target households show improved conditions in economic, environment, and spiritual indicators compared to non-target households

➢ 50% of Floresta member households say they have sufficient savings to meet household needs for 6 months, compared to only 6% of non-member households

➢ 90% of Floresta member households have planted some trees in the past 12 months, compared to 52% of non-member households

➢ Areas immediately around Floresta target villages show positive vegetation change, compared to the larger region which shows negative vegetation change due to drought

➢ almost all Floresta-trained households have shared their knowledge with friends and neighbours, and 94% of households say their neighbours are applying this knowledge

AcronymsBRAC-Bangladesh Rehabilitation Assistance CommitteeKINAPA-Kilimanjaro National ParkKNCU-Kilimanjaro Native Coffee UnionMODIS-Moderate Resolution Imaging SpectroradiometerNBS-National Bureau of StatisticsTANESCO-Tanzania Electrical Supply CompanyTASAF-Tanzania Social Action FundNASA-National Aeronautics & Space AgencyNDVI-Normalized Difference Vegetation IndexSACCOS-Savings and Credit CooperativesVEP-Village Education ProjectVICOBA-Village Community Bank

IntroductionMeasuring progress is a critical step in the development process. Trees are planted, loans are made, trainings are done, but how do these activities affect farmers? Do they make a difference? Is the condition of rural families improving? Measuring change is not easy, and being able to attribute change to one factor or other, such as program activities, is even more difficult. This study measures the economic, environmental, and spiritual condition of rural families in Tanzania, in the region of Kilimanjaro and where possible, connects change in those conditions to Floresta-Tanzania program activities.

Page 2: 2011 Impact Evaluation - Tanzania

MethodologyThis evaluation draws data from four different sources:1. Participatory workshops with farmers who are both Floresta program participants and non-participants2. A quantitative household survey of program participants and non-participants3. An analysis of vegetative cover using NDVI (Normalized Difference Vegetation Index)4. Tanzanian government census dataComparisons are made among the various data sources in order to develop a more reliable picture of the current condition of rural families in the project target area of Tanzania.

All indicators for all four sources were selected using the Plant With Purpose theory of change. The theory of change delineates the way in which the organization works towards long term change, and measurable indicators are assigned to the various outcomes in the theory of change pathways. The theory of change is depicted below.

Participatory Workshops: Participatory tools are used in community development not only as a useful way of collecting information, but more importantly as a means to help communities think about their own resources and challenges, and develop their own plans and goals. In this study, participants representing all sectors of the community—men, women, young, old, farmers, merchants, trades people-- discussed issues in the community using two participatory tools:

Page 3: 2011 Impact Evaluation - Tanzania

i) Institutional Analysis—community members listed the organizations/institutions both local and external who have been present in the area during the past 3 years. Community members assigned a ranking to each institution based on the institution`s perceived amount of resources, and rated each institution based on how satisfied community members were with the services provided by each institution.ii) Change Matrix--participants identified key changes, positive or negative in their communities in the past 3 years and discussed the causes and consequences of those changes according to the matrix shown below. Changes may be associated with the project or unassociated with the project, and are totally dependent on what the participants identify as key changes. If many changes are identified, the long list was recorded, and participants identified a maximum of 3 changes to analyze in detail.Change Causes Consequences Lessons learned

Both workshop tools were repeated with a target group—those community members that work with the program—and a non-target group—those community members who have not worked with the program. In the case of Tanzania, these workshops were conducted separately in the Marangu region, and the Malindi region.

Household Survey: a quantitative survey was conducted on 200 households in Kilimanjaro Region within the Floresta project target area from Aug. 18-Sep. 9, 2011. The sample was divided into two groups, 103 families who have participated in the Floresta program, and 97 families who have not participated—the comparison group. Sample size was based on the approximate population of the target area, and selected to maintain a margin of error of less than 8%. The survey collected information on basic household characteristics, economic activities, environmental conditions, social conditions, and spiritual conditions. Data was entered using an on-line form in order to reduce error, and data analysis was done using the R statistical system (R development core team, 2011). Results were expressed primarily as population means, and proportions, and statistically tested using the Welch two-sample T-test, or Pearsons Chi-squared test where appropriate.

Vegetation Analysis: The Normalized Difference Vegetation Index (NDVI) was used to provide an estimate of vegetative cover in the project area for the three year evaluation period, 2008-2011. NDVI is widely recognized to be highly correlated with both vegetation cover and vegetation health, and relies on the difference in plants ability to absorb light from the visible red band and the infrared band. NDVI is sensitive to all vegetation types, and does not distinguish directly between trees and other types of vegetation, however, high NDVI values are typically highly correlated with tree cover. This study used satellite data from MODIS sensors (Moderate Resolution Imaging Spectroradiometer) using 30 day composited data at a 1 km resolution (NASA, 2011). NDVI values were averaged from three periods, dry season (Sep.), wet season (Apr.), and the transition between wet and dry season (Jun.). These averaged values were taken as representative for the year, and for two annual periods, 2008 and 2011. These annual values were then averaged by subwatersheds within the Floresta project area and change over the 3 year period measured.

Tanzanian Government Census Data: Various statistics were drawn from the population and housing census of 2002 (TBS, 2002) for comparison to data collected in this study.

Page 4: 2011 Impact Evaluation - Tanzania

Results

Participatory Workshops

Institutional AnalysisIn the institutional analysis, workshop participants who have worked with Floresta (target group) and those who have not worked with Floresta (non-target group) were asked separately to identify institutions both local and external who have worked in their communities. Participants were also asked to evaluate each institution based on the perceived amount of resources which each institution has, and the effectiveness or proximity with which each institution works with the community. Perceived amount of resources are categorized as small, medium, or large, and the proximity with the community is measured as distance from the centre of a symbolic circle representing the community. This distance is then measured in centimetres in order to approximately quantify proximity.

Workshop responses were similar between target and non-target groups and between the Marangu and Malindi regions. VICOBA groups, churches/religion, and Floresta scored consistently high in terms of working closely with the community and all three institutions were perceived to have access to a large amount of resources. This is particularly interesting, since VICOBA groups are completely self-funded. TASAF, the Tanzania Social Action fund, a branch of the government focused on poverty reduction, was also perceived by Malindi participants to work moderately well with the community. TANESCO, the government electrical supply company, was seen by Malindi participants as working moderately well with the community, but were seen as working poorly with the community by Marangu residents.

A summary of the institutional analysis results for all groups is shown in the tables below (note that distance represents how closely the organization works with the community and is approximately quantified in cm, based on workshop results):

Malindi Members Malindi non-membersInstitution Resources Distance (cm) Institution Resources Distance (cm)vicoba large 9 Floresta large 10Floresta large 9 Religion large 10Religion large 9 TASAF large 10TASAF large 22.7 TANESCO medium 15.2TANESCO large 25.7 Water (public) medium 21Cooperatives & marketingmedium 28.5 Health large 26Care medium 30.9 Education large 28Health large 32 Cooperatives & marketingmedium 30Kiwakuki medium 32 Forestry small 31.2Education medium 34.8 SACCOS small 34.2Agriculture large 40 Agriculture medium 35SACCOS small 44Water (public) medium 47.3Forestry large 52

Page 5: 2011 Impact Evaluation - Tanzania

Change AnalysisWorkshop participants were asked to identify major changes taking place in their communities during the 3 years of the evaluation period, 2008-2011, and identify the related causes and consequences of those changes. Where appropriate, lessons learned as a result of the changes were also cited.

Four change analysis workshops were conducted in all, in two locations—Malindi and Marangu—and with two demographic groups—Floresta members and non-members. In spite of these different settings and conditions, workshop groups held strongly related views about major changes in their communities, as well as the causes and consequences of those changes. The positive influence of Floresta training and support was cited in every case, with the result being increased income, increased savings and related secondary benefits such as improved education, increased agricultural production, and improved health. Groups consistently asserted that 'unity is strength' and 'knowledge is the key to life', as factors in this economic development. Focus groups were also very concerned about declining values caused by globalization and the emulation of foreign values. Many consequences of declining values were mentioned including increased drug use, increase in disease, and unexpected pregnancy. Groups suggested a return to traditional religious and cultural values to counter this phenomenon.

Change analysis results for all groups are summarized in the tables below:

Marangu members Marangu non-membersInstitution Resources Distance (cm) Institution Resources Distance (cm)Floresta large 10 vicoba large 9.4vicoba Floresta large 10 Water (public) large 10.9Churches large 10 Religion large 11.3Umwi medium 18.8 Education large 20.9Communication large 25.8 Floresta large 27.4KNCU small 26.8 Health large 27.8school large 32.9 Kiwakuki large 30.4KINAPA medium 34 KNCU medium 32.5Agriculture large 34.8 tourism small 35Water (public) small 37.8 TANESCO medium 36.1hospital large 38.2 State council small 40.3VEP medium 42 court small 43.1vicoba vunjo small 46.1 KINAPA small 44.8TANESCO small 52.3 police mediium 55.8police small 60BRAC small 65.5

Page 6: 2011 Impact Evaluation - Tanzania

All Changes, MaranguMarangu members Weight Marangu non-members Weightincreased savings 20 improved development 20improved education in the community 11 change of youth behaviour 12decline in values 10 increased income 10increase in income 10 globalization 6increased environmental protection 9 increased water service 4improved nutrition 5 improved knowledge 4improvement of drainage canals 5 increased cost of living 4rising cost of healthcare 5 decline in health 3improvement of roads 4 change in standard of living for mothers 2change in climate for the worse 3 degradation of the environment 2improved animal husbandry 2 improved livestock raising techniques 2improvement of school buildings 1 improved agriculture 1

Change Matrix, Target Group, MalindiChange Causes Consequences Lessons learned

-affordable credit -many children go to school

-business training -payment of school fees has been simplified -time management-savings -production has increased

2. decline in values -increase in foolish behaviour

-use of drugs -decline in education -globalization is not good-negative influence of globalization -decrease in safety

-spread if HIV/AIDS-increase in rape-unexpected pregnancy

3. water tanks -loss of water

-increase in vegetable cultivation -water is life

-increased time for productive activities

1. vicoba has improved knowledge

-unity is strength, division is weakness

-emulating the styles and characteristics of foreigners

-hold to African traditions and customs that are good

-decrease the discomfort of the long walk to fetch water, especially for mothers and students in the home

-empowerment by building water tanks

-knowledge of rainwater harvesting from Floresta

All Changes, MalindiMalindi members Weight Malindi non-members Weightvicoba has improved knowledge 28 improved health 14decline in values 12 introduction of vicoba and Floresta 12water tanks 11 introduction of organic farming by Floresta 8improved way to do savings 9 decline in values 7introduction of family planning 7 improved knowledge 4increasing prices 6 installation of water tanks by Floresta 3installation of improved stoves 5 improvement of the government office 2improved communication 5 improved agriculture 2increased use of solar lights 3 increased lending for education 2increased vegetable production 2 improved communication 1increased environmental degradation 1 improvement of school buildings 1artificial insemination of livestock 1 introduction of solar lights 0

increased savings 0

Page 7: 2011 Impact Evaluation - Tanzania

Change Matrix, Target Group, MaranguChange Causes Consequences Lessons learned

-training from Floresta -increase in income -unity is strength-better health-protection of the environment-better housing-improvement of family knowledge-increase in entrepreneurship

-building of schools -many children get more education -knowledge is the key to life-introduction of Floresta -poverty reduction

-lack of teachers-lack of instruction-lack of desks-shortage of teacher housing

3. decline in values -spread of globalization -teenage pregnancy -globalization is a big problem-disease-absence from school-smoking cannibis (drugs)-robberies

1. increased savings

2. improved education in the community

Change Matrix, Non-Target Group, MalindiChange Causes Consequences Lessons learned1. improved health -increase in production

-access to clean water -students study well-increase in organic farming -national income increased-vulnerability of life in society -access to solar lamps -the community is able

-introduction of Floresta -increased schooling for children

-availability of water tanks

-training provided by Floresta -increase in income -knowledge is the key to life

-better nutrition -agriculture is the backbone

-better health

-construction of a clinic in the county

-good health is important for every son of the country

2. introduction of vicoba by Floresta -lack of knowledge of

entrepreneurship-simplification of cooking by improved stoves

-reduced damage to environment by saving energy

3. introduction of organic farming by Floresta -community acceptance of

organic farming training-better relationships are the foundation of development

Page 8: 2011 Impact Evaluation - Tanzania

Household Survey

Note: statistically significant differences are noted in charts and tables below by asterisks, where,* = significant at the 95% confidence level**= significant at the 99% confidence level***= significant at greater than 99.9% confidence level

Sample CharacteristicsStatistic ResultNumber of Regions in sample 1 (Kilimanjaro)Number districts in sample 2 (Moshi Rural, Same)Number of villages in sample 10Average age (years) 46.4 (minimum 21, maximum 90)Average number of people living in household 5.21 (minimum 0, maximum 11)

The average household size is 5.21 members per household, compared to a national average of 4.7 members per household (NBS, 2002). There was no significant statistical difference between member and non-member households for household size.Historical sample data 2008 2011Average age of sample 46.5 46.4Average household size 5.7 5.21

Change Matrix, Non-Target Group, MaranguChange Causes Consequences Lessons learned

-growth of tourism industry -decline in values -develop good moral values-good roads -improvements in life-increase in knowledge -better health-trust in God-globalization -use of drugs -lack of health education-world education -indecent behaviour

-adopt external values -increase in disease-peer pressure -unexpected pregnancy-no fear of God

-economic growth -unity is strength

-vicoba -increase in status of life -dare to do something-help from God himself -growth of cell phone business -increase prayer to God-saccos -increase in respect -knowledge is the key to life

1. improved development

2. change of youth behaviour -return to good values in our

culture

3. increased income

-increase in training from NGO's such as Floresta

Page 9: 2011 Impact Evaluation - Tanzania

SavingsAlmost all Floresta participants, 99% of households, are actively saving cash, and 50% of participant households claim to have enough savings to cover expenses for 6 months. Non-participant households by contrast, are saving less frequently (48% of households), and only 6% of non-participant households claim to have enough savings set aside to cover 6 months of expenses. These differences are statistically significant at the 99% level.

Household ConditionThose participating in the Floresta program (members), are generally showing improved household economic conditions compared to non-members including increased used of high value flooring materials such as concrete and tile, increased incidence of animal/cattle ownership, and a greater number of average rooms per household. Non-member households not only less frequently own cattle, but also own less cattle per household. Both member and non-member households show decreasing levels of cattle ownership when compared to data collected in 2008.

savings funds for 6 months0.00

0.50

1.000.99

0.500.480.06

Savings activities***

membernon-member

prop

ortio

n

0.00

0.500.17

0.41

Households with dirt floors***membernon-member

prop

ortio

n

0.000.200.400.600.801.00 0.80

0.56

Frequency of cattle ownership***

membernon-member

prop

ortio

n

2008 20110.00

1.00

2.00

3.00

Number of cattle per household***

membernon-member

num

ber o

f cat

tle

Page 10: 2011 Impact Evaluation - Tanzania

IncomeThe primary source of income for both Floresta member and non-member households is cropping, with almost 90% of families relying on this source for income. Member households, however, show more diversification of income sources in that a greater proportion of participant households count on animals, business, trees, trades, employment, and family outside the household to earn cash. In the case of business activities, over 40% more member families are involved in business as a source of income compared to non-member families.

Floresta participant households also show a greater diversity of crop production, reporting 15 different crops harvested in the past 12 months, compared to 12 crops harvested by non-member households. Member families also showed a higher frequency of harvesting, 7 of the 15 crops than non-members, in particular, member households harvested vegetables 2.5 times as often as non-member households. Non-member households did show higher production of avocado, almost 3 times as much as member families, but this is the only crop where non-participant households showed significantly more frequent production.

0.00

1.00

2.00

3.00

4.00 3.703.18

Number of rooms per house***

membernon-member

aver

age

cropsanimals

businesstrees

family outside hhtrades

employmentfamily outside country

0.000.100.200.300.400.500.600.700.800.901.00

0.880.81

0.660.58

0.340.28

0.140.03

0.87

0.61

0.460.52

0.26 0.25

0.12

0.01

Sources of income

membersnon-members

prop

ortio

n

Page 11: 2011 Impact Evaluation - Tanzania

Perception of community conditionsThere is no statistical difference between Floresta participants and non-participants in perception of fairness of prices. Participants however, perceive their community to be safer than that of non-participants and see greater unity in communities than non-participants. Both of these differences are highly statistically significant. Since members and non-members were sampled from the same communities for this survey, this difference in perception is likely a reflection of unity and safety within the VICOBA groups, rather than in the larger community.

Perception of community conditions Members of Floresta

Non-members of Floresta

Fairness of market prices--for selling farm products--(scale of 1 to 5, with 5 being the most fair)

2.66 2.54

Safety in community (scale of 1 to 5, with 5 being the safest)* 3.51 3.25Unity/conflict in community (scale of 1 to 5, with 5 being the most unified) ***

3.8 3.48

Land ConditionAlmost all farmers in the target region, both members and non-members own some amount of land with a range from 0.15 acres up to 10 acres. On average, Floresta participants own slightly more land (not statistically significant) than non-members, but participants are protecting over twice as much land as non-participants on average (statistically significant at the 99.9% level). Approximately 90% of Floresta participants planted at least some trees, while only 52% of non-participants planted trees. In terms of quantity, participants on average are also planting almost twice as many trees per year as non-participants.

beansmaize

bananacoffee

vegetablessunflower

avocadopeas

mangoirish potato

sweet potatosorghum

pigeon peatomato

yams

0.000.100.200.300.400.500.600.700.800.901.00

0.84 0.83

0.49

0.280.23

0.17

0.100.05 0.04 0.02 0.02 0.01 0.01 0.01 0.01

0.76

0.87

0.26 0.25

0.090.06

0.29

0.03 0.03 0.02 0.02 0.01

Crops harvested, past 12 months

membersNon-members

frequ

ency

Page 12: 2011 Impact Evaluation - Tanzania

NutritionFloresta member households are averaging more meals per day than non-member households. Nutrition patterns are similar between groups, although member households are consuming milk and dairy products more often than non-member households. Non-member households are consuming staples more frequently than member households.

owned Protected ***0.00

1.00

2.00 1.621.161.29

0.47

Land amounts (acres)

membersnon-members

acre

s

0204060

3920

Trees planted in past 12 months

membersnon-members

trees

Meat/eggs/fish beans vegetable milk** fruit staples*0%

20%

40%

60%

80%

100%

0.02

0.46

0.890.64 0.66

0.780.88

0.53

0.11

0.24 0.270.220.06

0.01 0.000.11 0.05

Nutrition, members

RarelyMonthlyWeeklyDaily

0.00

1.00

2.00

3.00

4.002.87 2.63

Meals per day ***

membersnon-members

num

ber o

f mea

ls

Page 13: 2011 Impact Evaluation - Tanzania

EnvironmentIncidence of three waterborne diseases, typhoid, cholera, and diarrhea, were used as indirect indicators of water quality, and environmental health. While the household incidence of typhoid and cholera was zero, the incidence of typhoid and diarrhea was three times as high in non-member families as member families (both differences statistically significant, 95%). Whether this is a result of better ground water quality due to more tree planting and soil conservation, or greater access to cisterns or wells, or other factors is unclear. There is no difference in perception of Floresta members and non-members regarding the number of permanent water sources (year-round springs), or watershed quality, however, Floresta participants report a higher soil quality than non-participants (statistically significant at 99.9% level).

Members Non-membersNumber of year-round springs, estimated 1.1 1.1Perception of soil quality on farm (scale of 1 to 5, with 5 as highest quality) ***

3.6 3.2

Perception of health of watershed (1 to 5, with 5 as most healthy) 3.4 3.3

SpiritualSpiritual issues are clearly difficult to quantify, and the very idea of 'measuring' spirituality seems to go

Meat/eggs/fish beans vegetable milk** fruit staples*0%

20%

40%

60%

80%

100%

0.02

0.40

0.85

0.370.52

0.910.78

0.53

0.14

0.35

0.36

0.090.16

0.07 0.01

0.230.11

Nutrition, non-members

RarelyMonthlyWeeklyDaily

typhoid* cholera diarrhea*0.00

0.20

0.40

0.060.00

0.080.20

0.00

0.23

Incidence of waterborne illness

membersnon-members

prop

ortio

n

Page 14: 2011 Impact Evaluation - Tanzania

against the idea of 'judge not lest you be judged'. Nevertheless, as part of our program effort, it is important to try and understand if our program activities are effective or not. As with all other indicators measured in this study, these spiritual indicators are drawn from the theory of change, and therefore integrated within the larger framework of the organizational strategy. With the first five indicators in this section, those participating in the Floresta program showed a better perception of conditions than non-participants (statistically significant at 95% level or higher). Program participants have a better perception of church involvement in the community than non-participants, and since both sample groups come from the same communities this may indicate that more members participate in church life. This would require further study in order to understand these difference in church perception. Similarly, Floresta members perceive alcohol to be a greater problem in the community than non-members, also difficult to explain without further investigation. Regardless, both groups see alcohol as causing problems in their community.

Scale of 1 to 5, with 5 being best response Members Non-membersPerception of personal prayer life *** 4.14 3.78Perception of personal response to community needs * 3.97 3.76Perception of local church response to community needs * 4.09 3.88Perception of personal care for creation ** 3.98 3.7Perception of local church's care for creation * 4.13 3.87Perception of alcohol as community problem ** 1.83 2.27Shared knowledgeMeasuring shared knowledge, or the so-called 'multiplier effect' improves our understanding of program training effectiveness as well as the suitability of the technologies or principles being shared. It is also an indicator of cost-effectiveness, since it shows to what extent the program is reaching beyond the direct participants to the general community. Almost all of Floresta members (98%) have shared their acquired knowledge with others, and on average, each member has shared knowledge with 20 people. Nearly as many participants, 94% estimate that those with whom they have shared knowledge have also applied this knowledge in the field, and approximately16 people per member are doing so.

Vegetation AnalysisA vegetation index, known as NDVI, was used to estimate the amount of tree cover in the Floresta target area. NDVI, or normalized difference vegetation index, relies on the ratio of infrared light to near-infrared light absorbed by plants, and is widely recognized as a reliable estimate of both amount

Shared *** Applied ***0.00

0.50

1.000.98 0.94

0.01 0.01

Knowledge shared with others

membersnon-members

prop

ortio

n

Page 15: 2011 Impact Evaluation - Tanzania

and health of vegetation. While not directly equivalent with tree cover, high values of NDVI are a strong indicator of the presence of trees. Data for this study was drawn from the MODIS satellite imaging system using the MOD13A3 product which provides 30 day averaged NDVI values at a 1km resolution (NASA, 2011). Data for the mid-wet season, mid-dry season, and transition from wet to dry was averaged to give a mean value for the 2 years, 2008 and 2011, and these values were compared to estimate the approximate change in vegetative cover of that period.

The project area is delineated by the major watersheds in the area—those river systems which connect the region hydrologically, and ecologically. These major watersheds, which together represent millions of square kilometres, are too large to be considered realistic target zones for Floresta, and subwatersheds were identified, which represent branches of the main rivers, and have surface areas which are of a more practical size for coverage by reforestation or soil conservation efforts. These major watersheds and the associated subwatersheds are shown in the maps below.

Page 16: 2011 Impact Evaluation - Tanzania

NDVI values are then plotted for the subwatersheds. The maps below show the average NDVI values for the two years, 2008, and 2011, the beginning and end of the evaluation period. Darker green areas represent higher NDVI values, and lighter green, lower NDVI values. NDVI values are generally expressed on a scale with a maximum of 10000. Values in the 6000 to 10000 range are often strongly associated with high tree cover.

A visual examination of the 2008 and 2011 NDVI data show that the patterns are very similar, and it is difficult to distinguish differences in vegetative cover. However, by subtracting the NDVI values for the previous period, 2008, from most recent year 2011, we can derive a map which shows whether the vegetation index has increased or decreased during the evaluation period. In the map below, areas shown in green are areas where NDVI has increased, or where there is a strong likelihood that vegetative cover has increased. Areas in red are areas where NDVI has decreased, or where there is a strong likelihood that vegetative cover has decreased over the evaluation period. Areas shown in yellow, are areas where the change in NDVI is close to zero, or where there has been little change in vegetative cover.

Page 17: 2011 Impact Evaluation - Tanzania

Visual examination of the change in NDVI map shows that while the region in general has been negatively affected by drought over the past 3 years, the Floresta communities tend to be associated with areas of positive change. Given that climate is a strong influence on overall vegetation cover, it is difficult to separate the impact of the program in this analysis. Longer term monitoring of vegetation will be of value in verifying whether positive change in vegetation is taking place due to program activities.

A summary map which averages NDVI changes over entire subwatershed regions provides a simplified pattern. Floresta communities are found in 7 subwatershed regions, and 2 of those 7 show neutral or slightly positive change. All other subwatersheds in or near the target area show negative vegetation change It is worth noting in all cases that the actual amount of change either positive or negative over the three year period is in the 3 to 8 percent range.

Page 18: 2011 Impact Evaluation - Tanzania

DiscussionThe target population for this evaluation was drawn from a random sample of households that are participating in the Floresta program as well as a control or comparison group that is not participating in Floresta activities. This sample shows an average age of 46.4 much higher than that of the national median age of 18.5 (World Factbook, 2011). This is typical in agricultural communities where youth seem less interested in agriculture and often migrate to urban areas in search of education or employment. Household size is also slightly larger than the national average, with sample mean household size being 5.21, compared to the national mean of 4.7 (NBS, 2002). While household size tends to be associated with lower levels of consumption and higher levels of poverty, the small difference between the sample household size and national household size is not a strong indicator of higher poverty levels among the target group.

Economically, the Floresta target group generally compared favourably with the non-target group, showing greater use of durable flooring materials, higher frequency of cattle ownership, greater number of rooms per household, and greater amount of land owned per household. The Floresta target group also shows a much higher frequency of saving cash than the non-target group, with almost all Floresta participants actively saving cash. This has resulted in half of Floresta members estimating that they have sufficient funds to cover 6 months of household needs, compared to only 6% of non-members.

The primary source of income for both program participants and non-participants is cropping. However Floresta member households show a greater diversity of income with a greater proportion of families involved in animal production, business, and tree crops compared to non-member households. Target group households also show a greater use of crop diversity, citing 15 different crops grown in the past 12 months compared to 12 crops in non-target households. Nutritionally participant households are consuming more meals per day, and consuming more dairy products than non-participant households. Non-member households are relying more on staples such as maize and cassava.

Both member and non-member households feel that market prices are moderately fair, but member households sense greater safety and unity in their communities than non-members.

With respect to the environment, Floresta member households protect their land more often, own greater amounts of protected land, and plant more trees than non-member households. Non-member families report suffering from waterborne illness at three times the rate of member families indicating better water quality among member families. Member households also perceive their soil quality to be significantly healthier. Vegetative cover change in Floresta target areas shows a positive change in the areas immediately around target communities. Overall vegetation change in the wider region over the past 3 years has been negative mostly likely due to regional drought.

Spiritually the participants have a better perception of quality of prayer life, personal response to community needs and creation care, and church response to community needs and creation care. Alcohol is perceived by both Floresta participants and non-participants as a problem although Floresta participants see it as a bigger problem than non-participants.

The target group is effectively sharing their knowledge learned from the Floresta program with others, with 98% of program participants sharing their knowledge, and 94% believing that those with whom they have shared are also applying this knowledge on their farms.

The most important changes over the past 3 years identified by community members were, improved

Page 19: 2011 Impact Evaluation - Tanzania

health care, education, and water supply, as well as increased income and savings. The improved income and savings situation was attributed by most workshops, both participant groups and non-participant groups to be a result of the introduction of VICOBA in their communities. On the negative side, most groups expressed concern about a decline in values, caused by outside influences such as globalization, and a resulting increase in abuse of drugs, spread of disease, and unplanned pregnancies. Workshop members recommended a return to traditional values as a way to reverse this trend.

Communities identified between 11 and 16 institutions working in their communities, with Floresta participants identifying slightly more institutions on average than non-participants. The top three institutions identified as most closely working with the community in both member and non-member groups were VICOBA, the church/religion, and Floresta. Floresta was perceived as having large financial resources.

It is difficult to say with absolute certainty that the positive changes noted in this study are the result of Floresta program influence and not a result of sample bias, or the program pre-selecting for households already in a better condition than non-participant households. However workshop results indicate that Floresta program activities are seen as a major positive influence by both participants and non-participants alike. Similarly the vegetation analysis shows a positive change in the area immediately surrounding target communities, a result which is independent of sample bias. This evidence while not direct proof, strongly suggests the positive impact of Floresta activities.

Overall, Floresta target households show positive results compared to non-target households in all three priority areas, economic, environmental and spiritual conditions. Almost all Floresta participants are saving cash, and are effectively sharing their knowledge with their friends and neighbours. An increase in vegetation is noted in the areas immediately around Floresta communities, in spite of the severe drought conditions affecting much of the general region. Program participants feel they are effectively addressing community needs, and caring for creation. Alcohol abuse and declining values are identified as serious concerns in target communities.

ReferencesNBS. 2002. Population and housing census. National Bureau of Statistics, Ministry of Planning, Economy, and Empowerment, Dar Es Salaam, Tanzania. http://www.nbs.go.tz/index.php

R Development Core Team. 2011. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.

NASA Land Processes Distributed Active Archive Center (LP DAAC). 2011. USGS/Earth Resources Observation and Science (EROS) Center, Sioux Falls, South Dakota.

World Factbook, 2011. Central Intelligence Agency World Factbook, Tanzania. https://www.cia.gov/library/publications/the-world-factbook//geos/tz.html