SSL-CCT: Country Presentation_Brazil Bolsa Familia

7/30/2019 SSL-CCT: Country Presentation_Brazil Bolsa Familia

1/27

Payment mechanisms and M&E

Experience of the Bolsa Familia

(Brazil)

Romulo Paes de Sousa,

IDB-ADB South-South learning event on Conditional Cash Transfers

Manila, 16-19 April 2013


2/27

Types of payments

Electronic withdrawal. The person of reference cashes the benefitusing a card with a password. The cards can be debit card or pre-paid card;

Offline withdrawal. Person of reference of the family or anauthorized person on his/her behalf can cash the benefit only in the

branches; Special withdrawal. Programmed payments performed by the

mobile banks teams;

Virtual account. In 2013, it will launch a system based in a virtualaccount for all beneficiaries. The beneficiary receives a SMSindicating the code and deposited benefit. In a cash machine, theperson of reference types the code, responds to a personalquestion provided by the machine, and then types the requestedvalue. This operation will no supress the bankcard. The use of themobile for payments in shops (as debit card) is also under study.


3/27

Payment operations

Country Programs Families

beneficiaries

Frequency of

payments

Values

Brazil Bolsa Famlia 13.9 million(March

2013)

Monthly US$ 67(average)

Colombia Ms Familias en

Accin

2.1 million

(Dec. 2012)

Every two

months

Honduras PRAF/ Bono

10,000

345

thousand

(July 2012)

Every four

months or more

Maximum of

US$ 513 per

year

Jamaica PATH 130

thousand

(Feb. 2012)

Every two

months

Mexico Oportunidades 5.8 million

(Dec. 2012)

Every two

months

Peru Juntos 650

thousand(Dec. 2012)

Every two

months

US$ 78 (per

family)


4/27

Source: Oportunidades, 2012

Types of payment methods used by

Oportunidades 2009 to 2011

0% 20% 40% 60% 80% 100%

2009

2010

2011

% of a ended households

Entrega directa

Abono en cuenta

Tarjeta bancaria chip

Tarjeta dbito

In cash

Deposit in the account

Bankcard with chip

Debit card


5/27

PAYING MONTHLY US$ 750 MILLION TO13.9 MILLION FAMILIES IN 5.7

THOUSAND MUNICIPALITIES IN BRAZIL


6/27

Receipt

After the payments, beneficiaries of Bolsa Familia(Brazil) receive a receipt that has also been used forcommunication purposes.

Example: the record of a child or youth of your family (6

to 18 years old) is missing the information regarding to theschool that he or she is engaged in. The persistence of thisproblem will lead to the suspension of the benefit. Please,update the family record in the Bolsa Famlia office of yourmunicipality.

When a beneficiary of the Bolsa Famla fails towithdrawal the benefit, the Bank produces a writtenstatement explaining the motives of the failure.


7/27

Problems during the payments

Refusal of payment of benefits, without any justification to thebeneficiary;

Retention of financial assets by way of collection of Banks fees;

Linking of the payments to the purchase of goods of any nature;

Discrimination in the payment of benefits to the beneficiaries, withthe establishment of different places or restricted times for cashing;

Inactivity of cash machines;

Lack of money for the payment of the benefits (the example of thecoins);

Collusion of the Banks in making successive payments to a person

with cards of many families; Retention of cards by the cash machines or by the staff of the

Banks.


8/27

Assisting the beneficiaries during the

payment

The recent changes on the rules of the payment agreedby the governmental authorities and the banks;

The list of families included and expelled by theprogramme in the month of the payment;

Basic information of the families (names, address,identification number of the person and/or thehousehold) and of the benefit of the family (type ofbenefits, value, and months of received payments);

The list of benefits not claimed by any beneficiary in agiven time, according to the rules of the programme.


9/27


10/27

Lessons

The bankcards are the most efficient vehiclefor accessing the payments. They identify,access the payment, and give a sense of

belonging to the programme Payment can be a stressful experience if it is

not well planed and implemented

Not always the programmes can rely on thebranches network. Therefore, other partnersshould be considered


11/27

MONITORING AND EVALUATINGBOLSA FAMILIA


12/27

M&E structure and performance

Two units: the Secretariat for Evaluation andInformation Management (SAGI) and theDepartment of the Single Registry, under the

Secretariat of Citizenship Income 91 professionals (29 only for the Single

Registry Unit)

In 2012, the budget was US$ 17.7 millions In 2012, MDS hired or performed 28

evaluation studies (6 only for Bolsa Familia)


13/27

Purposes of a Monitoring and Evaluation System

Providing information for analysis of products andservices to improve policies;

Producing knowledge about the impacts and costs ofpolicies and programs;

Ensuring transparency of how public resources areused,

Helping the decision making on budget allocation forpolicies and programs.

Monitoring and Evaluation Systems (M&E)


14/27

Needs for Improvement for Social

Policy and Programs

M&E Systems

Provide information, knowledge

and tools Statistical data

Program data

Internet Tools Monitoring Indicators

Evaluation Surveys

Position papers

PROVIDE CUSTOMIZED INFORMATION: is what

Monitoring and Evaluation Systems offer

Dissemination Strategies to reach

office and street level managers and

teams

M&E Cycle

Not structured

demands

Complex

information for

too busy people


15/27

Process evaluation areas of investigation & methods

AREAS OF INVESTIGATION

Implementation

Quality of Training

Quality of Facilities and Service

Delivery, and profile of the workforce

Incentives for Performance

Role of Supervision Facility Quality

Counseling Quality

Uptake and utilization of interventions

Access and Exposure to Services

Satisfaction with Service

Changing behaviors and attitudes

Contextual factors

Role of other programs/interventions

Role of family and community

members

METHODS

Qualitative

Review of program documents

(manuals, job aids)

Structured direct observations

Home-based interviews with progra

staff and mothers (qualitative or

quantitative)

Focus group discussions

Quantitative

Secondary data

Pre and post training assessments

Household surveys Interviews at facilities

Data from routine and program

documentation

15Source: Haddad, Paes-Sousa and Menon


16/27

Conditionalities monitoring routine of Bolsa Famlia (Brazil)

1.2.

Source: MDS, 2012. Informativo do Departamento de Condicionalidades. September 2012. Braslia: MDS

MSD

defines the roster of

beneficiariesMoH / MinEduc

Identify the beneficiaries to be

monitored through specific IT systems

Municipalities collect and impute

data on conditionality compliancein specific IT systems

MoH / MinEducconsolidate the data collected by the

municipalities

MSD

Identifies those that are notcomplying and the triggeredconsequences

MSD informs the families about theimplications (through letters and

payment receipts)

Municipalities and StatesAssess the case and the need for

special social services

Municipalities

impute data on familiesassisted by special social

services


17/27

Challenges for providing relevant information

Need to further development of M&E culture, ingovernmental and non-governmental institutions;

Dissemination strategies Medium term courses

Need to build an interdisciplinary team;

Staff turnover;

Partners convincement;

Different rhythms between management and evaluation;

Administrative procurement routines vs. lack of expertise inhiring evaluation researches:

Terms of Reference;

Evaluation services as common services;


18/27

INFORMATION: what does technical staff need to do?

Produce a Logic Framework for building monitoring indicators andevaluation surveys;

Track and summarize social reports produced by Main National(Population Bureau, etc.) and International Centres (UN Agencies,International Development Banks, etc.);

Select relevant statistical data and organize them in customizedtools to the program managers and decision makers;

Compute relevant indicators to help monitoring;

Perform evaluation studies, prioritizing those based on secondarydata;

Hire qualitative or quantitative surveys to answer specific questionsneeded for the improvement of the programmes;

Disseminate information through customized strategies (policybriefs, workshops, courses, videos, etc.).


19/27

Contracting and

managing contracted

applied studies


20/27

INFORMATION: which skills M&E staff team should have ?

They should know summarize social reports selecting the

relevant topics concerning the Ministry issues

The technical staff should know how to get and how to

tabulate data form Demographic Census and National Current

Surveys

They should have a Logic Framework for building monitoring

indicators and evaluation surveys

They should know how to disseminate data on Internet tools

There should be communication team to design products and

strategies to disseminate the information and knowlegdment


21/27

TWO EXAMPLES


22/27

School enrolment is over 95% among girls and boys from beneficiary families aged 7-

14 years old

0.6

0.65

0.7

0.75

0.8

0.85

0.9

0.95

1

6 7 8 9 10 11 12 13 14 15 16 17

Boys school enrolment by age and PBF

status

BF Non-recipients:

Males

BF Recipients: Males

No-beneficirio

: masculinoNo-beneficirio


: masculino

No-beneficirio

: masculino

No-beneficirio:

masculino

Beneficirio:

masculino

0.6

0.65

0.7

0.75

0.8

0.85

0.9

0.95

1

6 7 8 9 10 11 12 13 14 15 16 17

Girls school enrolment by age and PBF

status

BF Non-recipients:

Males


No-beneficirio



: masculino

No-beneficirio

: masculino

No-beneficirio:

girls

Beneficirio: girls

Digging Deeper with RCTs

Keeping girls in secondary school: does Bolsa Familia work?

Source: IFPRI/MDS (2010). Avaliao de impacto do Bolsa Famlia, 2 rodada [Impact evaluation

of Bolsa Famlia, 2nd round]. IFPRI/MDS: Braslia. Research report.


23/27

Yes: Where it counts mostIn the Northeast, PBF beneficiary children are more likely to school enrolment

0.6

0.65

0.7

0.75

0.8

0.85

0.9

0.95

1

6 7 8 9 10 11 12 13 14 15 16 17

Boys school enrolment by age andPBF status - Northeast

BF Non-recipients:

Males


No-

beneficirio: NE,

masculino

Beneficirio: NE,

masculino

No-beneficirio



: masculino

No-beneficirio

: masculino

No-beneficirio:

masculino

Beneficirio:

masculino

0.6

0.65

0.7

0.75

0.8

0.85

0.9

0.95

1

6 7 8 9 10 11 12 13 14 15 16 17

Girls school enrolment by age and

PBF status - Northeast

BF Non-recipients:

NE, Females

BF Recipients: NE,

Females

No-

beneficirio: NE,

feminino

Beneficirio: NE,

feminino

Source: IFPRI/MDS (2010). Avaliao de impacto do Bolsa Famlia, 2 rodada [Impact evaluation

of Bolsa Famlia, 2nd round]. IFPRI/MDS: Braslia. Research report. 23


24/27

Brazil and the timeframe and the politics of the offer

Source: Paes-Sousa, Pacheco and Miazaki (2011).Bull World Health Organ vol.89 no.7.


25/27

Lessons

Programme managing needs different type ofinformation: qualitative, quantitative, structured and notstructured

There is not a single method to produce relevant

information to help improving programme design ormanagement

Triangulation of methods, and interviewing people is avirtue not a problem

Programme Improvement and Innovation are mainly

incremental, not revolutionary Disseminate information to all people involved in the

Program operation is as important as to produce it

Information produced on M&E System are complex and

not easily understandable even for experienced team


26/27

Lessons: adding other dimensions

M&E Systems provide information, knowledgeand tools, not just program evaluations

Those who provide services loves monitoring andhates evaluation. Those who contract servicesloves evaluation, being indifferent to monitoring;

Evidence is necessary for policy & politicalsurvival;

The evaluation is important to reduce the risk ofpolitical interference/manipulation;

Good M&E practices contribute to raise a positiveperception of the programmes.


27/27

Thank you

[email protected]

[email protected]

Documents

SSL-CCT: Country Presentation_Brazil Bolsa Familia