cerrar
cerrar

caf.com / calls / i international caf call for impact evaluations for better management

calls

TwitterFacebookGoogle plusLinkedInYoutubeRSSSuscribe
July  01  to August  31, 2017I International CAF call for impact evaluations for better management
evento - I International CAF call for impact evaluations for better management

Do you want to measure the impact of your policy or learn about the best way to implement it working with a team of very qualified professionals? CAF, Development Bank of Latin America, through its Direction of Impact Evaluation and Learning of Policies invites public entities of Latin America to apply to the I International CAF Call for impact evaluations for #BetterManagement 

comparteevento - Twitterevento - Facebookevento - Google Plusevento - LinkedInimg - Whatsapp

At CAF, we are convinced that to achieve better management of public resources it is essential to know what works and what does not, through rigorous impact evaluations. For this reason, we are placing our resources at the disposal of the public entities of Latin America and the Caribbean, and our experience to help generate quality learning and promote the institutionalization of impact evaluations as tools for public management.

The Direction of Impact Evaluation and Policy Learning manages close to 40 impact evaluation projects in different countries of Latin America, emphasizing different issues. To continue and strengthen this involvement we have decided to organize the I International CAF Call for Evaluations for #BetterPublic Management, to encourage public institutions in the region to propose management programs or initiatives whose impact they want to know. Close to 15 applications  will be selected to receive technical, logistic, and financial support for the design and implementation of impact evaluations of the highest scientific accuracy.  

The 2017 call will have two (2) windows of application: 

  • The first window will be open from March 1st to April 30th. It is expected that seven or eight finalist projects will be selected here. 
  • The second window will be open between July 1st and August 31. Another seven or eight proposals will be selected here. 

The main emphasis (although not exclusive) of both application windows will be on management initiative proposals. In addition, there will be other thematic emphasis in both windows. 

The call is aimed at institutions of the Latin American and Caribbean public sector (see list below). 

Institutions which own the winning proposals will receive free advice provided by a highly qualified team, to design and implement an accurate impact evaluation. 

 

Apply

 

More information regarding the call in the following sections 

 

eligible policies

What kind of policies may be submitted?

At CAF, we believe that all public policies are important and, in principle, they can all be evaluated (provided they comply with the necessary technical requirements and there is interest in evaluating them). For this call, all policies with a very clear objective, implemented by public institutions and aligned with the institutional mission may be submitted. Policies must have  a benefit on people or institutions (public or private) or be aimed at improving institutional management processes.

Some examples are: initiatives to increase the payment of taxes (link to DIAN experiments) or programs to increase financial inclusion (link to UNICAS program).

Although we are interested in all types of policies, those aimed at improving management processes will have a priority in the selection process.

What do you mean by policies aimed at improving management processes?

At all levels in any institution, independently of its objective and nature, decisions are made as to how to use the resources or how to comply with its objectives in the most effective manner, that is, the best way to manage the institution.

Not necessarily in these cases there is a direct beneficiary. The State and citizens benefit indirectly through institutions that are increasingly efficient. Therefore, benefits cannot be measured in terms of wellbeing or usual impact variables, but rather in efficiency, speed, or quality with which an activity is carried out.

Some initiatives seek to improve a process comparing different alternatives to use an improvement opportunity, while other initiatives are complementary innovations to the process. 

 

awards

What do selected institutions win?

The objective of the call is to design and implement 15 rigorous impact evaluations which will be selected through a competitive process where institutions of all Latin America will participate.

The winning proposals will receive free advice from a highly qualified team to design and implement a rigorous impact evaluation.  The working team, which includes professionals with ample experience in evaluation projects and renowned academics, will provide personalized support during all the evaluation process.  

Winners will also learn about the effectiveness of their actions, which will potentially lead to improve the quality of the services and products they offer. During this process, they will also get firsthand experience on the evaluation process which we hope will remain as a knowledge asset for the institution for future evaluation efforts. The measurement and its results will also generate international dissemination of the institution's action and effectiveness, as well as prestige by being pioneers in the use of impact evaluation as a management tool.   

In addition, the institutions will have the opportunity of establishing relations and working closely with an institution of  international prestige such as CAF.

What are the awards?

The first component of the award is a rigorous methodological impact evaluation proposal led and managed by DEIAP. At the end of the proposal's design process, the winners will receive a document detailing the evaluation methodology of the proposal and its technical requirements. CAF commits to leverage human and financial resources to cover the costs of the evaluation's design phase.

The second component of the benefit includes technical support for the 15 selected initiatives to implement the impact evaluation from beginning to end. In addition to the active and direct participation of the DEIAP team, CAF will collaborate to procure additional resources (including, when possible, CAF's own funds) to cover the costs associated to the implementation of the evaluation. The possibility of using CAF funds will be evaluated on a case-by-case basis.

It is important to emphasize that the evaluation costs DO NOT include those related to the implementation of the policy to be evaluated. CAF also commits to collaborate with the implementing institution to manage additional funds if necessary. 

selection

How is the selection process?

The process will be the same in both application windows, and it is made up of two phases:

Phase 1: the objectives of this phase are to evaluate the technical feasibility of the proposals and to obtain information about the person who fills out the application to determine the level of connection with the policy to be evaluated. This phase lasts approximately 4 weeks and ends with a final decision regarding which applications go to phase 2 and which do not. 

Phase 2: the objective of this phase is to confirm the technical feasibility of the evaluation through more detailed information regarding the policy, its beneficiaries, available information, and budget, among others, as well as to confirm the commitment of the team involved in the implementation and of the responsible institution.  This phase lasts approximately 3 weeks and ends with a final verdict regarding which applications are the final beneficiaries of the evaluation services and which are not. 

the evaluation

What happens if you are selected in the last phase?

If an application is selected within the winning group, the policy will become part of the roster of evaluation projects managed by DEIAP. To formalize the selection, the institution responsible for the policy to be evaluated must subscribe an agreement of understanding with CAF, to establish the scope of the evaluation, as well as the responsibilities of each party (see Example Agreement here).

Later, the formal evaluation process will start and, in general, it must follow the following structure: initial exploration of the evaluation question and the program or initiative to be evaluated, detailed design of the methodological proposal, execution, implementation of the impact evaluation, and dissemination of final results.

The duration of the evaluation will depend on the characteristics of the project that will be evaluated. In general, it is expected that the process to design the evaluation should start within 4 months after the publication of the final results.  

applicant institutions

Which countries may participate?

Institutions located in any country of Latin America and the Caribbean may apply.

What type of institutions?

Only applications coming from institutions of the public sector will be accepted. Therefore, applications from non-profit institutions which are not public, such as NGO's or Universities, will not be considered valid, unless they are partenered with a public institution (in which case, we recommend the public institution to apply directly). 

Who may complete the application?

The application may be completed by a civil servant that works directly for the applicant institution. Ideally, said person must be responsible or work directly with the policy to be evaluated.

As a public official, what does completing the application imply?

By completing the application, the public official is applying for the institution that he/she works for, and is identifying him/herself as representative of said institution for the selection process. However, if the institution is selected, it may appoint another official to be the representative in subsequent phases. 

help for my application

To facilitate the application process, we have placed at the disposal of interested parties the following help tools. 

Due to the large number of institutions that we estimate will be interested in applying, we suggest that if you wish to obtain fast and timely replies to your doubts, try using all the resources that we offer in the page before contacting CAF's team.

Resources

Most frequent questions (FAQ): use link above

Video

Hangout 1: Questions will be answered regarding the application.(August 28th, 2017, 10:00 am)

Links of interest:

IDB Impact Evaluation Portal

Impact evaluation Manual (World Bank)

Impact evaluation in practice (World Bank)   

Practical guide for impact evaluation (book)

ECLAC evaluation manual

J-PAL resources and examples

J-PAL examples

IPA impact evaluation

Examples of 3ie (in English)

Examples of BIT behavioral and management issues (in English)

J-PAL Handbook (English)

application periods

Cronograma_ENGv2.JPG

eligible policies

What kind of policies may be submitted?

At CAF, we believe that all public policies are important and, in principle, they can all be evaluated (provided they comply with the necessary technical requirements and there is interest in evaluating them). For this call, all policies with a very clear objective, implemented by public institutions and aligned with the institutional mission may be submitted. Policies must have  a benefit on people or institutions (public or private) or be aimed at improving institutional management processes.

Some examples are: initiatives to increase the payment of taxes (link to DIAN experiments) or programs to increase financial inclusion (link to UNICAS program).

Although we are interested in all types of policies, those aimed at improving management processes will have a priority in the selection process.

What do you mean by policies aimed at improving management processes?

At all levels in any institution, independently of its objective and nature, decisions are made as to how to use the resources or how to comply with its objectives in the most effective manner, that is, the best way to manage the institution.

Not necessarily in these cases there is a direct beneficiary. The State and citizens benefit indirectly through institutions that are increasingly efficient. Therefore, benefits cannot be measured in terms of wellbeing or usual impact variables, but rather in efficiency, speed, or quality with which an activity is carried out.

Some initiatives seek to improve a process comparing different alternatives to use an improvement opportunity, while other initiatives are complementary innovations to the process. 

 

awards

What do selected institutions win?

The objective of the call is to design and implement 15 rigorous impact evaluations which will be selected through a competitive process where institutions of all Latin America will participate.

The winning proposals will receive free advice from a highly qualified team to design and implement a rigorous impact evaluation.  The working team, which includes professionals with ample experience in evaluation projects and renowned academics, will provide personalized support during all the evaluation process.  

Winners will also learn about the effectiveness of their actions, which will potentially lead to improve the quality of the services and products they offer. During this process, they will also get firsthand experience on the evaluation process which we hope will remain as a knowledge asset for the institution for future evaluation efforts. The measurement and its results will also generate international dissemination of the institution's action and effectiveness, as well as prestige by being pioneers in the use of impact evaluation as a management tool.   

In addition, the institutions will have the opportunity of establishing relations and working closely with an institution of  international prestige such as CAF.

What are the awards?

The first component of the award is a rigorous methodological impact evaluation proposal led and managed by DEIAP. At the end of the proposal's design process, the winners will receive a document detailing the evaluation methodology of the proposal and its technical requirements. CAF commits to leverage human and financial resources to cover the costs of the evaluation's design phase.

The second component of the benefit includes technical support for the 15 selected initiatives to implement the impact evaluation from beginning to end. In addition to the active and direct participation of the DEIAP team, CAF will collaborate to procure additional resources (including, when possible, CAF's own funds) to cover the costs associated to the implementation of the evaluation. The possibility of using CAF funds will be evaluated on a case-by-case basis.

It is important to emphasize that the evaluation costs DO NOT include those related to the implementation of the policy to be evaluated. CAF also commits to collaborate with the implementing institution to manage additional funds if necessary. 

selection

How is the selection process?

The process will be the same in both application windows, and it is made up of two phases:

Phase 1: the objectives of this phase are to evaluate the technical feasibility of the proposals and to obtain information about the person who fills out the application to determine the level of connection with the policy to be evaluated. This phase lasts approximately 4 weeks and ends with a final decision regarding which applications go to phase 2 and which do not. 

Phase 2: the objective of this phase is to confirm the technical feasibility of the evaluation through more detailed information regarding the policy, its beneficiaries, available information, and budget, among others, as well as to confirm the commitment of the team involved in the implementation and of the responsible institution.  This phase lasts approximately 3 weeks and ends with a final verdict regarding which applications are the final beneficiaries of the evaluation services and which are not. 

the evaluation

What happens if you are selected in the last phase?

If an application is selected within the winning group, the policy will become part of the roster of evaluation projects managed by DEIAP. To formalize the selection, the institution responsible for the policy to be evaluated must subscribe an agreement of understanding with CAF, to establish the scope of the evaluation, as well as the responsibilities of each party (see Example Agreement here).

Later, the formal evaluation process will start and, in general, it must follow the following structure: initial exploration of the evaluation question and the program or initiative to be evaluated, detailed design of the methodological proposal, execution, implementation of the impact evaluation, and dissemination of final results.

The duration of the evaluation will depend on the characteristics of the project that will be evaluated. In general, it is expected that the process to design the evaluation should start within 4 months after the publication of the final results.  

applicant institutions

Which countries may participate?

Institutions located in any country of Latin America and the Caribbean may apply.

What type of institutions?

Only applications coming from institutions of the public sector will be accepted. Therefore, applications from non-profit institutions which are not public, such as NGO's or Universities, will not be considered valid, unless they are partenered with a public institution (in which case, we recommend the public institution to apply directly). 

Who may complete the application?

The application may be completed by a civil servant that works directly for the applicant institution. Ideally, said person must be responsible or work directly with the policy to be evaluated.

As a public official, what does completing the application imply?

By completing the application, the public official is applying for the institution that he/she works for, and is identifying him/herself as representative of said institution for the selection process. However, if the institution is selected, it may appoint another official to be the representative in subsequent phases. 

help for my application

To facilitate the application process, we have placed at the disposal of interested parties the following help tools. 

Due to the large number of institutions that we estimate will be interested in applying, we suggest that if you wish to obtain fast and timely replies to your doubts, try using all the resources that we offer in the page before contacting CAF's team.

Resources

Most frequent questions (FAQ): use link above

Video

Hangout 1: Questions will be answered regarding the application.(August 28th, 2017, 10:00 am)

Links of interest:

IDB Impact Evaluation Portal

Impact evaluation Manual (World Bank)

Impact evaluation in practice (World Bank)   

Practical guide for impact evaluation (book)

ECLAC evaluation manual

J-PAL resources and examples

J-PAL examples

IPA impact evaluation

Examples of 3ie (in English)

Examples of BIT behavioral and management issues (in English)

J-PAL Handbook (English)

application periods

Cronograma_ENGv2.JPG

TwitterFacebookGoogle plusLinkedInYoutubeRSSSuscribe