results Archive

0

Evaluation for equitable development results

I received this message from four Directors of UN Evaluation Offices:

The focus on equity in human development is gathering momentum at the international level. Its premise is increasingly supported by United Nations reports and strategies, as well as by independent analysis. More and more national policies and international alliances are focusing on achieving equitable development results. The emerging equity agenda is surely the right way to go. But it poses important questions for everyone involved in development evaluation. Are current evaluation approaches and methods relevant and useful in the assessment of equity-focused interventions? Are we able to assess whether these interventions are achieving real and sustainable impact in reducing inequity? Under what conditions can equitable results be quickly and efficiently achieved? What needs to be done to strengthen the capacity of Governments, organizations and communities to evaluate the effect of interventions intended to achieve equitable outcomes for marginalized populations?

With the aim of prompting thinking to address such questions, UNICEF, UNDP, UNWomen and ILO Evaluation Offices partnered with Mexico’s Coneval, IDRC (the International Development Research Institute), IDEAS (International Development Evaluation Association) and IOCE (International Organization for Cooperation in Evaluation) to publish the book enclosed with this letter. This publication offers a number of strong contributions from senior officers in institutions dealing with evaluation, and from senior Government representatives responsible for national monitoring and evaluation systems.

We encourage you to share this publication within the United Nations system, as well as with your partners. We believe it will be a valuable resource for discussions on evaluation for equitable evaluation results, and to inform participants at relevant national and international meetings and conferences. Please do not hesitate to contact the book’s editor, Marco Segone, Evaluation Office, UNICEF, at msegone@unicef.org for any further information and/or additional copies. Soft copies are available, free of charge, at www.mymande.org, as well as a series of webinars with the authors of the book.

0

Event: Aid Effectiveness and Results-Based Aid, Bonn, 18 April

Public Lecture
Bonn, 18.04.2012, 18:30, DIE,
Aid Effectiveness and Results-Based Aid
Prof. Dr. Talaat Abdel-Malek, Panel Discussion afterwards.
Please register for the event with GDI directly: http://tinyurl.com/88dnh32

All aid approaches aim to achieve “results”. There are two aspects to the new debate on results: On the one hand, further improving the effectiveness of aid is important to the specialists, whereas on the other hand many donors (parliaments, the public etc.) continue to call for the justification of aid expenditures. This creates great pressure to give the most concrete evidence for the utility of aid budgets.

The current international discussion on results based approaches differs from debates so far in as much as in practice, aid has been frequently inputs and progress oriented. Results based aid (RBA) aims to identify outputs or outcomes that can be measured and quantified, i.e. results that can be directly linked to development activities.

0

DCED: Measuring and Reporting Results – The DCED Standard

The articulation of results chains, as mandated by the DCED Standard, helps programmes to realistically illustrate why they are doing what they are doing, how their individual work would help in achieving development impact, and provides the basis for assessing if and to what extent changes are taking place. However, drawing results chains can be challenging for some programmes, especially if done for the first time. The Guide to Making Results Chains, which is now available on our Measuring and Reporting Results page, gives practical tips and examples of how to draw results chains for your programme.
DCED: Measuring and Reporting Results – The DCED Standard.

0

DCED: Measuring and Reporting Results – The DCED Standard

Version VI of the DCED Standard for results measurement is now available on the Measuring and Reporting Results page. This version is fundamentally the same as Version V, with some formatting improvements and added clarity, in light of feedback received.One key change is that Control Point 8.4 (“findings of the system are used in programme management and decision making”) has become compulsory rather than recommended – since this underpins the rationale for the Standard. Comments and feedback are still welcome until the end of February 2012. DCED: Measuring and Reporting Results – The DCED Standard.

0

World Bank Approves Program-for-Results

New Financing Instrument Ties Lending Directly To Verified Development Results

The World Bank Board of Executive Directors approved Program-for-Results (PforR), an innovative new financing instrument for the World Bank’s client countries that links the disbursement of funds directly to the delivery of defined results. Money will flow once the results have been delivered and verified.

PforR would support government programs in a diverse range of countries and sectors. In some countries, PforR would help deliver and improve the coverage of antenatal care for mothers and newborns or increase immunization coverage for children. In others, PforR would help provide sustainable water supply and sanitation services; strengthen
the coverage and quality of early childhood and primary education; or contribute to a
government program to reduce the number of rural households living below the poverty line.

‘Enhancing development effectiveness by helping developing countries achieve results
is central to the mission of World Bank,’ said Robert B. Zoellick, President of the
World Bank Group. ‘Program-for-Results financing demands greater accountability from
partner countries and in turn will help these countries continue to deliver sustainable results long after the Bank’s involvement has ended. The time is right for this innovative development approach.’

PforR will also help improve the transparency and accountability of developing country programs, and strengthen systems to fight fraud and corruption. Under the new instrument, the Bank will provide part of the overall funding for a larger, developing country-financed program but will be able to provide its technical expertise to the larger government program. For example, the Bank’s commitment to openness and transparency will be applied to the entire program supported – including through the application of the Bank’s Access to Information policy to PforR operations.

Key assessments – fiduciary, environmental & social – of program systems are an important feature of this new instrument and will help provide assurance that Bank financing is used appropriately and that the environmental and social impacts of the program are adequately addressed. These assessments will all be publically disclosed. PforR financing will also help partner countries improve the design and implementation of their development programs, strengthen institutions, and build capacity.

Says Joachim von Amsberg, World Bank Vice President for Operations Policy and Country
Services, ‘Building effective and accountable institutions in partner countries is key to achieving better development outcomes and results. We believe that with this new instrument, the World Bank jointly with others – government, development partners, civil society, the private sector and others – will be a better partner focused on results, focused on institution building and focused on better partnerships.’ Source: World Bank http://tinyurl.com/6f3afdx

1

World Bank Approves Program-for-Results

New Financing Instrument Ties Lending Directly To Verified Development Results

The World Bank Board of Executive Directors approved Program-for-Results (PforR), an innovative new financing instrument for the World Bank’s client countries that links the disbursement of funds directly to the delivery of defined results. Money will flow once the results have been delivered and verified.

PforR would support government programs in a diverse range of countries and sectors. In some countries, PforR would help deliver and improve the coverage of antenatal care for mothers and newborns or increase immunization coverage for children. In others, PforR would help provide sustainable water supply and sanitation services; strengthen the coverage and quality of early childhood and primary education; or contribute to a government program to reduce the number of rural households living below the poverty line.

‘Enhancing development effectiveness by helping developing countries achieve results is central to the mission of World Bank,’ said Robert B. Zoellick, President of the World Bank Group. ‘Program-for-Results financing demands greater accountability from partner countries and in turn will help these countries continue to deliver sustainable results long after the Bank’s involvement has ended. The time is right for this innovative development approach.’

PforR will also help improve the transparency and accountability of developing country programs, and strengthen systems to fight fraud and corruption. Under the new instrument, the Bank will provide part of the overall funding for a larger, developing country-financed program but will be able to provide its technical expertise to the larger government program. For example, the Bank’s commitment to openness and transparency will be applied to the entire program supported – including through the application of the Bank’s Access to Information policy to PforR operations.

Key assessments – fiduciary, environmental & social – of program systems are an important feature of this new instrument and will help provide assurance that Bank financing is used appropriately and that the environmental and social impacts of the program are adequately addressed. These assessments will all be publically disclosed. PforR financing will also help partner countries improve the design and implementation of their development programs, strengthen institutions, and build capacity.

Says Joachim von Amsberg, World Bank Vice President for Operations Policy and Country Services, ‘Building effective and accountable institutions in partner countries is key to achieving better development outcomes and results. We believe that with this new instrument, the World Bank jointly with others – government, development partners, civil society, the private sector and others – will be a better partner focused on results, focused on institution building and focused on better partnerships.’ Source: World Bank http://tinyurl.com/6f3afdx

0

Publications on Development Effectiveness

Aid effectiveness: bringing country ownership (and politics) back in ODI Working Papers 336, August 2011
http://tinyurl.com/cwmlxlk
This paper by David Booth considers that assumption untenable and agrees with those arguing that ownership should be treated as a desirable outcome, not an achieved state of affairs. It then asks the corresponding question: whether external actors have any useful role in assisting the emergence of developmental country leaderships.

Capacity Development: Where do EU Members Stand on the Road to Busan? http://tinyurl.com/18r
Gwennaelle Corre, author of the EC study on ‘Supporting the Implementation of the Technical Cooperation for an Enhanced Capacity Development’, found, however that there is a noticeable difference between the Capacity Development practices and experiences of EU Member States. While all European donors do not regard Capacity Development with the same degree of priority, they have become increasingly aware of the importance of supporting it as a way to achieve lasting development results, according to a recent European Commission study.

CSOs on the Road to Busan: CSO Key Messages and Proposals
http://tinyurl.com/d8s8wmh
This paper by BetterAid lays out the main demands from civil society organizations (CSOs) in the run up to the HLF-4. Civil society organizations can sign on to the paper online.

Demanding democratic ownership. D+C article by Antonio Tujan Jr. http://www.inwent.org/ez/articles/197562/index.en.shtml
Civil society organisations are engaged in the aid effectiveness debate. They have been pushing for deeper, more meaningful reform. In 2008, the Accra HLF recognised CSOs as development actors in their own right. Some of their concerns were adopted by the HLF, including broader country ownership or more effective and inclusive partnerships. Many demands, however, were not met. The most important of these were aid reforms that would enable people to use their human rights (”right-based results”) and introduce democratic ownership free from foreign interference.

Democratic Ownership after Busan: Setting up Integrative Partnerships for Development http://www.alliance2015.org/index.php?id=54
In its preparations for the HLF-4, Alliance2015 has surveyed the progress towards democratic ownership based on five case studies – Cambodia, Ghana, Mozambique, Nicaragua and Tanzania – and on a cross-country report focussing on civil society participation in the development process. Donors are not doing enough to provide developing countries the political space they need in order to find their own path to development through real democratic processes. Numerous governments in developing countries have never really endorsed the principle of democratic ownership. They have not taken serious steps towards shaping an enabling environment because they do not sufficiently recognise civil society and parliaments as being independent actors in the development process. When civil society organisations and parliaments are invited to participate, they often do not possess the necessary knowledge about political processes. Therefore, they are frequently unable to make a meaningful contribution to the development process.

Independent Evaluation of the Implementation of the Paris Declaration http://www.aideffectiveness.org/busanHLF-4/topics/evidence-for-busan/450.html
The Independent Evaluation of the Implementation of the Paris Declaration is an independent global appraisal of efforts to improve the effectiveness of international aid since 2005. The latest evidence is vital for decisions taken at Busan. It will help in learning lessons and ensuring that all involved in aid meet their commitments.

It’s Complicated: the Challenge of Implementing the Paris Declaration on Aid Effectiveness http://www.brookings.edu/opinions/2011/0922_paris_declaration_chandy.aspx By Laurence Chandy, The Brookings Institution.
Of the 13 targets agreed to at the Paris High Level Forum, only one was met. That’s a grim outcome even by the standards of global development, where commitments are regularly professed but rarely fulfilled. It also makes for a gloomy backdrop to this November’s High Level Forum on Aid Effectiveness in Busan, Korea. Over the next few weeks, be prepared for a good amount of haranguing and finger-pointing as development activists line up to accuse donor agencies of not trying hard enough and aid skeptics write off the High Level Forum process as an ineffectual talking shop.

Move on. D+C Comment by Sachin Chaturvedi
http://www.inwent.org/ez/articles/197873/index.en.shtml
The time has come to move on beyond ”donors” and ”recipients” in the international development discourse, argues an expert from India. In his view, the focus must be on what is happening in the countries that receive aid flows, and what can improve the lot of their peoples.

Results based aid: limitations of new approaches
GDI Briefing Paper 17/2011 by Stephan Klingebiel
http://tinyurl.com/clx2d5b
Some of the current instruments already offer useful ways of incentivising performance. For instance, designing budget support with variable tranches. With respect to other RBA approaches (such as Cash on Delivery), practical experience is still lacking. It is possible that the disadvantages might outweigh the advantages. The hoped for benefit of RBA approaches, that of being able to produce clearly verifiable results may only ”seem to be” achievable. RBA approaches assume a clear performance orientation in the partner countries, which applies to the reform dynamic countries, but those without good governance may be less easily encouraged by such a system of incentives, and thus other approaches might be more suitable there.

0

Improving donor support for governance: the case for more rigorous impact evaluation

Rigorous governance evaluation poses three key challenges:

• Governance outcomes are difficult to quantify.

• Rigorous impact evaluation can capture no more than narrow aspects of complex, ‘system-wide’governance support and short-term impacts.

• A lack of incentive, since evaluation results may constrain political choices.

Past evaluations provide valuable recommendations to tackle these challenges. In quantifying governance outcomes, use context-specific information or conduct behavioural games. In dealing with complex ‘system-wide’ interventions, identify components of the programme that is viable for rigorous analysis. In improving incentives, persuade politicians to implement rigorous evaluations by studying the impact of their priority interventions

and by setting appropriate expectations.

Rigorous impact evaluation in governance is difficult but feasible. As donors face increasing pressure to demonstrate results, rigorous impact evaluations should work with, not against, achieving improved governance support and development outcomes.

From: Garcia, Maria Melody (2011)
Improving donor support for governance: the case for more rigorous impact evaluation
Bonn: Deutsches Institut für Entwicklungspolitik / German Development Institute
(Briefing Paper 11/2011)

via Improving donor support for governance: the case for more rigorous impact evaluation.

0

OECD-DAC Quality Standards for Development Evaluation

The OECD-DAC Quality Standards for Development Evaluation, built through international consensus, provide a guide to good practice. They are not intended to be used as a development evaluation manual, but they outline the key quality dimensions for each phase of a typical evaluation process: defining purpose, planning, designing, implementing, reporting, and learning from and using evaluation results. Principles informing the whole of the evaluation process are transparency and independence; integrity and respect for diversity; partnership, coordination and alignment; capacity development; and quality control.

via GSDRC: display.

0

Tracking the effectiveness of climate change adaptation

GTZ. Monitoring and evaluation – tracking the effectiveness of adaptation.

M&E plays a central role in capturing whether and how interventions lead to the successful achievement of their objectives. This is of particular importance in the relatively new field of adaptation to climate change, where interventions are still in the phase of being defined and tested. Showing which ad aptation interventions lead to desired results is also important in securing funding, since financial resources are being made available specifically for adaptation measures and funders want proof of how they enable adaptation.