Methods Archive

  • The World Bank offers A Curated List of Our Postings on Technical Topics – Your One-Stop Shop for Methodology | Impact Evaluations.

    A Curated List of Postings on Technical Topics – Your One-Stop Shop for Methodology | Impact Evaluations

    The World Bank offers A Curated List of Our Postings on Technical Topics – Your One-Stop Shop for Methodology | Impact Evaluations.

    Continue Reading...

  • Speaker: Professor Howard White, Former Executive Director, 3ie https://www.youtube-nocookie.com/embed/pWutrZwzP18?list=PLMdLqa33jxDnYmlJXC6_ExjpefosgQ3BF A comprehensive theory of change is integral to designing a high quality and policy relevant impact evaluation. In this video, Professor Howard White uses the example of a school feeding programme to illustrate the steps involved in building a theory of change for an impact evaluation. For more videos with Professor Howard White and for lectures on other topics related to impact evaluations and systematic reviews, click here. 3ie’s How-To videos 3ie’s How-To videos on impact evaluation use a simple step-by-step approach for explaining theoretical concepts. The videos draw from examples of impact evaluations to show you how to apply technical concepts. The videos in this series explore various topics related to designing, implementing and using impact evaluations. A short quiz at the end of each lecture will help you assess your understanding of the subject covered in the video.

    How to build a theory of change for an impact evaluation | Video by Howard White

    Speaker: Professor Howard White, Former Executive Director, 3ie https://www.youtube-nocookie.com/embed/pWutrZwzP18?list=PLMdLqa33jxDnYmlJXC6_ExjpefosgQ3BF A comprehensive theory of change is integral to designing a high quality and policy relevant impact evaluation. In this video, Professor Howard White uses the example of a school feeding programme to illustrate the steps involved in building a theory of change for an impact evaluation. For more videos with Professor Howard White and for lectures on other topics related to impact evaluations and systematic reviews, click here. 3ie’s How-To videos 3ie’s How-To videos on impact evaluation use a simple step-by-step approach for explaining theoretical concepts. The videos draw from examples of impact evaluations to show you how to apply technical concepts. The videos in this series explore various topics related to designing, implementing and using impact evaluations. A short quiz at the end of each lecture will help you assess your understanding of the subject covered in the video.

    Continue Reading...

  • How do you decide who participates in evaluation? What are the power dynamics at play? And how can participation be used to benefit people? This month, BE is shining a spotlight on participation in evaluation. Throughout the month, Better Evaluation published blog posts on some of these key questions. Blogs | Better Evaluation.

    Participation in evaluation blogs and webinar | Better Evaluation

    How do you decide who participates in evaluation? What are the power dynamics at play? And how can participation be used to benefit people? This month, BE is shining a spotlight on participation in evaluation. Throughout the month, Better Evaluation published blog posts on some of these key questions. Blogs | Better Evaluation.

    Continue Reading...

  • Integrating Human Rights and Gender Equality in Evaluations | DME for Peace. This Guidance is aimed at increasing knowledge on the application of these two approaches in evaluation processes but also at raising awareness on their specific relevance and significance for UN work. It complements the UNEG’s Handbook ‘Integrating Human Rights and Gender Equality in Evaluation: Towards UNEG Guidance’, an abridged version that outlines practical steps on how to prepare, conduct and use HR & GE responsive evaluations. The present document deepends each of these aspects, and provides additional theoretical and applied information, tools and suggestions.

    Integrating Human Rights and Gender Equality in Evaluations | DME for Peace

    Integrating Human Rights and Gender Equality in Evaluations | DME for Peace. This Guidance is aimed at increasing knowledge on the application of these two approaches in evaluation processes but also at raising awareness on their specific relevance and significance for UN work. It complements the UNEG’s Handbook ‘Integrating Human Rights and Gender Equality in Evaluation: Towards UNEG Guidance’, an abridged version that outlines practical steps on how to prepare, conduct and use HR & GE responsive evaluations. The present document deepends each of these aspects, and provides additional theoretical and applied information, tools and suggestions.

    Continue Reading...

  • EuropeAid’s evaluation and results-oriented monitoring systems do not provide adequate information on EU development expenditure results, says the European Court of Auditors. Two of the key elements of the accountability framework operated by the European Commission’s Directorate-General for Development and Cooperation (EuropeAid) are its evaluation and results-oriented monitoring (ROM) systems. In its special report published today, the European Court of Auditors (ECA) is critical of the reliability of these systems. Karel Pinxten, the ECA Member responsible for this report, said: “The demand for accountability for EU expenditure in all fields has never been higher. It is not good enough to report achievements in vague global terms. The Commission needs to have the building blocks necessary for a comprehensive reporting system which provides meaningful information for its own management and for its external stakeholders. One of these components is a strong evaluation system which feeds into an overall reporting process. At […]

    EuropeAid’s evaluation and results-oriented monitoring systems do not provide adequate information

    EuropeAid’s evaluation and results-oriented monitoring systems do not provide adequate information on EU development expenditure results, says the European Court of Auditors. Two of the key elements of the accountability framework operated by the European Commission’s Directorate-General for Development and Cooperation (EuropeAid) are its evaluation and results-oriented monitoring (ROM) systems. In its special report published today, the European Court of Auditors (ECA) is critical of the reliability of these systems. Karel Pinxten, the ECA Member responsible for this report, said: “The demand for accountability for EU expenditure in all fields has never been higher. It is not good enough to report achievements in vague global terms. The Commission needs to have the building blocks necessary for a comprehensive reporting system which provides meaningful information for its own management and for its external stakeholders. One of these components is a strong evaluation system which feeds into an overall reporting process. At […]

    Continue Reading...

  • The Bond Evidence Principles and checklist are for assessing and improving the quality of evidence in evaluation reports, research reports and case studies. They have been designed specifically for NGOs and can be used when commissioning, designing and reviewing evidence-based work. The principles help ensure that decisions about projects and programmes are made on the highest quality basis. Bond is the UK membership body for organisations working in international development or supporting those that do through funding, research, training and other services. – See more at: http://www.bond.org.uk/effectiveness/principles#sthash.fI3CuIzp.dpuf

    Evidence Principles  |  Bond

    The Bond Evidence Principles and checklist are for assessing and improving the quality of evidence in evaluation reports, research reports and case studies. They have been designed specifically for NGOs and can be used when commissioning, designing and reviewing evidence-based work. The principles help ensure that decisions about projects and programmes are made on the highest quality basis. Bond is the UK membership body for organisations working in international development or supporting those that do through funding, research, training and other services. – See more at: http://www.bond.org.uk/effectiveness/principles#sthash.fI3CuIzp.dpuf

    Continue Reading...

  • By: EvalPartners in collaboration with other partners This work is inspired by Paris 21’s advocacy tool-kit and aims to fill a gap at the bottom of the “capacity pyramid” (on the enabling environment for evaluation) by advocating for the “demand side” of evaluation. The toolkit was jointly developed by EvalPartners, IOCE and UNWOMEN in partnership with UNEG, UNICEF, the Ministry for Foreign Affairs of Finland and USAID. The final publication “Advocating for Evaluation: A toolkit to develop advocacy strategies to strengthen an enabling environment for evaluation” is now available, for free download here and e-version. The focus of the toolkit is to help civil society organisations, VOPEs, governments and other development partners to: learn how strategic advocacy can be leveraged to increase the demand for evaluation; acquire essential skills to become an effective advocate for building an enabling environment for evaluation; devise a long-term advocacy strategy to develop and implement equity and gender […]

    Advocating for Evaluation: A toolkit to develop advocacy strategies to strengthen an enabling environment for evaluation

    By: EvalPartners in collaboration with other partners This work is inspired by Paris 21’s advocacy tool-kit and aims to fill a gap at the bottom of the “capacity pyramid” (on the enabling environment for evaluation) by advocating for the “demand side” of evaluation. The toolkit was jointly developed by EvalPartners, IOCE and UNWOMEN in partnership with UNEG, UNICEF, the Ministry for Foreign Affairs of Finland and USAID. The final publication “Advocating for Evaluation: A toolkit to develop advocacy strategies to strengthen an enabling environment for evaluation” is now available, for free download here and e-version. The focus of the toolkit is to help civil society organisations, VOPEs, governments and other development partners to: learn how strategic advocacy can be leveraged to increase the demand for evaluation; acquire essential skills to become an effective advocate for building an enabling environment for evaluation; devise a long-term advocacy strategy to develop and implement equity and gender […]

    Continue Reading...

  • This UNEG interactive resource kit contains both a guidance note and a practitioner’s toolkit. It covers joint evaluation management and governance structures, and outlines recommended steps for undertaking joint evaluation, including con-sideration of gender and human rights issues. See UNEG News and Updates.

    UNEG Resource Pack on Evaluation

    This UNEG interactive resource kit contains both a guidance note and a practitioner’s toolkit. It covers joint evaluation management and governance structures, and outlines recommended steps for undertaking joint evaluation, including con-sideration of gender and human rights issues. See UNEG News and Updates.

    Continue Reading...

  • Sick of reporting on just numbers and outputs ?  Do you value useful information on project impacts including unexpected ones?  Do you want to hear how you have made a difference to people’s lives in their own words and what is important to them? A 2 day course in the Most Significant Change (MSC) technique in Berlin (July 21/22) will provide you with the knowledge and a plan to meet these needs. MSC is a story based participatory monitoring & evaluation technique ideally suited to providing qualitative information on project /program impact.  MSC is also an excellent tool for encouraging stakeholder participation, surfacing stakeholder values, fostering organisational learning and program improvement. It is used widely in international development and social change projects. This is a unique opportunity to have MSC training in Germany, from an experienced MSC professional who has delivered training in MSC over 30 times.  If you are […]

    Most Significant Change (MSC) Workshop, Berlin, Germany 21-22 July 2014 Storytelling

    Sick of reporting on just numbers and outputs ?  Do you value useful information on project impacts including unexpected ones?  Do you want to hear how you have made a difference to people’s lives in their own words and what is important to them? A 2 day course in the Most Significant Change (MSC) technique in Berlin (July 21/22) will provide you with the knowledge and a plan to meet these needs. MSC is a story based participatory monitoring & evaluation technique ideally suited to providing qualitative information on project /program impact.  MSC is also an excellent tool for encouraging stakeholder participation, surfacing stakeholder values, fostering organisational learning and program improvement. It is used widely in international development and social change projects. This is a unique opportunity to have MSC training in Germany, from an experienced MSC professional who has delivered training in MSC over 30 times.  If you are […]

    Continue Reading...

  • The Independent Evaluation Group of The World Bank Group hosts an Evaluation Capacity Development webpage. It features resources to help build evaluation knowledge and skills, “how to” help guides to design and manage evaluation process and help in using evaluations as a means to improve project performance. Evaluation Capacity Development (ECD) efforts strengthen and sustain both individuals and organizations to: Access, build, and implement evaluative knowledge and skills; Design, implement, and manage effective evaluation processes and findings; and Use evaluations as a performance improvement tool. Quick Search ECD Working Papers ECD Guides IEG also has Resources for Evaluators/Networks at https://ieg.worldbankgroup.org/evaluators The World Bank Group also offers “A Curated List of Our Postings on Technical Topics – Your One-Stop Shop for Methodology” http://blogs.worldbank.org/impactevaluations/curated-list-our-postings-technical-topics-your-one-stop-shop-methodology Of course this is all included in my Evaluation Resources Library Monitoring and Evaluation Reading List

    IEG’s Evaluation Capacity Development Website

    The Independent Evaluation Group of The World Bank Group hosts an Evaluation Capacity Development webpage. It features resources to help build evaluation knowledge and skills, “how to” help guides to design and manage evaluation process and help in using evaluations as a means to improve project performance. Evaluation Capacity Development (ECD) efforts strengthen and sustain both individuals and organizations to: Access, build, and implement evaluative knowledge and skills; Design, implement, and manage effective evaluation processes and findings; and Use evaluations as a performance improvement tool. Quick Search ECD Working Papers ECD Guides IEG also has Resources for Evaluators/Networks at https://ieg.worldbankgroup.org/evaluators The World Bank Group also offers “A Curated List of Our Postings on Technical Topics – Your One-Stop Shop for Methodology” http://blogs.worldbank.org/impactevaluations/curated-list-our-postings-technical-topics-your-one-stop-shop-methodology Of course this is all included in my Evaluation Resources Library Monitoring and Evaluation Reading List

    Continue Reading...

  • The video documentation of the Global Conference: Building a Global Citizens Movement is ready. Spend 9 minutes worth watching and connect yourself to the global citizen movement! In July 2013, 200 active citizens from around the world met in Johannesburg to start “Building a Global Citizens Movement”. This research conference, co-organised by DEEEP/CONCORD in collaboration with CIVICUS – World Alliance for Citizens Participation and GCAP – Global Call to Action against Poverty, was not a one-shot experience. All together we want to start building a Global Citizens Movement gathering grassroots movement, civil society organisations and activists from 6 continents. The Johannesburg conference was the first, but not the last! Through a participative and transparent methodology, the participants endorsed the Johannesburg Compass: Questions and orientations as a first-step engagement towards the movement. Find the text in its current version (the one endorsed during the conference) here. The platform will be the […]

    DEEEP Global Conference: Building a Global Citizens Movement

    The video documentation of the Global Conference: Building a Global Citizens Movement is ready. Spend 9 minutes worth watching and connect yourself to the global citizen movement! In July 2013, 200 active citizens from around the world met in Johannesburg to start “Building a Global Citizens Movement”. This research conference, co-organised by DEEEP/CONCORD in collaboration with CIVICUS – World Alliance for Citizens Participation and GCAP – Global Call to Action against Poverty, was not a one-shot experience. All together we want to start building a Global Citizens Movement gathering grassroots movement, civil society organisations and activists from 6 continents. The Johannesburg conference was the first, but not the last! Through a participative and transparent methodology, the participants endorsed the Johannesburg Compass: Questions and orientations as a first-step engagement towards the movement. Find the text in its current version (the one endorsed during the conference) here. The platform will be the […]

    Continue Reading...

  • Randomized controlled trials (RCTs) are now widely used in development economics. However, their use is often resisted by non-governmental development organizations. The objections they raise differ between the three types of activities of such non-governmental organizations (NGOs): capacity building, advocacy, and service delivery. This paper discusses the objections and alternatives to RCTs for each type. RCTs might not be appropriate even for service delivery, the activity which would appear to be best suited to their use. This is because typically local NGO staff can use their discretion in selecting communities or individuals for participation in a service-delivery programme. A standard RCT does not mimic the use of private knowledge of local circumstances and can therefore be misleading. Chris Elbers and Jan Willem Gunning WIDER Working Paper 2014/026 via UNU-WIDER : WP/2014/026 Evaluation of non-governmental development organizations.

    Evaluation of non-governmental development organizations | UNU-WIDER WP/2014/026

    Randomized controlled trials (RCTs) are now widely used in development economics. However, their use is often resisted by non-governmental development organizations. The objections they raise differ between the three types of activities of such non-governmental organizations (NGOs): capacity building, advocacy, and service delivery. This paper discusses the objections and alternatives to RCTs for each type. RCTs might not be appropriate even for service delivery, the activity which would appear to be best suited to their use. This is because typically local NGO staff can use their discretion in selecting communities or individuals for participation in a service-delivery programme. A standard RCT does not mimic the use of private knowledge of local circumstances and can therefore be misleading. Chris Elbers and Jan Willem Gunning WIDER Working Paper 2014/026 via UNU-WIDER : WP/2014/026 Evaluation of non-governmental development organizations.

    Continue Reading...