Skip to main content

Evaluation Design for Complex Global Initiatives Workshop Summary (2014) / Chapter Skim
Currently Skimming:

2 Overview Framework for Complex Evaluations
Pages 11-16

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 11...
... • Many methods are complex and rapidly changing, creating a demand for guidance in their use. In the opening session of the workshop, Simon Hearn, a research fellow at the Overseas Development Institute, set the stage for discussing the practice of designing and implementing mixed methods evaluations of large complex interventions and presented an overall framework for approaching these types of evaluations.
Read the entire page →
From page 12...
... Can the relationship between inputs and outcomes be defined, and will this relationship change over time? THE BETTEREVALUATION INITIATIVE RAINBOW FRAMEWORK Hearn and his colleagues have developed the BetterEvaluation Rainbow Framework to help evaluators navigate the choices available at each stage of an evaluation (see Figure 2-1)
Read the entire page →
From page 13...
... or results chain, a more sophisticated logical framework, more structured and free-flowing outcomes hierarchies, or realist matrices, though complex Figure 2-1, fixed image, type replaced evaluations are much more likely to rely on the more sophisticated models. Prominent questions include whether an evaluation is looking at the effects on policy, the effects on populations, or both; whether multiple levels of activity are being evaluated; and who the stakeholders are.
Read the entire page →
From page 14...
... Theory-based designs, participatory designs, counterfactual analysis, regulatory frameworks, configurational frameworks, generative frameworks, realist evaluation, general elimination method, process tracing, contribution analysis, and qualitative comparative analysis are among the many techniques that can explore causation. Indeed, said Hearn, the BetterEvaluation website has 29 different options for understanding causes.
Read the entire page →
From page 15...
... "We do not want them just to be published as a report and for the users of those reports to ignore them or to misuse them." This task requires identifying reporting requirements for different stakeholders; developing reporting media, whether written reports, social media campaigns, or some other output; ensuring accessibility for those who can use the results; developing recommendations where appropriate; and helping users of evaluations to apply the findings. Finally, Hearn discussed the management of these six tasks, which includes but is not limited to the following elements: • Understand and engage with stakeholders.
Read the entire page →
From page 16...
... The website offers much more information on each of the elements of the framework, as well as other resources. The BetterEvaluation organization also runs events, clinics, workshops, and other events to help teams work through evaluation design, and it then feeds the information generated by such experiences into its website.
Read the entire page →

Key Terms

  • evaluation questions
  • complex evaluations
  • betterevaluation initiative
  • rainbow framework
  • quantitative data

  • evaluation process
  • key evaluation
  • complex interventions
  • framework hearn
  • help evaluators

  • meso level
  • evaluators navigate
  • social media
  • quality evaluation
  • improve evaluation

  • single evaluation
  • answer evaluation
  • overall evaluation
  • evaluation matrix
  • sophisticated statistical

  • logical framework
  • framework organizes
  • hearn concluded
  • simon hearn
  • evaluating complex

  • sophisticated logical
  • task requires
  • overall framework
  • betterevaluation website
  • betterevaluation rainbow


    • This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
    More information on Chapter Skim is available.