Different studies called “Impact Evaluations”

by Jan 12, 2020

Hi! Happy 2020!

With the new year come new (and old) resolutions, like to post more often – mostly when I realize that last year I only posted 8 times in my own blog! (On the other hand I posted more regularly on AEA365, and maybe both things are linked).

However, I am going to try to be more active producing new visual content.

By this point, after more than 5 years exploring synergies between Evaluation and Data Visualization, I have in my to-do list uncountable ideas for visuals, lots of them already started but most of them still unfinished. One of the reasons for keeping some of the visuals in the “oven” (laptop) is because I wait to have reached some point of understanding or conclusion, and that often takes time and has not happened yet.

Today I am sharing a visual of something Howard White shared in White, H. (2010). A Contribution to Current Debates in Impact Evaluation. Evaluation, 16(2), 153–164, about the different types of evaluations that are called “Impact evaluation”. He basically helped me understand, explaining in a neutral voice the differences between studies that are called Impact Evaluation, but not meaning the same with that term, which creates confusion. Some studies just assess outcomes and impact in a generic way, others aim to measure outcomes and impact, and finally (and this is what some people claim that are the “real” impact evaluations but there is no consensus about it) some studies assess the attribution by identifying the conterfactual value. So basically, each of them is a specific case of the previous type, that goes a step further.

So, as usual, I am just presenting his insights in a visual way, by showing they all cohabitate in the same (evaluation field) space, and they all want to study the impact of an intervention to different extents:

As usual, not sure if this is somehow useful, but as usual, it was somehow useful for me (one doubt less in my list).

And as usual, to be continued! 🙂

Forthcoming posts

(published every two weeks-ish 🙂 )

  • ToCs series
  • Visual summary of impact designs
  • Visual summaries of other criteria designs
  • Ideas to make Bibliographies more informative
  • Ways of mapping beneficiaries
  • My favorite pre-attentive features
  • Ideas for reports (series)
  • Some day: iterations with the Periodic Table of Evaluation

And more!

Stay tuned! 🙂

You want to see more Visuals?