Colleges & Institutes Canada: Episode 6 Part 2 Evaluation experts discuss flaws in their PMF and provide solutions on how the evaluation of the project can be improved

Improving Development Evaluation - A podcast by David Wand

Categories:

In this episode 6, part 2, Dr. Wand discusses with evaluation expert Dr. Jenny Jorgenson Colleges & Institutes Canada www.collegesinstitutes.ca Performance Measurement Framework (PMF) for a $18 Million project in Senegal entitled A Thousand women: I am woman, I exist, I participate. You can learn more about the project here: https://w05.international.gc.ca/projectbrowser-banqueprojets/project-projet/details/P006852001. The experts conclude that Colleges & Institutes Canada cannot make the claim that their project is achieving its outcomes because only 1 of their 17 outcome indicators in their PMF properly measures the project outcomes. This discussion focuses on the flaws with the PMF and provides solutions to how the PMF and the overall evaluation of the project can be improved. In brief, those solutions include:Replace your self-reporting bias of your project beneficiaries (i.e. vulnerable women) from your focus groups with measuring others (e.g. community members, others within their households) on awareness of the need for women to participate in decision-making bodies;Measure women's incomes and their ability to make decisions that show their power before you claim that your project women have increased their 'empowerment'. Your current measures of empowerment in the PMF are not valid measures of empowerment.Either introduce comparison groups or measure your target groups more frequently to support your claims that awareness levels or empowerment levels have increased. Currently, you only measure your target groups once per year in your PMF. This is inadequate to support your claim that your leadership training and entrepreneurship training are responsible for increases in women empowerment.The PMF and complete summary of all 17 outcome indicators for this project is available by emailing [email protected].