Outcome Mapping: A Method for Measuring the Results of Social Change Interventions. Child Rights in Practice: ‘Measuring Our Impact’ May 10-15, 2009 Whistler, British Columbia, Canada. Terry Smutylo [email protected] Two approaches to Evaluation:. As inspection:
Child Rights in Practice:
‘Measuring Our Impact’
May 10-15, 2009
Whistler, British Columbia, Canada
Adapted from: Patton, Michael Q., 2006, “Evaluation for the Way We Work”, The Nonprofit Quarterly, Spring.
program influence decreases
community capacity & ownership increases
key ideas in
The individuals, groups, and organizations you work with directly to support change
The journey is as important as the destination.
a brief history
Identifying system boundaries
sphere of interest
sphere of influence
sphere of ‘control’
Adapted from: Steff Deprez VVOB-CEGO, Nov 2006
What are we trying to accomplish and how?
What do we want to track & how?
What do we
want to learn & report?
step 1: vision
improved human, social, & environmental wellbeing
I have a dream!
Martin Luther King, Jr.
August 28, 1963
…and energizes the team
Across rural India, women and girls utilize and benefit from appropriate health care, education, food and water security and freedom from violence. Women have access to the markets, credit, banking and municipal services they need to pursue their livelihood goals. They use drudgery-reducing technologies and agricultural inputs that contribute to personal well-being and to ecological sustainability. Villages are fully served by public transport, are well lit at night and police enforce all laws fully and equitably. Girls attend school full time and families have the information and resources to make informed decisions regarding their health, safety and social needs. Gender equity governs household labor and decision-making; and men in the community understand and support gender-responsive laws. As elected representatives and as pressure groups, women influence decisions and policies affecting the wellbeing of their families and communities.
vision in graphic form, Nagaland (India)
step 2: mission
Describes how the program intends to:
(what it does, with who, how and why)
Example Mission Statement
The Swayamsiddha Project works with governments, NGOs & CBOs to improve women’s health and empowerment. It facilitates the formation of women’s self help groups by providing funding and training to help them influence community and government services to be more responsive to their health and livelihood needs. The project fosters mutual respect and joint action between women’s self-help groups and banks, police, health & social service providers and government agencies. It researches and promotes ecosystem and human health practices in agriculture and in community health and sanitation services. Swayamsiddha addresses equity issues in all its activities. It uses participatory methods to monitor progress, to learn how to become more effective in supporting its partners and to report on its results.
step 3: boundary partners
sphere of influence
The part of the world you are interested in
= the project’s direct or ‘boundary’ partners
moving from stakeholders...
...to boundary partners
step 4: outcome challenge
what indicators do you use for:
step 5: progress markers
progress markers (ladder of change)
Love to see
Expanding influence, helping others, sharing expertise
Like to see
Actively engaged, learning, commitment
Expect to see
Early encouraging response to program, initial engagement
Girls & Women
Women’s Self Help Groups
Public Health Clinics
step 6: strategy maps
6 kinds of strategies
what networks or relationships will be established or utilized?
how will sustained support, guidance or mentoring be provided?
aimed at boundary partner’s environment
what will be done to produce and “immediate output”?
what will be done to alter the physical or policy environment?
how will the media or publications be used?
aimed atindividual boundary partner
what will be done to build capacity?
value of strategy maps
Flexible: modular to be adapted to use & context
Complementary: combine with other methods
Participatory: in dialogue and collaboration with partners
Evaluative: promote culture of reflection, results oriented thinking,
and social & organizational learning
Points to Remember:
2.Act out of passion, integrity & competence
3.Celebrate the contributions of your team and your partners.
4.Be “idealistic realists.”
5.Learn, then teach upwards.
for more information and to share experiences
…routine, ongoing, collection of information on a program’s outputs, outcomes and indicators to measure, improve and report on the performance.
…the systematic acquisition and assessment of information to provide useful feedback about a program, policy, technology or activity.
…What’s the relationship?
uses of M&E
(behaviour changes in the partners)
relevance & viability
(of the program)
(interventions by the program)
5 kinds of M&E information
c o n t e x t u a l i n f o r m a t i o n
Useful M&E Has 4 Dimensions
‘Rhythm & Spaces’
(Info to users/events/audiences)
(Of interventions & outcomes)
(Data collection & interpretation)
(Choosing what to track & how)
morbidity & mortality
partner actions in community
community responses to proj.
partner collab. with ministry
Annual Project Mtg
Quarterly Reportto Donor
3 yr Prog Review
Quarterly Team Mtg
M&E Planning Worksheet