1 / 14

Evaluating Capabilities: Building Consensus on Measures and Indicators for Youth Services

This report by Jason Pollard explores the development and evaluation of capability measures and indicators for youth services, guided by the Integrative Development Model. It addresses challenges faced by service deliverers and presents opportunities for sector improvement. Through collaboration with local youth providers, a set of indicators was jointly developed, allowing for a comprehensive evaluation approach. Pilot testing of data collection tools aims to ensure operationally useful information to support decision-making, fostering creativity, resilience, agency, and citizenship among young people.

valin
Download Presentation

Evaluating Capabilities: Building Consensus on Measures and Indicators for Youth Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating Capabilities: Building consensus around capability measures and indicators Jason Pollard Think:Learn:Do

  2. Background • Integrative Development Model (Kia-Keating, 2009) • Young Foundation Report • Adoption by commissioners • Challenge for service deliverers • Opportunity for the sector

  3. The challenges of evaluation • Bringing capabilities into a single tool • Developing a set of (valid) indictors • Scoring a capability measure • Getting the right data out of the service

  4. Meeting the Challenge • Local evaluation network • Feasibility study – • Asked can operationally useful information be collected to support operational decision making

  5. Evaluation Network • Recruited six youth providers through VAL • Jointly developed a set of indicators • Pilot evaluation and pre-test of data collection tool • Full evaluation to ‘road test’ tools

  6. Developing the Indicator Set

  7. Lewisham – Capability Measures • Being Creative • Communication • Relationships and Leadership • Resilience • Confidence and Agency • Managing Feelings • Planning and Problem Solving • Strengthening Citizenship • Making the most of London

  8. Delphi – Agreeing Definitions Example – Being Creative

  9. Delphi – Agreeing Measures How to measure Being Creative

  10. Delphi – Agreeing Indicators What would we expect to see?

  11. The Indicator Set • 27 indicators • Equally split over 9 outcomes • What we would expect to see • Conceptually linked to outcomes

  12. Developing the Data Collection Tool • A ‘composite’ tool – brings together several capability scales • Valid and reliable (in pre-test) • Soft Data – questions relating to the development of the young person and their engagement with their project • Hard Data – age-specific questions directly relating to the capabilities

  13. Next Steps • Pilot - Scale-up: 10+ organisations to collect common data • Explore Thematic indicators (talent; financial capability, etc) • Establish evaluation communities of interest (Co-ops; CiCs)

  14. End

More Related