Evaluation as Positive Youth Development

Evaluation as Positive Youth Development Ben Silliman, Barbara Swanson, Bill Stone North Carolina 4-H Webinar website: http://nc4-heval.wikispaces.com eXtension E-CoP website: http://collaborate.extension.org/wiki/PDCoP_Evaluation

Evaluation as PYDWho we are eXtension Evaluation Community of Practice monthly webinar …targeting 4-H community professionals and programs A place to network and encourage each other A place to learn together across the continuum A place to make the best better Webinar website: http://nc4-heval.wikispaces.com eXtension E-CoP website: http://collaborate.extension.org/wiki/PDCoP_Evaluation

Evaluation as PYDWhat about today? Do volunteers and youth love to tell you what difference a program made or do they struggle to describe anything beyond ‘what they did’?  Evaluation is as good as the trust, clarity, and insight of program participants

Evaluation as PYDWhat about today? Do your programs “search for impacts” or “plan for impacts”?  Evaluations cannot track what programs have not tried

Evaluation as PYDWhat about today? Do evaluation activities tend to disrupt or enhance relationships with youth?  How you evaluate affects how well you evaluate

Evaluation as PYDWhat about today? Do volunteers and youth love to tell you what difference a program made or struggle to describe anything beyond ‘what they did’?  Begin with relationships Do your programs “search for impacts” or “plan for impacts”?  See the big picture Do evaluation activities tend to disrupt or enhance relationships with youth?  Blend evaluation & programs  Evaluation is in our youth development DNA!

Evaluation as PYDLearning together with youth How do we know 4-H makes a difference? We listen to their stories and dreams We see it in their faces We watch them grow

Evaluation as PYDLearning together with youth We live the difference

Evaluation as PYDLearning together with youth But how do we capture the learning, the leadership and teamwork, the confidence, the commitment to citizenship and service that comes from 4-H experiences?

Evaluation as PYDLearning together with youth …and why is it important?

Evaluation as PYDWhat we know CAN help us Capturing the impact of a youth program helps program leaders… Show accountability for investments of time & money Grow capacities of individuals and organizations to conduct quality programs and measure results Know how to improve programs and innovate Bestow youth with stronger relationships Go forward with clear, accurate DATA and insightful, inspiring ideas to support program success and renew the organization

Evaluation as PYDWhat we know CAN help us Capture and use impacts Accountability: PYD study (national, state, local) Capacity-building: Youth Summit/Civic Education Conference presentations, community awareness Program improvement: Opportunities with youth, community college School-age Care providers Relationships: Talking about bullying w/families

Evaluation as PYDPlan the work and work the plan Planning for quality and impact (program development) helps youth leaders… Develop programs with the right “dosage” to make a difference (intensity-frequency-duration) Train and support staff for maximum effectiveness Develop and test those programs gradually for maximum quality and impact (initiating-refining-maturing program and evaluation)

Evaluation as PYDPlan the work and work the plan Planning programs, not just activities “Dosage”: School enrichment units  Outcomes Training/Support: Coaching volunteer leaders (appropriate goals, continuity across activities) Maturing programs/evaluations: Needs/Experiences …Quality/Outcomes…Individual & Community Impact

Evaluation as PYDHow we find out is what we are about Blending programming and evaluation strategies can help youth leaders… Create authentic and empowering assessment processes that… reflect youth development best practices yield rich and diverse data that can be used by many stakeholders for many different purposes

Evaluation as PYDHow we find out is what we are about Integrate relationships, programming, and evaluation: It’s all youth development Authentic and empowering assessment YDBP: positive climate, guided discovery, teachable moment at camp Data mining: camp observations, mentoring, experiential learning, decision-making…debriefing …training…accountability reports…funding proposals

Evaluation as PYDWhat we’re doing about it Evaluation Learning Circles are learning skills “hands-on” with peers nationwide Self-assessment (and growth!) on evaluation skills, focus group ‘markers’ on goals, achievements Collaborative planning, programming, evaluation on shared program-of-interest (that fits 4-H LRFAs) Leading and participating in national webinars Reporting, publishing results and making a difference

Evaluation as PYDWhat we’re doing about it Evaluation Learning Circles are all over: Camp Millstone* (2006-11): Quality and Impact Northwest* (2007): Presentation Contest North Central (2009-11): Record Books/STEM Northeast (2009-10): PYD/Youth Leadership Southwest (2009-11): Science Fair South Central (2010-11): Club Outcomes Southeast + (2010-11): Presentation Contest Shooting Sports (2011): Training Quality, Outcomes * Results published in Journal of Youth Development

Evaluation as PYDQuestion and Answer Are these the right questions for keeping evaluations positive youth development experiences? Do volunteers and youth love to tell you what difference a program made or struggle to describe anything beyond ‘what they did’? Do your programs “search for impacts” or “plan for impacts”? Do evaluation activities tend to disrupt or enhance relationships with youth?

Evaluation as PYDQuestion and Answer What work do we need to do to answer these questions in our own programs? (comments and questions) Do volunteers and youth love to tell you what difference a program made or struggle to describe anything beyond ‘what they did’? Do your programs “search for impacts” or “plan for impacts”? Do evaluation activities tend to disrupt or enhance relationships with youth?

Evaluation as PYDFeedback to Presenters What should presenters keep or change? Content Delivery

Evaluation as PYDTake-away What insights, skills, or tools will you take away from this webinar?

4-H EvaluationCommunity of PracticeNext Month Join us as Dr. Robert Horton applies today’s theme with the Experiential Learning Model

Evaluation as PYDAdios! Thanks for joining in—it’s your Community of Practice! Webinar website: http://nc4-heval.wikispaces.com eXtension E-CoP website: http://collaborate.extension.org/wiki/PDCoP_Evaluation

Evaluation as PYDDebriefing Delivery LRS Level/Relevance/Specificity EEE Enthusiasm/Engagement/Empathy Content KASA Knowledge/Attitude/Skills/Aspiration gains BA Behavior Change/Application Community OIA Open/Inclusive/Affirming

Evaluation as Positive Youth Development