From Theory to Practice and Back: Finding New Ways to Link Research and Practice

1. From Theory to Practice and Back: Finding New Ways to Link Research and Practice Jennifer Southwick Brown Ph.D. Candidate Department of Human Development May 31, 2007

2. Acknowledgements • Evaluation Team Leaders • Bill Trochim, Jennifer Southwick Brown, Sarah Hertzog, Claire Lobdell, Cath Kane • Evaluation Planning Partnerships • 7 sites in Cornell Cooperative Extension • New York City, Tompkins County, St. Lawrence County, Jefferson County, Chenango County, Onondaga County, Ulster County • Museum of the Earth, Cornell Center for Materials Research

3. Overview • Why did we read the Renger & Hurley (2006) article? • Systems Evaluation • From logic models to Pathway models • Analysis of evidence • The Netway: Creating a tool for the future

4. What do we mean by theory? • Program theory • Theory of change • What we’re going to do, with whom, in what context, to effect what outcomes • Logic Model • Visual representation (typically columnar) of the inputs, activities, outputs, short- and long-term outcomes associated with a program • Basic theory

5. What do we mean by practice? • Activities, Stakeholders, Participants, Outcomes, Goals • How can we achieve a link between research and practice? • Planning and Evaluation/Feedback

6. Developing a Program Model: NYC 4-H After-School Clubs and Special Interest Projects Inputs Outcomes Long Activities Outputs Short Medium Increased rates of higher education & career goal attainment Increased interest in science education Youth interest in science Curricula FTE Extension Educators Partnerships (community, sponsors) State & National 4-H Initiatives Volunteers Students complete engineering kits Agilent Science & Tech Develop leadership skills Public Presentation Program Students make public presentations to a group Volunteer Orientation & Trainings Youth Leadership Academy Context / Assumptions Funder mandates time & budgetary constraints Staff is proficient at train-the trainer skills

7. Developing a Pathway Model Students complete engineering kits Agilent Science & Tech Youth interest in science Increased rates of higher education & career goal attainment Public Presentation Program Increased interest in science education Students make public presentations to a group Develop leadership skills Volunteer Orientation & Trainings Youth Leadership Academy Legend: Activity Outputs Long-Term Outcomes Short-Term Outcomes Medium-Term Outcomes

8. Articulating Causal Relationships Students complete engineering kits Youth interest in science Increased interest in science education

9. Analysis of Evidence: Finding the “Golden Spike” Students complete engineering kits Youth interest in science Increased rates of higher education & career goal attainment Increased interest in science education

10. The Netway • The Netway is an internet-based database tool for monitoring and tracking program activities and participants • Features of the Netway • Stores program information • Converts logic models to pathway models • Produces evaluation plans • Stores participant information • Provides logic model, pathway model, & participant reports

11. The Netway: Tracking Programs http://www.extensionnetway.net/

12. The Netway: Logic Model

13. The Netway: Pathway Model

14. The Netway: Evaluation Plan Report

15. The Netway: Develop Evaluation Plan • Program • Description • Questions • Activities • Methods • Sampling • Measures • Design • Analysis • Reporting

16. The Netway: Participant Report

17. The Netway in the Future • Interactive user database • Practitioner Practitioner: Connecting similar programs, activities, outcomes, & measures • Practitioner Researcher: Connecting research to programs • Referral Linkages • Social Networking • Interactive Web Graphics

18. The Netway in the Future: Referral Linkages

19. The Netway in the Future: Networking

20. The Netway in the Future: Academic Portal

21. The Netway in the Future: Student Portal

22. The Netway in the Future: Visual Networks http://www.touchgraph.com/

23. The Netway in the Future: Visual Networks http://www.touchgraph.com/

24. The Netway in the Future: Visual Networks

25. The Netway: Research to Practice AND BACK • Pilot testing and development with the 7 CCE sites, Museum of the Earth, and CCMR • Designing and populating the researcher portal • Finding gaps in the research literature • Adding additional portals

26. Online Resources • Research Methods Knowledge Base http://www.socialresearchmethods.net • Penn State Cooperative Extension (website) Extension and Outreach Program Evaluation: http://www.extension.psu.edu/evaluation/ • University of Wisconsin Extension (online course) Enhancing Program Performance through Logic Models: http://www1.uwex.edu/ces/lmcourse/ • Cornell Website: http://evaluation.cce.cornell.edu

27. Program Lifecycle EFNEP Farmer’s Market Project Bridge Initiation Development Maturity Translation & Dissemination

28. Program & Evaluation Alignment Program Phase Evaluation Phase EFNEP Farmer’s Market Project Bridge Initiation Development Maturity Translation & Dissemination