Mike Conlon, University of Florida

1. Evaluating the Effectiveness of the CTRC: Designing Quantitative and Qualitative Measures to Assess in Real Time the Value of the Center Mike Conlon, University of Florida

2. Goals and Objectives • Comparing goals and objectives to purpose and mission • Comparing actions to goals and objectives • Comparing actions to accomplishments • Comparing accomplishments to goals and objectives The mission of the University of Florida Clinical and Translational Science Institute is to improve human health by accelerating the translation of scientific discoveries into practical applications and practices for the diagnosis, treatment, prevention and cure of human disease

3. CTSI Institute-Scale Logic Model Communication External Recognition and Support Communication Internal Recognition and Support Professional Validation Health Policies Publications Training Collaboration Health Outcomes Collaboration Interventions Methods, Models & Technologies Transdisciplinary Integration Health Impacts Translation to Practice Scientific Integration Short-term Markers Intermediate-term Markers Long-term Markers Adapted from Trochim et al. 2008

4. Measurement • Measures are identified by program directors, leadership, evaluators • Include quantitative (counts of activities) and qualitative (satisfaction, suggestions) • Use operational data coming from systems. Augment with targeted data collection for evaluation

6. Using Evaluation for Program Improvement Four Steps • Strategic and Tactical Planning • Program Creation and Service Delivery • Program Evaluation • Review findings with program leaders and adjust programs and services -- goals, budgets, personnel

7. Questions & Discussion