INTRODUCTION TO PROGRAM EVALUATION

1. INTRODUCTION TO PROGRAM EVALUATION By Lizzette Rojas, PhD and FlordelizSerpa, PhD Non-Profit Evaluation & Resource Center, Inc. (NPERCI)

2. Lizzette Rojas, PhD Dr. Rojas has over seventeen years of experience in the area of evaluation research of health, education, and social services programs. She is the Chief Operating Officer of Non-Profit Evaluation & Resource Center, Inc.

3. FlordelizSerpa, PhD Dr. Serpa is an accomplished researcher and program evaluator. She has applied her skills to organizations in both the public and private sectors. Dr. Serpa is the Chief Executive Officer of Non-Profit Evaluation & Resource Center, Inc.

4. Learning Objectives • Learn about evaluation and evaluation research • Learn about the evaluation process • Be able to develop an evaluation plan • Be able to determine appropriate evaluation designs

5. Definitions • Evaluation • Evaluation research • Assessment • Needs assessment

6. The Evaluation Process: Characteristics • Systematic • Empirical • Logical • Inductive • Explanatory • Specific • Replicable and Valid

7. Stages In TheEvaluation Process • Goals and objectives • Activity standardization • Statistical model design

8. Stages In TheEvaluation Process • Data collection • Data analysis • Explanation of success level • Recommendations

9. Categories Of Evaluation • Relevance • Progress • Efficiency • Effectiveness • Impact

10. Principles In The Selection And Elaboration Of Variables • Objectivity • Verifiable • Uniformity • Specificity • Pertinence • Acceptability

11. The Evaluation Plan • Introduction • Conceptual framework • Objectives • Program description

12. The Evaluation Plan • Measurable indicators • Methodology • Results • Discussion • Conclusions and recommendations

13. Evaluation Designs • True-Experimental Designs • Quasi-Experimental Designs • Non-Experimental Designs • Cost-Benefit Analysis • Cost-Effectiveness Analysis

14. Critical Issues To Be Considered In The Evaluation Design • Description of the organization • Mission • Short and long term goals and objectives • Target population • Description of the services

15. Critical Issues To Be Considered In The Evaluation Design • Priorities of the organization • Changes in the organization • Current situation of the organization • Available resources • Flow chart of the organization

16. Suggested Readings • Thinking About Program Evaluation by Berk and Rossi, Sage Publications, 1998 • Program Evaluation by John Owen, Sage Publications, 1999