Safety Program Evaluation

1. Safety Program Evaluation Chapter 11 11-1

2. Learning Objectives • Describe the purpose for evaluation of the health and safety program. • Compare the two types of evaluations, process and outcome. • Explain who has the responsibility for evaluation. • Describe a recommended frequency for evaluation and the factors that affect the frequency. 11-2

3. Introduction • The time frame for evaluation will also be goal dependent • Method of evaluation should compare where the organization is now compared to where it was prior to program implementation • To be effective, an understanding of the evaluation process and the measuring of results must be undertaken • Program evaluation is linked in part to Life Safety Initiative 9 11-3

4. The Evaluation Process • Three reasons to evaluate program • See if the program is effective • Determine the response to the program from the members’ perspective • Facilitate program changes Cont. 11-4

5. The Evaluation Process • Process evaluation • Analysis of the procedures of the program and is undertaken throughout the program • Answers the question, “How well did the processes in the program do what they were intended to do?” • Process evaluation steps • Determine who was effected by the program • Determine to what extent • Are improvements occurring as planned • Determine most and least effective parts of the program Cont. 11-5

6. Process Evaluation 11-6

7. The Evaluation Process • Outcome evaluation • Measured after the program has been in effect for a while • The steps in outcome evaluation are: • Compare current injury rates and severities, to those prior to program implementation • Measure the change in knowledge and performance • Analyze the changes in the physical environment • Measure the response to policy changes 11-7

8. Outcome Evaluation 11-8

9. Responsibility for Evaluation • Everyone should play a role in process • The safety program manager may oversee the process • Evaluation may be accomplished through • Safety committee • Incident safety officers • Senior staff members • First line supervisors • External evaluations recommended by NFPA 1500 11-9

10. Evaluation Frequency • Process evaluation continually • Outcome evaluation at specific intervals • Frequency of evaluation should be considered dynamic • Program evaluation is a required component of the safety and health program 11-10

11. Summary • There are two basic formats for the evaluation of the program • Process evaluation • Outcome evaluation • Process evaluation is an ongoing analysis of program • Outcome evaluation compares results with goals and objectives to determine effectiveness • External evaluations are recommended 11-11