How to encourage utilization
Download
1 / 22

How to Encourage Utilization - PowerPoint PPT Presentation


  • 133 Views
  • Uploaded on

How to Encourage Utilization. Chapter 14 April 3 rd and 5 th , 2006. To encourage utilization, present reports in a way that gets attention!. To encourage utilization, present reports in a way that gets attention!. The multiple uses of Evaluations.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' How to Encourage Utilization' - ainsley-puckett


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
How to encourage utilization

How to Encourage Utilization

Chapter 14

April 3rd and 5th, 2006




The multiple uses of evaluations
The multiple uses of Evaluations attention!

  • Stakeholders are disposed to use the information

  • The evaluation affects the intentions to modify programs

  • Evaluation results in further exploration of particular questions

  • The evaluation might affects the programs evaluated

  • The evaluation affects the development of new laws

  • Evaluation information becomes part of the knowledge base and reduce the uncertainty of administrators, stakeholders, and people involve in program

  • Evaluation might bring change in practice



Obstacles to effective utilization and to implementing findings
Obstacles to effective attention!utilizationand to implementingfindings

  • Constraints on managers

  • Value conflicts among stakeholders

  • Misapplied methodology

  • Evaluating a program at arm’s length


Example border officers armed or unarmed
Example – Border Officers attention!Armed? or Unarmed?



Dealing with mixed findings1
Dealing with mixed findings attention!

  • Don’t abdicate your responsability

  • Don’t take the easy way out

  • Show how to use the evaluation to improve the program


Using evaluations when an innovative program seems no better than other treatments
Using Evaluations when an innovative program seems no better than other treatments

  • When can evaluators be sure groups do not differ?

  • Are evaluations valuable even when no advantage for the innovations is found?


When can evaluators be sure groups do not differ
When can evaluators be sure groups do not differ? than other treatments

  • Sufficient sample sizes?

  • Include an examination of the degree of implementation

  • What failed?

  • Were the measurement tools sufficient to capture the essence of the program?

  • Type II errors?


Type ii error missing a program effect
Type II error than other treatments= Missing a program effect


How to avoid type ii error
How to avoid Type II error? than other treatments

  • Raise alpha level above 0.5

  • Examine the impact model- intermediate and final outcomes- specific characteristics of participants

  • Make a good effort to find a difference


Using evaluations when an innovative program seems no better than other treatments1
Using Evaluations when an innovative program seems no better than other treatments

  • When can evaluators be sure groups do not differ?

  • Are evaluations valuable even when no advantage for the innovations is found?


Are evaluations valuable even when no advantage for the innovations is found
Are evaluations valuable even when no advantage for the innovations is found?

Oftenyes!

If the results of an evaluation demonstrate that a standard program is just as effective as an innovative program we can conclude that we can achieve the same results with a less expensive program.


Work release programs for prisoners in the usa example p 277 278
Work-Release Programs for Prisoners in the USA innovations is found?Example p. 277-278


Developing a learning culture
Developing a learning culture innovations is found?

  • Work with stakeholders

  • Adopt developmental interpretations

  • Frame findings in terms of improvements

  • Treat findings as tentative indicators, not final answers

  • Recognize service providers’ needs

  • Keep evaluation findings on the agency’s agenda


The evaluation attitude
The Evaluation Attitude innovations is found?

  • Humility won’t hurt

  • Impatience may lead to disappointment

  • Recognize the importance of the evaluator’s perspective

  • Work on practical questions

  • Work on feasible issues

  • Avoid data addiction

  • Make reports accessible

  • Seek evaluations of your own work

  • Encourage the development of a learning culture


Possible trends
Possible Trends innovations is found?

  • Help the organization make use of an evaluation even when findings are mixed or negative

  • Encourage stakeholders to look upon an evaluation as a development tool to use in making program improvements

  • Evaluators should be involved in discussions in order to explain the findings related to needs, implementation, or outcomes

  • To expect confusion in program design and limitations in implementation in the field and to recognize the constraints on the activities of the managers of service organizations and government agencies

  • See that each program is unique and what works in one place might not be appropriate for another site or with another population

  • Recognize the limitations of evaluation methods


Better evaluations based on
Better evaluations based on… innovations is found?

  • Greater sensitivity to stakeholder needs

  • Deeper respect for importance of the context of a program

  • Less grandiose view of evaluation methods


Group exercises
Group Exercises innovations is found?


The end
The End innovations is found?


ad