How to encourage utilization
This presentation is the property of its rightful owner.
Sponsored Links
1 / 22

How to Encourage Utilization PowerPoint PPT Presentation


  • 97 Views
  • Uploaded on
  • Presentation posted in: General

How to Encourage Utilization. Chapter 14 April 3 rd and 5 th , 2006. To encourage utilization, present reports in a way that gets attention!. To encourage utilization, present reports in a way that gets attention!. The multiple uses of Evaluations.

Download Presentation

How to Encourage Utilization

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


How to encourage utilization

How to Encourage Utilization

Chapter 14

April 3rd and 5th, 2006


To encourage utilization present reports in a way that gets attention

To encourage utilization, present reports in a way that gets attention!


To encourage utilization present reports in a way that gets attention1

To encourage utilization, present reports in a way that gets attention!


The multiple uses of evaluations

The multiple uses of Evaluations

  • Stakeholders are disposed to use the information

  • The evaluation affects the intentions to modify programs

  • Evaluation results in further exploration of particular questions

  • The evaluation might affects the programs evaluated

  • The evaluation affects the development of new laws

  • Evaluation information becomes part of the knowledge base and reduce the uncertainty of administrators, stakeholders, and people involve in program

  • Evaluation might bring change in practice


How to encourage utilization

  • Obstacles


Obstacles to effective utilization and to implementing findings

Obstacles to effective utilizationand to implementingfindings

  • Constraints on managers

  • Value conflicts among stakeholders

  • Misapplied methodology

  • Evaluating a program at arm’s length


Example border officers armed or unarmed

Example – Border OfficersArmed? or Unarmed?


Dealing with mixed findings

Dealing with mixed findings


Dealing with mixed findings1

Dealing with mixed findings

  • Don’t abdicate your responsability

  • Don’t take the easy way out

  • Show how to use the evaluation to improve the program


Using evaluations when an innovative program seems no better than other treatments

Using Evaluations when an innovative program seems no better than other treatments

  • When can evaluators be sure groups do not differ?

  • Are evaluations valuable even when no advantage for the innovations is found?


When can evaluators be sure groups do not differ

When can evaluators be sure groups do not differ?

  • Sufficient sample sizes?

  • Include an examination of the degree of implementation

  • What failed?

  • Were the measurement tools sufficient to capture the essence of the program?

  • Type II errors?


Type ii error missing a program effect

Type II error = Missing a program effect


How to avoid type ii error

How to avoid Type II error?

  • Raise alpha level above 0.5

  • Examine the impact model- intermediate and final outcomes- specific characteristics of participants

  • Make a good effort to find a difference


Using evaluations when an innovative program seems no better than other treatments1

Using Evaluations when an innovative program seems no better than other treatments

  • When can evaluators be sure groups do not differ?

  • Are evaluations valuable even when no advantage for the innovations is found?


Are evaluations valuable even when no advantage for the innovations is found

Are evaluations valuable even when no advantage for the innovations is found?

Oftenyes!

If the results of an evaluation demonstrate that a standard program is just as effective as an innovative program we can conclude that we can achieve the same results with a less expensive program.


Work release programs for prisoners in the usa example p 277 278

Work-Release Programs for Prisoners in the USAExample p. 277-278


Developing a learning culture

Developing a learning culture

  • Work with stakeholders

  • Adopt developmental interpretations

  • Frame findings in terms of improvements

  • Treat findings as tentative indicators, not final answers

  • Recognize service providers’ needs

  • Keep evaluation findings on the agency’s agenda


The evaluation attitude

The Evaluation Attitude

  • Humility won’t hurt

  • Impatience may lead to disappointment

  • Recognize the importance of the evaluator’s perspective

  • Work on practical questions

  • Work on feasible issues

  • Avoid data addiction

  • Make reports accessible

  • Seek evaluations of your own work

  • Encourage the development of a learning culture


Possible trends

Possible Trends

  • Help the organization make use of an evaluation even when findings are mixed or negative

  • Encourage stakeholders to look upon an evaluation as a development tool to use in making program improvements

  • Evaluators should be involved in discussions in order to explain the findings related to needs, implementation, or outcomes

  • To expect confusion in program design and limitations in implementation in the field and to recognize the constraints on the activities of the managers of service organizations and government agencies

  • See that each program is unique and what works in one place might not be appropriate for another site or with another population

  • Recognize the limitations of evaluation methods


Better evaluations based on

Better evaluations based on…

  • Greater sensitivity to stakeholder needs

  • Deeper respect for importance of the context of a program

  • Less grandiose view of evaluation methods


Group exercises

Group Exercises


The end

The End


  • Login