Assessing fidelity a necessary component of effective implementation
Download
1 / 16

Assessing Fidelity: A Necessary Component of Effective Implementation - PowerPoint PPT Presentation


  • 136 Views
  • Uploaded on

Assessing Fidelity: A Necessary Component of Effective Implementation. Sandra F. Naoom, MSPH National Implementation Research Network Frank Porter Graham Child Development Institute University of North Carolina- Chapel Hill. Child Care Policy Research Consortium Annual Meeting 2009.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Assessing Fidelity: A Necessary Component of Effective Implementation ' - fox


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Assessing fidelity a necessary component of effective implementation
Assessing Fidelity: A Necessary Component of Effective Implementation

Sandra F. Naoom, MSPH

National Implementation Research Network

Frank Porter Graham Child Development Institute

University of North Carolina- Chapel Hill

Child Care Policy

Research Consortium

Annual Meeting 2009


What is implementation
What is Implementation? Implementation

The act of accomplishing some aim or executing some order

To put into practical effect; carry out

Pursue to a conclusion

– Dictionary.com


Stages of implementation

2 – 4 Years Implementation

Stages of Implementation

Major Implementation Initiatives occur in stages:

Exploration

Installation

Initial Implementation

Full Implementation

Innovation

Sustainability


Implementation drivers processes
Implementation Drivers (Processes) Implementation

STAFF

EVALUATION

CONSULTATION & COACHING

DECISION SUPPORT DATA SYSTEMS

INTEGRATED & COMPENSATORY

FACILITATIVE ADMINISTRATIVE SUPPORTS

PRESERVICE TRAINING

RECRUITMENT AND SELECTION

SYSTEMS

INTERVENTIONS


Implementation and fidelity
Implementation and Fidelity Implementation

“The bridge between a promising idea and the impact on students is implementation, but innovations are seldom implemented as intended” .

-Berman & McLaughlin, 1976


Fidelity and fidelity measures
Fidelity and Fidelity Measures Implementation

Fidelity is the degree to which a program as implemented corresponds with the program as described.

(Fixsen, Naoom, Blase, Friedman & Wallace, 2005,

National Implementation Research Network)

Fidelity measures are tools to assess the adequacy of the implementation of the program as described.


Fidelity in the field the prevalence
Fidelity in the Field: The Prevalence Implementation

  • Implementation efforts in the ‘real’ world, are often unsuccessful and highly variable both in terms of the fidelity and sustainability of the program or practice. (Elliott & Mihalic, 2004).

  • About 23%-81% of program activities may be omitted during implementation (Durlak, 1998).

  • “Surprisingly, many of the highest-quality programs fail to take adequate steps to monitor and verify program integrity...This weakens the conclusions that can be drawn regarding the program outcomes and reduces the likelihood that replications will resemble the original program” (Domitrovitch and Greenberg, 2000).


Why is fidelity important
Why is Fidelity Important? Implementation

  • Basis for program effectiveness

  • Helps to avoid Type III Error

    Promotes Internal and External Validity

  • Research has linked fidelity with positive outcomes

    Adult Mental Health- ACT; Children’s Services- FFT, MST, Wraparound; Medicine- DOTS, Texas Algorithm


Why measure fidelity
Why Measure Fidelity? Implementation

Measure Fidelity AND Outcomes BECAUSE

you need to know:

Are we having an implementation problem?

Low fidelity + Poor outcome =

Implementation problem

Are we having an effectiveness problem?

High fidelity + Poor outcome =

Effectiveness problem


Common dimensions of intervention fidelity
Common Dimensions of Intervention Fidelity Implementation

  • Adherence

  • Dosage/Exposure

  • Quality of Program Delivery

  • Participant Responsiveness

  • Program Differentiation

    (e.g. Dane & Schneider, 1998; Dusenbury, 2003)


Nirn s fidelity dimensions
NIRN’s Fidelity Dimensions Implementation

  • Context

    Pre-requisites and pre-conditions for a program to operate.

  • Compliance

    Extent to which practitioner uses intervention processes prescribed by the program and avoids those proscribed by the program.

  • Competence

    Level of skill demonstrated by practitioner while delivering services or treatment to the consumer.


Fidelity assessments
Fidelity Assessments Implementation

Fidelity assessments should include aspects of :

  • Structure

    The framework for service delivery.

  • Process

    The way in which services are delivered.


Methods to develop a fidelity assessment
Methods to Develop a Fidelity Assessment Implementation

Requires the specification of a theory of change; core components of intervention need to be identified and measured.

  • Drawing from a specific program model with proven efficacy and effectiveness

  • Gathering expert opinion

    Survey of experts and/or literature reviews to identify active ingredients or the core components of the program.

  • Opinions of users and advocates regarding what works or site visits of diverse currently operating programs.


Measuring intervention fidelity
Measuring Intervention Fidelity Implementation

Most common methods:

  • Ratings by experts, based on project documentation, client records, site observations, interviews and/or videotaped sessions.

  • Surveys or interviews completed by the individuals delivering the services or those who receive them.


For more information

Sandra F. Naoom, M.S.P.H. Implementation

919-636-2035

[email protected]

For More Information

  • At the Frank Porter Graham Child Development Institute

  • University of North Carolina

  • Chapel Hill, NC

  • http://nirn.fpg.unc.edu/

  • http://www.fpg.unc.edu/~nirn/resources/publications/Monograph/


For more information1

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).

Download all or part of the monograph at:

http://www.fpg.unc.edu/~nirn/resources/publications/Monograph/

To order the monograph go to:

https://fmhi.pro-copy.com/

For More Information


ad