Developmental disabilities program independent evaluation ddpie project
This presentation is the property of its rightful owner.
Sponsored Links
1 / 36

Developmental Disabilities Program Independent Evaluation (DDPIE) Project PowerPoint PPT Presentation


  • 48 Views
  • Uploaded on
  • Presentation posted in: General

Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Technical Assistance Institute UCEDDs June 12, 2008 Westat Lynn Elinson, Ph.D. Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Also known as “ADD Independent Evaluation” .

Download Presentation

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Developmental disabilities program independent evaluation ddpie project

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Technical Assistance Institute

UCEDDs

June 12, 2008

Westat

Lynn Elinson, Ph.D.


Developmental disabilities program independent evaluation ddpie project1

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Also known as “ADD Independent Evaluation”


Purpose of presentation

Purpose of Presentation

  • To provide update on progress since last national UCEDD technical assistance meeting (May, 2007)

  • To present next steps

  • To provide feedback on pilot study

  • To answer questions, obtain comments


Presentation outline

Presentation Outline

  • Background

  • Update on progress

  • Further Validation

  • Timing

  • Feedback on pilot study

  • Comments/questions


1 background

1.Background


Purpose of the ddpie project

Purpose of the DDPIE Project

  • Demonstrate impact of DD Network programs on:

    • Individuals

    • Families

    • Service providers

    • State systems

  • Provide feedback to ADD to help improve the effectiveness of its programs and policies

  • Promote positive achievements of DD Network programs by “storytelling”

  • Promote accountability to the public


Purpose of phase i

Purpose of Phase I

  • Develop tools for independent evaluation

  • Test the tools

  • Report and make recommendations to ADD


Content of measurement matrices

Content of Measurement Matrices

Benchmarks

Key Functions

Indicators

PerformanceStandards


Reporting at national level

Reporting at National Level

Data will be collected on individual programs and rolled up to national level.

Independent evaluation will NOT be comparing programs to one another

Independent evaluation will NOT replace MTARS, which is specific to individual programs.


2 update on progress

2. Update on Progress


Issues raised by all programs

Issues Raised by All Programs

  • Transparency

  • Efficiency - use of existing data

  • Simplicity


Transparency

Transparency

  • Working Groups

  • All programs

    -ERoom

    -Telephone calls

    -Written comments

    -National TA meetings

  • Advisory Panel

  • ADD website

  • Validation Meeting


Efficiency

Efficiency

  • Testing use of existing data (5-year plan, annual report, MTARS background information) in pilot study


Simplicity

Simplicity

  • One of the purposes of the pilot study was to inform the revision or elimination of benchmarks/indicators

  • Advisory Panel recommended not reducing number of benchmarks/indicators until after the pilot study.


3 further validation

3.Further Validation


Opportunities for validation

Opportunities for validation

  • Working Group process*

  • Advisory Panel meetings*

  • Opportunities for feedback from DD Network programs (at national meetings, by telephone, E-Room, in writing)*

  • Pilot study*

  • Validation Meeting*

  • OMB process* – new contract

    *DD Network programs represented


Purpose of validation meeting

Purpose of Validation Meeting

  • To review benchmarks, indicators, and performance standards

  • To rate the indicators on importance or value to ADD independent evaluation goals

  • To make recommendations on process for further development of performance standards


Validation meeting representation

Validation Meeting Representation

  • Self-advocates

  • Family members

  • DD Council members

  • Members of Boards of Directors (P&A)

  • DD Network program staff

  • Policy analysts

  • Researchers


4 timing

4. Timing


Ddpie project milestones

DDPIE Project Milestones


5 feedback on the pilot study

5. Feedback on the Pilot Study


Purpose of pilot study

Purpose of Pilot Study

  • To inform the revision or elimination of some benchmarks/indicators

  • To test data collection instruments

  • To inform the further development of performance standards

  • To determine the usefulness of existing data in reports to ADD

  • To test the logistics for a full-scale independent evaluation


Programs participating in pilot study

Programs Participating in Pilot Study


Criteria for dd council inclusion in pilot study

Criteria for DD Council Inclusion in Pilot Study

  • Geographic diversity (e.g., rural/urban);

  • Geographic region of the United States (west, midwest, and east);

  • Participation in MTARS in 2005 – 2007 (at least 1)

  • Organizational structure (is and is not in a medical school); and

  • Is and is not a LEND program.


Pilot study activities

Pilot Study Activities

  • Development of data collection instruments

  • Training

  • Review of program materials (policies, procedures, forms, reports)

  • Program visits

  • In-person and telephone interviews

  • Review and analysis of reports to ADD – 5-year plan, annual report, MTARS materials (for some)

  • Transcriptions, write-ups, analysis, synthesis


Interviews

Interviews


Pilot study experiences

Pilot Study Experiences

  • Organizing program visit

  • Developing agenda with Executive Director

  • Logistics

  • Some observations to date


Pilot study participants feedback from executive directors

Pilot Study Participants – Feedback from Executive Directors


6 comments and questions

6.Comments and questions


Contacts

Contacts:

  • Lynn Elinson, 412 421-8610, [email protected]

  • Cynthia Thomas, 1-800-937-8281, ext. 4364,

    [email protected]


  • Login