Developmental disabilities program independent evaluation ddpie project
Download
1 / 36

Developmental Disabilities Program Independent Evaluation DDPIE Project - PowerPoint PPT Presentation


  • 76 Views
  • Updated On :

Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Technical Assistance Institute UCEDDs June 12, 2008 Westat Lynn Elinson, Ph.D. Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Also known as “ADD Independent Evaluation” .

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Developmental Disabilities Program Independent Evaluation DDPIE Project' - sarila


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Developmental disabilities program independent evaluation ddpie project

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Technical Assistance Institute

UCEDDs

June 12, 2008

Westat

Lynn Elinson, Ph.D.


Developmental disabilities program independent evaluation ddpie project1
Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Also known as “ADD Independent Evaluation”


Purpose of presentation
Purpose of Presentation (DDPIE) Project

  • To provide update on progress since last national UCEDD technical assistance meeting (May, 2007)

  • To present next steps

  • To provide feedback on pilot study

  • To answer questions, obtain comments


Presentation outline
Presentation Outline (DDPIE) Project

  • Background

  • Update on progress

  • Further Validation

  • Timing

  • Feedback on pilot study

  • Comments/questions


1 background
1. Background (DDPIE) Project


Purpose of the ddpie project
Purpose of the DDPIE Project (DDPIE) Project

  • Demonstrate impact of DD Network programs on:

    • Individuals

    • Families

    • Service providers

    • State systems

  • Provide feedback to ADD to help improve the effectiveness of its programs and policies

  • Promote positive achievements of DD Network programs by “storytelling”

  • Promote accountability to the public


Purpose of phase i
Purpose of Phase I (DDPIE) Project

  • Develop tools for independent evaluation

  • Test the tools

  • Report and make recommendations to ADD


Content of measurement matrices
Content of Measurement Matrices (DDPIE) Project

Benchmarks

Key Functions

Indicators

PerformanceStandards


Reporting at national level
Reporting at National Level (DDPIE) Project

Data will be collected on individual programs and rolled up to national level.

Independent evaluation will NOT be comparing programs to one another

Independent evaluation will NOT replace MTARS, which is specific to individual programs.


2 update on progress
2. Update on Progress (DDPIE) Project


Issues raised by all programs
Issues Raised by All Programs (DDPIE) Project

  • Transparency

  • Efficiency - use of existing data

  • Simplicity


Transparency
Transparency (DDPIE) Project

  • Working Groups

  • All programs

    - ERoom

    - Telephone calls

    - Written comments

    - National TA meetings

  • Advisory Panel

  • ADD website

  • Validation Meeting


Efficiency
Efficiency (DDPIE) Project

  • Testing use of existing data (5-year plan, annual report, MTARS background information) in pilot study


Simplicity
Simplicity (DDPIE) Project

  • One of the purposes of the pilot study was to inform the revision or elimination of benchmarks/indicators

  • Advisory Panel recommended not reducing number of benchmarks/indicators until after the pilot study.


3 further validation
3. Further Validation (DDPIE) Project


Opportunities for validation
Opportunities for validation (DDPIE) Project

  • Working Group process*

  • Advisory Panel meetings*

  • Opportunities for feedback from DD Network programs (at national meetings, by telephone, E-Room, in writing)*

  • Pilot study*

  • Validation Meeting*

  • OMB process* – new contract

    *DD Network programs represented


Purpose of validation meeting
Purpose of Validation Meeting (DDPIE) Project

  • To review benchmarks, indicators, and performance standards

  • To rate the indicators on importance or value to ADD independent evaluation goals

  • To make recommendations on process for further development of performance standards


Validation meeting representation
Validation Meeting Representation (DDPIE) Project

  • Self-advocates

  • Family members

  • DD Council members

  • Members of Boards of Directors (P&A)

  • DD Network program staff

  • Policy analysts

  • Researchers


4 timing
4. Timing (DDPIE) Project




Purpose of pilot study
Purpose of Pilot Study (DDPIE) Project

  • To inform the revision or elimination of some benchmarks/indicators

  • To test data collection instruments

  • To inform the further development of performance standards

  • To determine the usefulness of existing data in reports to ADD

  • To test the logistics for a full-scale independent evaluation



Criteria for dd council inclusion in pilot study
Criteria for DD Council Inclusion in Pilot Study (DDPIE) Project

  • Geographic diversity (e.g., rural/urban);

  • Geographic region of the United States (west, midwest, and east);

  • Participation in MTARS in 2005 – 2007 (at least 1)

  • Organizational structure (is and is not in a medical school); and

  • Is and is not a LEND program.


Pilot study activities
Pilot Study Activities (DDPIE) Project

  • Development of data collection instruments

  • Training

  • Review of program materials (policies, procedures, forms, reports)

  • Program visits

  • In-person and telephone interviews

  • Review and analysis of reports to ADD – 5-year plan, annual report, MTARS materials (for some)

  • Transcriptions, write-ups, analysis, synthesis


Interviews
Interviews (DDPIE) Project


Pilot study experiences
Pilot Study Experiences (DDPIE) Project

  • Organizing program visit

  • Developing agenda with Executive Director

  • Logistics

  • Some observations to date




Contacts
Contacts: Directors

  • Lynn Elinson, 412 421-8610, [email protected]

  • Cynthia Thomas, 1-800-937-8281, ext. 4364,

    [email protected]


ad