developmental disabilities program independent evaluation ddpie project
Download
Skip this Video
Download Presentation
Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Loading in 2 Seconds...

play fullscreen
1 / 36

Developmental Disabilities Program Independent Evaluation DDPIE Project - PowerPoint PPT Presentation


  • 77 Views
  • Uploaded on

Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Technical Assistance Institute UCEDDs June 12, 2008 Westat Lynn Elinson, Ph.D. Developmental Disabilities Program Independent Evaluation (DDPIE) Project. Also known as “ADD Independent Evaluation” .

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Developmental Disabilities Program Independent Evaluation DDPIE Project' - sarila


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
developmental disabilities program independent evaluation ddpie project

Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Technical Assistance Institute

UCEDDs

June 12, 2008

Westat

Lynn Elinson, Ph.D.

developmental disabilities program independent evaluation ddpie project1
Developmental Disabilities Program Independent Evaluation (DDPIE) Project

Also known as “ADD Independent Evaluation”

purpose of presentation
Purpose of Presentation
  • To provide update on progress since last national UCEDD technical assistance meeting (May, 2007)
  • To present next steps
  • To provide feedback on pilot study
  • To answer questions, obtain comments
presentation outline
Presentation Outline
  • Background
  • Update on progress
  • Further Validation
  • Timing
  • Feedback on pilot study
  • Comments/questions
purpose of the ddpie project
Purpose of the DDPIE Project
  • Demonstrate impact of DD Network programs on:
    • Individuals
    • Families
    • Service providers
    • State systems
  • Provide feedback to ADD to help improve the effectiveness of its programs and policies
  • Promote positive achievements of DD Network programs by “storytelling”
  • Promote accountability to the public
purpose of phase i
Purpose of Phase I
  • Develop tools for independent evaluation
  • Test the tools
  • Report and make recommendations to ADD
content of measurement matrices
Content of Measurement Matrices

Benchmarks

Key Functions

Indicators

PerformanceStandards

reporting at national level
Reporting at National Level

Data will be collected on individual programs and rolled up to national level.

Independent evaluation will NOT be comparing programs to one another

Independent evaluation will NOT replace MTARS, which is specific to individual programs.

issues raised by all programs
Issues Raised by All Programs
  • Transparency
  • Efficiency - use of existing data
  • Simplicity
transparency
Transparency
  • Working Groups
  • All programs

- ERoom

- Telephone calls

- Written comments

- National TA meetings

  • Advisory Panel
  • ADD website
  • Validation Meeting
efficiency
Efficiency
  • Testing use of existing data (5-year plan, annual report, MTARS background information) in pilot study
simplicity
Simplicity
  • One of the purposes of the pilot study was to inform the revision or elimination of benchmarks/indicators
  • Advisory Panel recommended not reducing number of benchmarks/indicators until after the pilot study.
opportunities for validation
Opportunities for validation
  • Working Group process*
  • Advisory Panel meetings*
  • Opportunities for feedback from DD Network programs (at national meetings, by telephone, E-Room, in writing)*
  • Pilot study*
  • Validation Meeting*
  • OMB process* – new contract

*DD Network programs represented

purpose of validation meeting
Purpose of Validation Meeting
  • To review benchmarks, indicators, and performance standards
  • To rate the indicators on importance or value to ADD independent evaluation goals
  • To make recommendations on process for further development of performance standards
validation meeting representation
Validation Meeting Representation
  • Self-advocates
  • Family members
  • DD Council members
  • Members of Boards of Directors (P&A)
  • DD Network program staff
  • Policy analysts
  • Researchers
purpose of pilot study
Purpose of Pilot Study
  • To inform the revision or elimination of some benchmarks/indicators
  • To test data collection instruments
  • To inform the further development of performance standards
  • To determine the usefulness of existing data in reports to ADD
  • To test the logistics for a full-scale independent evaluation
criteria for dd council inclusion in pilot study
Criteria for DD Council Inclusion in Pilot Study
  • Geographic diversity (e.g., rural/urban);
  • Geographic region of the United States (west, midwest, and east);
  • Participation in MTARS in 2005 – 2007 (at least 1)
  • Organizational structure (is and is not in a medical school); and
  • Is and is not a LEND program.
pilot study activities
Pilot Study Activities
  • Development of data collection instruments
  • Training
  • Review of program materials (policies, procedures, forms, reports)
  • Program visits
  • In-person and telephone interviews
  • Review and analysis of reports to ADD – 5-year plan, annual report, MTARS materials (for some)
  • Transcriptions, write-ups, analysis, synthesis
pilot study experiences
Pilot Study Experiences
  • Organizing program visit
  • Developing agenda with Executive Director
  • Logistics
  • Some observations to date
contacts
Contacts:

[email protected]

ad