Sampling and Fieldwork Preparation Plans using the Renewal
This presentation is the property of its rightful owner.
Sponsored Links
1 / 33

Sampling and Fieldwork Preparation Plans using the Renewal Data Collection Instructions PowerPoint PPT Presentation


  • 44 Views
  • Uploaded on
  • Presentation posted in: General

Sampling and Fieldwork Preparation Plans using the Renewal Data Collection Instructions. INTRODUCTIONS. Roll call of States, Regional Office, and Central Office staff participating in the Webinar WRMA Staff Carol Pearson, Project Director Art Marcotte, Site Liaison. WEBINAR LOGISTICS.

Download Presentation

Sampling and Fieldwork Preparation Plans using the Renewal Data Collection Instructions

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Sampling and fieldwork preparation plans using the renewal data collection instructions

Sampling and Fieldwork Preparation Plans using the Renewal Data Collection Instructions


Introductions

INTRODUCTIONS

  • Roll call of States, Regional Office, and Central Office staff participating in the Webinar

  • WRMA Staff

    • Carol Pearson, Project Director

    • Art Marcotte, Site Liaison


Webinar logistics

WEBINAR LOGISTICS

  • Type in questions during, or before exiting, using the “Question and Answer” window

  • WRMA can respond during the Webinar

  • WRMA will respond following the Webinar


Agenda

AGENDA

  • The training session will cover the following:

    • Overview of the Renewal Data Collection Instructions

    • Overview of:

      • Sampling Decisions

      • Generating a Sample

      • Fieldwork Preparation Plan

      • State experiences first review cycle

    • Next Steps


States selected by year of three year reporting cycle

1st Year States

2nd Year States

3rd Year States

Region

State

Region

State

Region

State

I

New Hampshire

I

Massachusetts

I

Connecticut

Vermont

Rhode Island

Maine

II

Puerto Rico

II

New York

II

New Jersey

III

Pennsylvania

III

Virginia

III

Maryland

West Virginia

Delaware

D.C.

IV

Georgia

IV

Florida

IV

North Carolina

Alabama

Tennessee

Kentucky

V

Illinois

Mississippi

South Carolina

Indiana

V

Ohio

V

Michigan

VI

Texas

Wisconsin

Minnesota

Oklahoma

VI

Louisiana

VI

New Mexico

VII

Kansas

Arkansas

VII

Missouri

VIII

Colorado

VII

Iowa

Nebraska

North Dakota

VIII

Utah

VIII

Montana

IX

California

South Dakota

Wyoming

Nevada

IX

Arizona

IX

Hawaii

X

Washington

X

Oregon

X

Idaho

Alaska

STATES SELECTED BY YEAR OF THREE YEAR REPORTING CYCLE

(Section II, Pg. 3 Data Collection Instructions)


Renewal data collection instructions

RENEWALDATA COLLECTION INSTRUCTIONS

  • Year 1 and 2 States will conduct their reviews utilizing the Renewal Data Collection Instructions.

  • The Child Care Bureau is continuing to explore options for potential revisions to the Error Rate Review Process. 

  • Technical assistance will be provided to Lead Agencies through Walter R. McDonald & Associates, Inc (WRMA).


Renewal data collection instructions1

RENEWALDATA COLLECTION INSTRUCTIONS

  • The Renewal Data Collection Instructions is the official document to instruct States in completing the error rate methodology:

    • Sections

      • Introduction

      • Overview & State Reporting Cycle

      • Generating a sample of cases for review

      • Customizing the Record Review Worksheet (ACF-400)

      • Conducting case record reviews

      • Completing the Data Entry Form (ACF-401)

      • Completing and submitting the State Improper Authorizations for Payment Report (ACF-402)

    • Glossary

    • Attachment 1: Record Review Worksheet and Instructions

    • Attachment 2: Data Entry Form and Instructions

    • Attachment 3: State Improper Authorizations for Payment Report and Instructions


Comparison of key changes in dci renewal

COMPARISON OF KEY CHANGES IN DCI RENEWAL

The Renewal DCI requires that sampling decisions (sample size, sampling frequency and source of random number), Fieldwork Preparation plan and assurances be submitted for approval to the ACF Regional Office no later than October 31 of the calendar year prior to the reporting year.

The Renewal DCI requires CCB approval of the use of all replacement cases.


Timeline for implementing error rate methodology

TIMELINE FOR IMPLEMENTING ERROR RATE METHODOLOGY


Review period

REVIEW PERIOD

FFY 12 month review period: ends Sept 30th of calendar year prior to submission of State’s Improper Authorizations for Payment Report(ACF-402)

  • 1st Year Reporting States:

    • Submit their ACF-402 by June 30, 2011

    • For an Oct. 1, 2009—Sept. 30, 2010 review period

  • 2ndYear Reporting States:

    • Submit their ACF-402 by June 30, 2012

    • For an Oct. 1, 2010—Sept. 30, 2011 review period

      (Section IV, Pg. 5 Data Collection Instructions)


Ro approval of fieldwork preparation plans

RO APPROVAL OF FIELDWORK PREPARATION PLANS

  • RO approval of Fieldwork Preparation Plans before State draws first sample

  • Year 1States submit to RO by Oct. 31, 2010:

    • Sampling Decisions

    • Fieldwork Preparation Plan

    • Assurances

  • Year 2 States submit by Oct. 31, 2011

  • (Section II, Pg. 2Data Collection Instructions)


    Core elements of sampling decisions

    Core Elements of SAMPLING DECISIONS

    Selection of:

    • Total sample of 271 or 276 cases

    • Source of random numbers

    • Frequency of selecting monthly sampling frames

    • Number of replacement cases

    (Sect IV,Pg. 5 Data Collection Instructions)


    Sampling unit

    SAMPLING UNIT

    • A child for whom a subsidy was authorized for the sample month

    • CCDF and Pooled CCDF Funded Children Only

    • State systems and authorizations vs. payments

    (Section IV, Pg. 6 Data Collection Instructions)


    Frequency of sampling frame selection

    FREQUENCY OF SAMPLING FRAME SELECTION

    • States create sampling frames for each of the 12 months of the review period

    • States must specify their sampling frames. Examples include:

      • Monthly

      • Quarterly

      • Semi-annually, or

      • Annually

    (Sect II, Pg 2 Data Collection Instructions)


    Use of replacement cases

    USE OF REPLACEMENT CASES

    • When a sampled case record is:

      • Unavailable

        • due to a natural disaster

        • Under appeal

        • Referred for a fraud investigation

      • Other

      • RO approval required prior to use of any replacement case

    (Section IV, Pg. 6 Data Collection Instructions)


    Core elements of fieldwork preparation plans

    Core Elements of Fieldwork Preparation Plans

    • Review of State policies and procedures

    • Determining what constitutes an error

    • Selection and Training of Review Team

    • IT Involvement and Tasks

    • Case review logistics


    Incorporate lessons learned during last review cycle

    INCORPORATE LESSONS LEARNEDDURING LAST REVIEW CYCLE

    • Policy Changes

    • Error Definition

    • Review Team size, Composition and Training

    • Use of TA and Site Visit

    • IT and Sampling Issues

    • Sampling Frequency

    • Initiating Review Process

    • Logistics of Case Record Reading


    Review policies and procedures

    REVIEW POLICIES AND PROCEDURES

    • Review policies and procedures to:

      • Reflect State policies in effect at time of authorization

      • Decide how they will be recorded

      • Customize Record Review Worksheet to reflect policy

      • Defining errors and improper authorization errors

    (Sect V, Pg. 8 Data Collection Instructions)


    Error definition

    ERROR DEFINITION

    States define:

    What constitutes an error

    and

    Which errors result in an improper authorization

    (Glossary Pg. 43 Data Collection Instructions)


    Error definition cont

    Error Definition (CONT.)


    Consistent error interpretation

    consistent error interpretation

    To ensure consistency in error findings:

    • Conduct mock case reviews

    • Discuss, as a group, case review findings

    • Conduct re-reviews

    (Section VI, Pg. 16 Data Collection Instructions)


    Review team selection

    REVIEW TEAM SELECTION

    • State Review Team Staff:

      • Know State child care policies

      • Share understanding of what is an error

      • Have not made or approved eligibility determinations during the review period

      • Are not under supervision of persons responsible for eligibility determinations during the review

    (Sect VI, Pg. 16 Data Collection Instructions)


    Case review logistics

    CASE REVIEW LOGISTICS

    The State needs to consider several logistical issues:

    • Review of electronic case records

    • Location of record review:

      • On-site, centrally or regionally

    • Coordination with local offices


    Sampling assurance

    SAMPLING ASSURANCE

    States submit statement:

    The State will abide by the monthly sample instructions in "Measuring Improper Authorizations for Payment in the Child Care Program."


    Example of state s submission to ro

    EXAMPLE OF STATE’SSUBMISSION TO RO

    Sampling Decisions:

    Chose a sample size and number of replacement cases

    • State chooses to randomly select 23 cases per month for a total of 276 cases and 3 replacement cases per month for a total of 36 replacement cases. The State will seek RO approval prior to the use of any replacement case.

      Cite frequency of collecting monthly sampling frames

    • Statewill collect sampling frames and cases monthly. This will begin in MM/YYYY.

      Cite software used for random number source

    • State will use a computer program written in Visual Basic for an automated random number generator.


    Example of state s submission to ro cont

    EXAMPLE OF STATE’S SUBMISSION TO RO (cont.)

    Fieldwork Preparation Plan:

    Selection of a Project Administrator and Improper Payments Planning Team

    • Mary Doe, Director of Child Care Services will serve as Administrator for the Improper Authorizations for Payment Data Collection and Review Project.

    • The State project planning team will be made up of……..

      Selection of a State Review Team

    • Review Team members will be selected from staff of the DSS Division of Provider Reimbursements & Audits. No members of the team will have made or approved eligibility determinations for Child Care Services during the review period.


    Example of state s submission to ro cont1

    EXAMPLE OF STATE’S SUBMISSION TO RO (cont.)

    Fieldwork Preparation Plan:

    Review of Policies and Procedures

    The members of the New State policy unit will review State policies and procedures to revise and define error for each element of the Record Review Worksheet and will draft a customized Record Review Worksheet.

    Error Definition

    The State has defined:

    Error: Any instance in which child care assistance policy was misapplied or not followed, whether or not the misapplication of policy resulted in an improper payment.

    Improper Authorization for Payment: Any authorization for child care assistance payment that should not have been made or that was made in an incorrect amount.


    Example of state s submission to ro cont2

    EXAMPLE OF STATE’S SUBMISSION TO RO (cont.)

    Training of Review Team

    • Members of the State review team will be trained in the following areas:

      • Policy and procedures for determining Child Care Subsidy eligibility

      • Error definitions

      • Child Care caseworker case worksheets

      • Use of the Record Review Worksheet

      • Completion of Data Entry Forms

        Re-Review Process

    • The team leader will re-review all improper authorization errors and 10% of all other cases.


    Example of state s e mail submission to ro cont

    EXAMPLE OF STATE’S E-MAIL SUBMISSION TO RO (cont.)

    Coordination with IT Department

    • State IT Department will:

      • Generate the 12 monthly sampling frames and samples.

      • Identify the total amount of authorizations for payment for the review period.

      • Archive the 12 monthly sampling frames

        State Assurance

    • State will abide by the monthly sample instructions in "Measuring Improper Authorizations for Payment in the Child Care Program."


    Technical assistance

    Technical Assistance

    • WRMA provides Technical Assistance to states in a variety of ways:

      • Four Webinars on the Data Collection Instructions

      • Conference Calls and individual GoToMeetings

      • On-going telephone and email support to answer questions.

      • Site Visits as needed


    Next steps

    NEXT STEPS

    • WRMA will provide:

      • Three additional training Webinars:

        • Customizing Record Review Worksheets:

          October 13, 2010 1:00 – 2:00 p.m. EST

        • Conducting the Record Review Process:

          February 9, 2011 1:00 – 2:00 p.m. EST

        • Completing the State Improper Authorizations for Payment Report:

          April 13, 2011 1:00 – 2:00 p.m. EDT

      • Ongoing technical assistance with each State


    Contact information

    CONTACT INFORMATION

    • Carol Pearson

      (302)226-1542

      [email protected]

    • Art Marcotte

      (410)409-2751

      [email protected]


    Closing remarks

    CLOSING REMARKS

    • Please submit your evaluation following the Webinar.


  • Login