1 / 12

Juan Carlos Calcagno Mathematica Policy Research, Inc. IES Research Conference June 11 th , 2008

The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach: Addressing Endogenous Sorting and Noncompliance. Juan Carlos Calcagno Mathematica Policy Research, Inc. IES Research Conference June 11 th , 2008. >> Introduction: Why is this Important?.

henrygoodwin
Download Presentation

Juan Carlos Calcagno Mathematica Policy Research, Inc. IES Research Conference June 11 th , 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach:Addressing Endogenous Sorting and Noncompliance Juan Carlos Calcagno Mathematica Policy Research, Inc. IES Research Conference June 11th, 2008

  2. >> Introduction: Why is this Important? • Controversial topic in postsecondary education: • Remediation increases access but is costly to states and colleges • Should we pay twice for academic preparation that should have occurred in secondary school? • Large proportion of entering students requiring remedial courses • Remedial credits do not count toward degrees, but students pay tuition for these courses • Little is known about the causal effects of remediation on student outcomes: • Lack of data • Nonrandom selection into remediation Juan Carlos Calcagno, June 11th, 2008

  3. >> Contribution of this Study • Estimate the causal impact of remediation in Florida community colleges using a unique administrative dataset. • Use a quasi-experimental design (regression discontinuity) based on a remedial placement cutoff rule to solve the selection problem. • Discuss threats to internal validity and implications for practice: noncompliance and endogenous sorting Juan Carlos Calcagno, June 11th, 2008

  4. >> FL Administrative Dataset • All first-time, degree-seeking community college students starting in the Fall of 1997 to 2000 (over 100,000 records) • Term-by-term transcript data through Spring of 2006 • All test scores reported (CPT, SAT, ACT) plus other controls • Outcomes: passing Algebra/English 101, retention, certificate, associate degree, transfer to state 4-year college, credits earned (remedial and non-remedial) Juan Carlos Calcagno, June 11th, 2008

  5. Beth and Becky both take the College Placement Test (CPT) Beth scores just above the cut-off score Becky scores just below the cut-off score Beth go to college-level courses Becky go to remediation Crossover: Beth take remediation No-show: Becky never enroll in remediation Compare the outcomes of Beth and Becky >> The Regression Discontinuity Design: Intuition Beth and Becky are observationally similar Endogenous Sorting: Beth retests to place out of remediation Juan Carlos Calcagno, June 11th, 2008

  6. >> Noncompliance Probability of Enrollment in Remediation by CPT Score and Subject ` CPT Score Relative to Math Cutoff CPT Score Relative to Reading Cutoff Juan Carlos Calcagno, June 11th, 2008

  7. .04 .03 .02 .01 0 -50 -40 -30 -20 -10 0 10 20 30 >> Endogenous Sorting around Cutoff Density of Reading CPT for Institution E Juan Carlos Calcagno, June 11th, 2008

  8. T: enrollment in remedial education is the local average treatment effect (RD-IV) >> The Econometric Model D: assignment to remediation (below cutoff) Z: CPT test score is the intention-to-treat estimator (ITT) Robustness tests: (1) add controls; (2) narrow sample; (3) endogenous sorting; (4) functional form & standard errors Juan Carlos Calcagno, June 11th, 2008

  9. >> The Impact of Math Remediation Juan Carlos Calcagno, June 11th, 2008

  10. >> The Impact of Reading Remediation Juan Carlos Calcagno, June 11th, 2008

  11. >> Summary of Findings • Math remediation increases persistence to 2nd year (2 to 3.8%) for students on the margin of passing the cutoff. • Impacts on total credits earned are positive (7 and 3 points, M & R), but not different from zero for college-level credits. • No statistical differences for all other outcomes • The likelihood of passing English 101 was slightly lower for reading remedial students while no difference was found in passing Algebra 101 for math remedial students. Juan Carlos Calcagno, June 11th, 2008

  12. >> Policy Implications • Remediation might promote early persistence in college, but it does not necessarily help students on the margin of passing the cutoff to make progress toward a degree. • Costs of remediation should be given careful consideration in light of the limited benefits. • State Departments of Education should explore noncompliance and retesting practices and consider potential consequences. Juan Carlos Calcagno, June 11th, 2008

More Related