Math Success Project: Using Data to Improve Student Achievement in College-Level Mathematics

1. Math Success Project:Using Data to Improve Student Achievement in College-Level Mathematics Ron Henry, Georgia State University Danette Gerald, The Education Trust

2. Background and History of Mathematics Success Project

3. Nine States in Math Success • NASH/Education Trust • State University System of Florida • University System of Georgia • University of Hawaii System • Purdue University (Indiana) • Kentucky Council on Postsecondary Ed. • University of Louisiana System • Mississippi Institutions of Higher Learning • Nevada System of Higher Education • State University of New York (SUNY)

4. Research Question • What factors/strategies increase success of students in college mathematics courses? • Success definition – number of starters who complete the course with a least a grade of C [or P (if P/F) or S (if S/U)] • For a predictor, success definition – 75% chance of at least a grade of C 4

5. Core Analyses • Student retention/success in each course • % of starters successful (ABC; P; S) • % of starters with W • % of completers successful (ABC; P; S) • Student preparation or placement in a course • ACT/SAT data and success • HS courses and success • Correlation of placement tests 5

6. Core Analyses • Student retention/success in each course • For fall 2005 and spring 2006 • By course; remedial; terminal math; college algebra; pre-calculus; calculus • By sector [2-year; comprehensive; research] • By race/ethnicity 6

7. Developmental math:Percent success starters

8. College Algebra:Percent success starters

9. Average Success by Race

10. Core Analysis I: Conclusions • Wide range of success • Across the various Systems and sectors • Within the same System and sector • Among sections within the same institution • Across ethnicities – significant gaps • Some institutions have much higher success rates => Let’s learn from them

11. Core Analysis II: % Freshmen taking math courses • Range: 41.7% - 85.9% [Median 70.2%] • Surprised that a large percentage of freshmen do not take any math courses in their first year • => Policy implication: Should all freshmen be required to attempt math course in their first year?

12. First math course impact on returning students: Developmental Math

13. First math course impact on returning students: College Algebra

14. First math course impact on returning students: Conclusions • Many students return who have not been successful in their first-year math courses • => Reinforces policy implication of requiring students to take math in their first year

15. High School Preparation How can we work with [high] schools to help more students be successful in K-12 mathematics so that they are prepared for non-remedial mathematics college courses, i.e. test out of Elementary Algebra [Developmental/remedial math]? What percentage of your First Year students completed high school taking less than Algebra II? What percentage completed at least Algebra II? What percentage completed more than Algebra II? How does that preparation correlate with college mathematics readiness? 15

16. HS math courses taken in 12th grade by entering college freshmen

17. HS math & College Success %

18. Conclusions • Regardless of HS math preparation, students placed in remedial math have low probability of success • Preparation in HS matters, however just looking at the course taken in 12th grade is not sufficient for analysis • => Should ask the question: “ What is the highest level mathematics course in HS in which the student was successful?” 18

19. Core Analyses Placement exams and success in course Predictability of ACT/SAT scores and success Pre-requisite course and success in next course 02/13/07 19

20. ACT Math benchmark • ACT Math benchmark for success in College Algebra is 22 • Where success is defined as a 50% probability of obtaining a grade of B or better • Used logistic regression model

21. ACT & % Success (ABC)

22. SAT & % Success (ABC)

23. SAT Math and course success

24. Correlation coefficients

25. ACT Math and course success

26. Conclusion ACT Math appears to be a better predictor of success than SAT Quantitative, but the correlation is fairly weak 02/13/07 26

27. Placement If many students who test into a mathematics course are not being successful in this course, how do we change the screening test? Are there particular topics in which many students are struggling? Are there student characteristics that correlate with success? COMPASS 36 < Alge < 50 -> 79% ABC college algebra COMPASS 30 < Trig < 45 -> 64% ABC pre-calculus COMPASS Trig > 45 -> 79% ABC calculus I 02/13/07 27

28. Placement If a student passes your prerequisite mathematics course with a C or better, what should be a goal for success in their current mathematics course? What is the success of students in subsequent mathematics courses as a function of their grade in the first mathematics course? ABC college algebra -> 59% ABC pre-calculus ABC pre-calculus -> 54% ABC calculus 02/13/07 28

29. Definitions and Examples of Developmental Course Levels

30. Math View III

31. Interventions • Supplemental Instruction (SI) • Course Redesign* • Emporium Model (Virginia Tech) • Fully Online Model (Iowa State) • Replacement Model (U of Alabama) • Supplemental Model (Carnegie Mellon) • Buffet Model (Mohave CC) *Twigg, C. A. (2003). “Improving Learning & Reducing Costs: Redesigning Large-Enrollment Courses.” Educause Review38(5): 28-36.

32. Interventions • Course Redesign • Replacement Model • U of Alabama; LSU; U of Idaho • Recommend 1 hour classroom + 3 hours in math lab

33. Persistence What is the retention and graduation success of your mathematics under-prepared students? How many students who have to repeat their first mathematics course do not enroll for their second year? Are under-prepared students when placed in credit-bearing math courses instead of developmental/remedial courses experiencing success? 02/13/07 33

34. Conclusions Large number of remedial students are not successful Non-remedial students are also not particularly successful, even in Calculus => Need to examine what we mean by readiness for College Algebra or Calculus OR “What are the standards for entrance and exit from a particular mathematics course?” 02/13/07 34

35. Policy Ideas Students can drop and re-enroll at will. Can we at least ask them why?? Students allow long time intervals between steps. Can we encourage them to be continuously enrolled? Students do not understand the relationship and importance of math. How can we stress the importance of specific courses? Students fear math Can we de-mystify it? Non-graded Applied Learning communities

36. Data to monitor Student retention/success in each course % of starters successful % of starters who withdraw Student success in subsequent math course Student success if placed in course Variations in student success across sections of same course Gaps in success for various ethnicities

37. Mathematics Success Project: Data Collection and Analysis Ronald J Henry Georgia State University 37

38. Community College  University Transfer Rates Difficult to get ACCURATE information No national data California picture About 40% of first-time students in the California community colleges are not seeking a degree or certificate, but are pursuing basic skills, job skills, or personal enrichment. Of the 60% who are seeking a degree or certificate, only about 1/4 succeed in transferring to a university and/or earning an associate’s degree or a certificate within six years. Dr. Linda Serra Hagedor (University of Florida) Dr. Alberto Cabrera (University of Maryland) Shulock, N. & Moore, C. (2007) Rules of the Game: How State Policy Creates Barriers to Degree Completion and Impedes Student Success in the California Community College