Validity with the CAAP Assessment

1 / 14

# Validity with the CAAP Assessment - PowerPoint PPT Presentation

Validity with the CAAP Assessment. Validity for what purpose?. Placement/Progress Accountability/Accreditation. Validity measures of what type?. Absolute score based Normative. Possible validity models. Correlations with accepted measures of skills

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

## Validity with the CAAP Assessment

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

### Validity with the CAAP Assessment

Validity for what purpose?
• Placement/Progress
• Accountability/Accreditation
Validity measures of what type?
• Absolute score based
• Normative
Possible validity models
• Correlations with accepted measures of skills
• Prediction of accepted measures of skills
• Change across time
Placement/Progress models
• Based on some measure of future success (e.g. graduation, upper level GPA)
• Regression model based

Model: Value-Added – All Students

.40

Achievement beyond 2nd year

Achievement first two years

.68

.49

.64

.79

.77

.40

Graduation in 6 years

.81

High School Prep

.81

.04

-.02

Progress beyond 2nd year

Progress first two years

CFI = .95

RMSEA = .08

.39

7

Accountability/Accreditation
• Tend to be normative
• Comparison group of like institutions
• Adjustment for covariates
• Longitudinal/Cross sectional

Example of longitudinal study

Pascarella, Bohr, Nora and Terenzini, (1995) Journal of Higher Education

Example of cross sectional model

• VSA
• ACT Linkage report
• Uses ACT scores as a covariate
• Develops conditional distribution of CAAP scores given ACT score, based on a large sample
• Compares institutional distribution with comparison distribution (based on deciles)
What’s next?
• Assessments of a different type

(non multiple choice)

• Standardization of alternative measures

(alternative assessment types, portfolios, college GPA)

Example of what is possible
• Bassiri and Schulz (2003) Constructing a universal scale of high school course difficulty
International dreams
• Is there a PISA or a Bologna in our future?
• Is college knowledge the same across the globe?
• Are the populations in college the same?