assessment 101 l.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Assessment 101 PowerPoint Presentation
Download Presentation
Assessment 101

Loading in 2 Seconds...

play fullscreen
1 / 25

Assessment 101 - PowerPoint PPT Presentation


  • 127 Views
  • Uploaded on

Assessment 101. Daniel Martinez, PhD Associate Director of Institutional Research Riverside Community College District. Disclaimer. Views expressed in this presentation are mine and do not represent approval of RCCD, CCCAA, or the CCCCO

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Assessment 101' - gwidon


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
assessment 101

Assessment 101

Daniel Martinez, PhD

Associate Director of Institutional Research

Riverside Community College District

disclaimer
Disclaimer
  • Views expressed in this presentation are mine and do not represent approval of RCCD, CCCAA, or the CCCCO
  • Questions should be checked with the “Standards” document and/or with consultation with the CCCCO’s matriculation office
  • Standards, policies and procedures for the evaluation of assessment instruments used in the California Community Colleges (4th edition, revised March 2001)
the placement process
The Placement Process
  • A standardized test is NOT required
    • Interviews
    • Holistic scoring processes
    • Attitude surveys
    • Career aptitude inventories
    • Transcripts
    • Measures of performance
approved tests
2nd Party Tests

COMPASS

CELSA

P&P

Computerized

ACCUPLACER

CPT

Companion

MDTP

CTEP

Critical Mass

CA Chemistry Diagnostic Test

Local Developed or Managed

52 CCCs

Approved Tests
the postmodern context of assessment
The Postmodern Context of Assessment
  • Hermeneutic Circle

Why did the psychic cross the road?

  • Options for new (i.e., unknown) students
    • Start at the beginning
    • Start NOT at the beginning

Demonstrate knowledge

the 6 pieces of the placement process
The 6 Pieces of the Placement Process
  • Validity
  • Freedom from Bias
  • Reliability
  • Standard Error of Measurement (SEM)
  • Disproportionate Impact
  • Standardization
the 6 pieces of the placement process7
The 6 Pieces of the Placement Process
  • Validity
  • Freedom from Bias
  • Reliability
  • Standard Error of Measurement (SEM)
  • Disproportionate Impact
  • Standardization
the 6 pieces of the placement process8
The 6 Pieces of the Placement Process
  • Validity
  • Freedom from Bias
  • Reliability
  • Standard Error of Measurement (SEM)
  • Disproportionate Impact
  • Standardization
validity
Validity
  • Content
  • Criterion

Or

  • Consequential
content validity
Content Validity
  • Placement acts like a prerequisite
  • Faculty participation is necessary
    • Match between items on a test and prerequisite skills for a class
criterion consequential validity
Criterion/Consequential Validity
  • Evidence that students can be placed into different levels of courses
  • Either is permissible to meet this standard
  • Rule of thumb:
    • Criterion: test has not been used for placement
    • Consequential: test has been used for placement
criterion validity
Criterion Validity
  • Various measures can be used
    • Student ratings
    • Faculty ratings
    • Mid-term test scores
    • Final grades
  • The infamous “.35”
  • Professional Judgment
consequential validity
Consequential Validity
  • At a minimum
    • Student evaluation
    • Faculty evaluation

75% agreement

reliability
Reliability

Reliability = Consistency

  • Internal
  • Stable
    • Test-retest
    • Equivalent form
standard error of measurement sem
Standard Error of Measurement (SEM)

The standard deviation of test scores that would have been obtained from a single student had that student been tested multiple times.

SE = S1-r

  • S = Standard deviation
  • r = Reliability coefficient
disproportionate impact
Disproportionate Impact

If the percent of students from a particular group are directed to a particular placement is significantly different then the representation of that group in the population being tested

80/20 Rule

standardization
Standardization
  • Consistent administration of test
  • Any accommodations need to be documented
multiple measures
Multiple Measures
  • If a test is used, more than one measure needs to be used for placement.
  • If another test is used, the correlation between the two tests must be below .80
  • No specific criteria as to what other measures can be
college responsibilities
2nd Party Test

Validity

Content

Criterion/Consequential

DI

Standardization

(Bias, reliability, SEM)

Developed/Managed

Validity

Bias

Reliability

SEM

DI

Standardization

College Responsibilities
developed managed
Developed/Managed

For an INITIAL submission

  • Validity
    • Content
    • Criterion (Professional judgment)
  • Bias
  • DI – how it will be monitored
direct performance
Direct Performance
  • The same 6 criteria are required
  • Reliability uses ratings between judges
    • Correlation r = .70
    • Agreement = 90%

(within 1 point on a 6-point scale)

    • Description of how differences are resolved
thank you

Thank You!

Are there any questions?

cccaa perspective

CCCAA Perspective

Steven Jones, MEd

Counselor/Assessment Center Coordinator

Reedley College

resources available to colleges
Resources Available to Colleges
  • CCCAA Website

WWW.CCCAA.NET

  • Site Visit Advisory Program
    • Free (almost)
    • Pre-site visit assistance
thank you25

Thank You!

Are there any questions?