TEST EVALUATION By: Larry;Liu,Zhao; AND HANK TOO!
In Today’s Society Education = Testing Scores = Accountability Obviously, Students are held accountable, But also! • Teachers • School districts • States
You should gather the information you need to evaluate a test. 1. Have an idea of what you want the test to measure. 2. Review a sample test from publisher. 3. Analyze test reviews. • Buros and Pro-Ed Test Locators • MMY & ERIC databases 4. Determine for yourself whether the publisher has made a compelling case that the test is valid and appropriate for your intended use.
WE WILL DISCUSS THE FOLLOWING ISSUES CONCERNING TEST EVALUATION • A. Test coverage and use • B. Appropriate samples for test validation and norming • C. Reliability • D. Predictive validity • E. Test administration • F. Test reporting
A. Test coverage and use • The principal question to be asked in evaluating a test is whether it is appropriate for your intended purposes and your students.
B.Appropriate samples for test validation and norming • The individuals in the norming and validation samples should be representative of the group for which the test is intended in terms of age, experience, and background.
C. Reliability • Reliability refers to the consistency of assessment results. • Fundamental to the evaluation of any instrument is the degree to which test scores are free from various sources of measurement error and are consistent from one occasion to another.
D. Predictive validity • Validity is the appropriateness of the interpretations made from test scores and other evaluation results. • In terms of an achievement test, predictive validity refers to the extent to which a test can be appropriately used to draw inferences regarding achievement. Example: high or low validity.
E. Test Administration To insure your test is valid: • Directions should be clear. • Questions should be easy to read. (use basic vocabulary & sentence structure) • Ample time allowed.
E. Test Administration, Cont. • The test is not biased or offensive with regard to race, sex,native language, ethnic origin, geographic region or otherfactors. • Tests are not expected to yield equivalent mean scores across population groups.
F. Test Reporting • The methods used to report test results, including scaled scores, subtests results and combined test results, are described fully along with the rationale for each method. • Test results should be presented in a manner that will helpschools, teachers and students to make decisions that areconsistent with appropriate uses of the test. Help should be available for interpreting and using the test results.
IN CONCLUSION: Since testing is such an important part of education, it must be done correctly! Test Selection & Evaluation is critical. Be sure your tests are: Reliable, Valid, Administered fairly!
THANK YOU FOR YOUR ATTENTION! HAPPY TESTING!