Using curriculum based measurement for progress monitoring in math
Download
1 / 172

Using Curriculum-Based Measurement for Progress Monitoring in Math - PowerPoint PPT Presentation


  • 325 Views
  • Uploaded on

Step 3: How to Administer and Score Math Curriculum-Based Measurement Probes ... problems representing the year-long grade-level math curriculum. ...

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Using Curriculum-Based Measurement for Progress Monitoring in Math' - Kelvin_Ajay


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Using curriculum based measurement for progress monitoring in math l.jpg

Using Curriculum-Based Measurement for Progress Monitoring in Math

Todd Busch

Tracey Hall

Pamela Stecker


Progress monitoring l.jpg
Progress Monitoring in Math

  • Progress monitoring (PM) is conducted frequently and designed to:

    • Estimate rates of student improvement.

    • Identify students who are not demonstrating adequate progress.

    • Compare the efficacy of different forms of instruction and design more effective, individualized instructional programs for problem learners.


What is the difference between traditional assessments and progress monitoring l.jpg
What Is the Difference Between Traditional Assessments and Progress Monitoring?

  • Traditional Assessments:

    • Lengthy tests.

    • Not administered on a regular basis.

    • Teachers do not receive immediate feedback.

    • Student scores are based on national scores and averages and a teacher’s classroom may differ tremendously from the national student sample.


What is the difference between traditional assessments and progress monitoring4 l.jpg
What Is the Difference Between Traditional Assessments and Progress Monitoring?

  • Curriculum-Based Measurement (CBM) is one type of PM.

    • CBM provides an easy and quick method for gathering student progress.

    • Teachers can analyze student scores and adjust student goals and instructional programs.

    • Student data can be compared to teacher’s classroom or school district data.


Curriculum based assessment l.jpg
Curriculum-Based Assessment Progress Monitoring?

  • Curriculum-Based Assessment (CBA):

    • Measurement materials are aligned with school curriculum.

    • Measurement is frequent.

    • Assessment information is used to formulate instructional decisions.

  • CBM is one type of CBA.


Progress monitoring6 l.jpg
Progress Monitoring Progress Monitoring?

  • Teachers assess students’ academic performance using brief measures on a frequent basis.

  • The main purposes are to:

    • Describe the rate of response to instruction.

    • Build more effective programs.


Focus of this presentation l.jpg
Focus of This Presentation Progress Monitoring?

Curriculum-Based Measurement

The scientifically validated form of progress monitoring.


Teachers use curriculum based measurement to l.jpg
Teachers Use Curriculum-Based Measurement To . . . Progress Monitoring?

  • Describe academic competence at a single point in time.

  • Quantify the rate at which students develop academic competence over time.

  • Build more effective programs to increase student achievement.


Curriculum based measurement l.jpg
Curriculum-Based Measurement Progress Monitoring?

  • The result of 30 years of research

  • Used across the country

  • Demonstrates strong reliability, validity, and instructional utility


Research shows l.jpg
Research Shows . . . Progress Monitoring?

  • CBM produces accurate, meaningful information about students’ academic levels and their rates of improvement.

  • CBM is sensitive to student improvement.

  • CBM corresponds well with high-stakes tests.

  • When teachers use CBM to inform their instructional decisions, students achieve better.


Most progress monitoring mastery measurement l.jpg

Most Progress Monitoring: Progress Monitoring?Mastery Measurement

Curriculum-Based Measurement is NOT

Mastery Measurement


Mastery measurement tracks mastery of short term instructional objectives l.jpg
Mastery Measurement: Progress Monitoring?Tracks Mastery of Short-Term Instructional Objectives

  • To implement Mastery Measurement, the teacher:

    • Determines the sequence of skills in an instructional hierarchy.

    • Develops, for each skill, a criterion-referenced test.


Hypothetical fourth grade math computation curriculum l.jpg
Hypothetical Fourth Grade Progress Monitoring?Math Computation Curriculum

1. Multidigit addition with regrouping

2. Multidigit subtraction with regrouping

3. Multiplication facts, factors to nine

4. Multiply two-digit numbers by a one-digit number

5. Multiply two-digit numbers by a two-digit number

6. Division facts, divisors to nine

7. Divide two-digit numbers by a one-digit number

8. Divide three-digit numbers by a one-digit number

9. Add/subtract simple fractions, like denominators

10. Add/subtract whole numbers and mixed numbers


Multidigit addition mastery test l.jpg
Multidigit Addition Mastery Test Progress Monitoring?


Mastery of multidigit addition l.jpg
Mastery of Multidigit Addition Progress Monitoring?

Multidigit Subtraction

Multidigit Addition

10

8

6

in 5 minutes

Number of digits correct

4

2

0

4

8

10

12

14

6

2

WEEKS


Hypothetical fourth grade math computation curriculum16 l.jpg
Hypothetical Fourth Grade Progress Monitoring?Math Computation Curriculum

1. Multidigit addition with regrouping

2. Multidigit subtraction with regrouping

3. Multiplication facts, factors to nine

4. Multiply two-digit numbers by a one-digit number

5. Multiply two-digit numbers by a two-digit number

6. Division facts, divisors to nine

7. Divide two-digit numbers by a one-digit number

8. Divide three-digit numbers by a one-digit number

9. Add/subtract simple fractions, like denominators

10. Add/subtract whole numbers and mixed numbers


Multidigit subtraction mastery test l.jpg
Multidigit Subtraction Mastery Test Progress Monitoring?

Date:

Name:

Subtracting

6

5

2

1

5

4

2

9

8

4

5

5

6

7

8

2

7

3

2

1

3

7

5

6

3

4

7

5

6

9

3

7

3

9

1

5

6

8

2

6

4

2

2

3

4

8

4

2

4

1

5

4

3

2

1

9

4

2

5

2

9

4

2

6

8

5

4

8

7

4


Mastery of multidigit addition and subtraction l.jpg
Mastery of Multidigit Addition Progress Monitoring?and Subtraction

Multidigit Subtraction

Multidigit Subtraction

Multiplication

Multiplication

Multidigit

Multidigit

10

10

Facts

Facts

Addition

Addition

8

8

6

6

Number of problems correct

in 5 minutes

in 5 minutes

Number of digits correct

4

4

2

2

0

0

4

4

8

8

10

10

12

12

14

14

6

6

2

2

WEEKS

WEEKS


Problems with mastery measurement l.jpg
Problems with Mastery Measurement Progress Monitoring?

  • Hierarchy of skills is logical, not empirical.

  • Performance on single-skill assessments can be misleading.

  • Assessment does not reflect maintenance or generalization.

  • Assessment is designed by teachers or sold with textbooks, with unknown reliability and validity.

  • Number of objectives mastered does not relate well to performance on high-stakes tests.


Curriculum based measurement was designed to address these problems l.jpg
Curriculum-Based Measurement Was Designed to Address These Problems

An Example of Curriculum-Based Measurement:

Math Computation


Hypothetical fourth grade math computation curriculum21 l.jpg
Hypothetical Fourth Grade Math ProblemsComputation Curriculum

1. Multidigit addition with regrouping

2. Multidigit subtraction with regrouping

3. Multiplication facts, factors to nine

4. Multiply two-digit numbers by a one-digit number

5. Multiply two-digit numbers by a two-digit number

6. Division facts, divisors to nine

7. Divide two-digit numbers by a one-digit number

8. Divide three-digit numbers by a one-digit number

9. Add/subtract simple fractions, like denominators

10. Add/subtract whole numbers and mixed numbers


Slide22 l.jpg


Slide23 l.jpg

Computation 4 Problems

Sheet #2

Password: AIR

Name:

Date:

A

B

C

D

E

)

5

5

2

2

8

8

5

5

2

2

9

)

8

2

8

5

9

2

4

4

7

2

+

+

6

6

4

4

7

7

0

0

8

8

4

3

0

4

x

0

9

0

+

J

F

G

H

I

)

3

5

4

7

2

1

6

3

0

=

x

7

4

x

x

3

3

5

9

K

L

M

N

O

4

8

3

2

)

)

5

6

5

3

1

6

3

0

-

=

7

x

x

2

3

6

P

Q

S

T

R

1

0

7

)

4

1

6

5

3

2

9

6

+

=

3

x

4

4

1

1

1

1

x

2

U

V

W

X

Y

1

5

0

4

1

1

3

0

)

9

8

1

4

+

6

=

1

4

4

1

)

5

1

0

2

7

x

  • Random numerals within problems

  • Random placement of problem types on page


Donald s progress in digits correct across the school year l.jpg
Donald’s Progress in Digits Correct ProblemsAcross the School Year


Slide25 l.jpg

One Page of a Problems3-Page CBM in Math Concepts and Applications (24 Total Blanks)


Donald s graph and skills profile l.jpg

Darker boxes equal a greater level of mastery. Problems

Donald’s Graph and Skills Profile


Sampling performance on year long curriculum for each curriculum based measurement l.jpg
Sampling Performance on Year-Long Curriculum for Each Curriculum-Based Measurement . . .

  • Avoids the need to specify a skills hierarchy.

  • Avoids single-skill tests.

  • Automatically assesses maintenance/generalization.

  • Permits standardized procedures for sampling the curriculum, with known reliability and validity.

  • SO THAT: CBM scores relate well to performance on high-stakes tests.


Curriculum based measurement s two methods for representing year long performance l.jpg
Curriculum-Based Measurement’s Two Methods for Representing Year-Long Performance

Method 1:

  • Systematically sample items from the annual curriculum (illustrated in Math CBM, just presented).

    Method 2:

  • Identify a global behavior that simultaneously requires the many skills taught in the annual curriculum (illustrated in Reading CBM, presented next).


Hypothetical second grade reading curriculum l.jpg
Hypothetical Second Grade Representing Year-Long PerformanceReading Curriculum

  • Phonics

    • CVC patterns

    • CVCe patterns

    • CVVC patterns

  • Sight Vocabulary

  • Comprehension

    • Identification of who/what/when/where

    • Identification of main idea

    • Sequence of events

  • Fluency


Second grade reading curriculum based measurement l.jpg
Second Grade Reading Curriculum-Based Measurement Representing Year-Long Performance

  • Each week, every student reads aloud from a second grade passage for 1 minute.

  • Each week’s passage is the same difficulty.

  • As a student reads, the teacher marks the errors.

  • Count number of words read correctly.

  • Graph scores.


Curriculum based measurement31 l.jpg
Curriculum-Based Measurement Representing Year-Long Performance

  • Not interested in making kids read faster.

  • Interested in kids becoming better readers.

  • The CBM score is an overall indicator of reading competence.

  • Students who score high on CBMs are better:

    • Decoders

    • At sight vocabulary

    • Comprehenders

  • Correlates highly with high-stakes tests.


Slide32 l.jpg

CBM Passage for Correct Words per Minute Representing Year-Long Performance


What we look for in curriculum based measurement l.jpg
What We Look for in Curriculum-Based Measurement Representing Year-Long Performance

Increasing Scores:

  • Student is becoming a better reader.

    Flat Scores:

  • Student is not profiting from instruction and requires a change in the instructional program.


Sarah s progress on words read correctly l.jpg
Sarah’s Progress on Words Read Correctly Representing Year-Long Performance

Sarah Smith

Reading 2

180

160

140

120

100

Words Read Correctly

80

60

40

20

0

Sep

Oct

Nov

Dec

Jan

Feb

Mar

Apr

May


Jessica s progress on words read correctly l.jpg
Jessica’s Progress on Words Read Correctly Representing Year-Long Performance

Jessica Jones

Reading 2

180

160

140

120

100

Words Read Correctly

80

60

40

20

0

Sep

Oct

Nov

Dec

Jan

Feb

Mar

Apr

May


Reading curriculum based measurement l.jpg
Reading Curriculum-Based Measurement Representing Year-Long Performance

  • Kindergarten: Letter sound fluency

  • First Grade: Word identification fluency

  • Grades 1–3: Passage reading fluency

  • Grades 1–6: Maze fluency


Kindergarten letter sound fluency l.jpg
Kindergarten Representing Year-Long PerformanceLetter Sound Fluency

p U z L y

  • Teacher: Say the sound that goes with each letter.

  • Time: 1 minute

i t R e w

O a s d f

v g j S h

k m n b V

Y E i c x


First grade word identification fluency l.jpg
First Grade Representing Year-Long PerformanceWord Identification Fluency

  • Teacher: Read these words.

  • Time: 1 minute


Grades 1 3 passage reading fluency l.jpg
Grades 1–3 Representing Year-Long PerformancePassage Reading Fluency

  • Number of words read aloud correctly in 1 minute on end-of-year passages.


Slide40 l.jpg

CBM Passage for Correct Words per Minute Representing Year-Long Performance


Grades 1 6 maze fluency l.jpg
Grades 1–6 Representing Year-Long PerformanceMaze Fluency

  • Number of words replaced correctly in 2.5 minutes on end-of-year passages from which every seventh word has been deleted and replaced with three choices.


Computer maze l.jpg
Computer Maze Representing Year-Long Performance


Donald s progress on words selected correctly for curriculum based measurement maze task l.jpg
Donald’s Progress on Words Selected Correctly for Curriculum-Based Measurement Maze Task


Curriculum based measurement44 l.jpg
Curriculum-Based Measurement Curriculum-Based Measurement Maze Task

  • CBM is distinctive.

    • Each CBM test is of equivalent difficulty.

      • Samples the year-long curriculum.

    • CBM is highly prescriptive and standardized.

      • Reliable and valid scores.


The basics of curriculum based measurement l.jpg
The Basics of Curriculum-Based Measurement Curriculum-Based Measurement Maze Task

  • CBM monitors student progress throughout the school year.

  • Students are given reading probes at regular intervals.

    • Weekly, biweekly, monthly

  • Teachers use student data to quantify short- and long-term goals that will meet end-of-year goals.


The basics of curriculum based measurement46 l.jpg
The Basics of Curriculum-Based Measurement Curriculum-Based Measurement Maze Task

  • CBM tests are brief and easy to administer.

  • All tests are different, but assess the same skills and difficulty level.

  • CBM scores are graphed for teachers to use to make decisions about instructional programs and teaching methods for each student.


Curriculum based measurement research l.jpg
Curriculum-Based Measurement Research Curriculum-Based Measurement Maze Task

  • CBM research has been conducted over the past 30 years.

  • Research has demonstrated that when teachers use CBM for instructional decision making:

    • Students learn more.

    • Teacher decision making improves.

    • Students are more aware of their performance.


Steps to conducting curriculum based measurements l.jpg
Steps to Conducting Curriculum-Based Measurements Curriculum-Based Measurement Maze Task

Step 1: How to Place Students in aMath Curriculum-BasedMeasurement Task forProgress Monitoring

Step 2: How to Identify the Level ofMaterial for Monitoring Progress

Step 3: How to Administer and ScoreMath Curriculum-BasedMeasurement Probes

Step 4: How to Graph Scores


Steps to conducting curriculum based measurements49 l.jpg
Steps to Conducting Curriculum-Based Measurements Curriculum-Based Measurement Maze Task

Step 5: How to Set Ambitious Goals

Step 6: How to Apply Decision Rulesto Graphed Scores to KnowWhen to Revise Programsand Increase Goals

Step 7: How to Use the Curriculum-Based MeasurementDatabase Qualitatively toDescribe Students’ Strengthsand Weaknesses


Step 1 how to place students in a math curriculum based measurement task for progress monitoring l.jpg
Step 1: How to Place Students in a Math Curriculum-Based Measurement Task for Progress Monitoring

  • Grades 1–6:

    • Computation

  • Grades 2–6:

    • Concepts and Applications

  • Kindergarten and first grade:

    • Number Identification

    • Quantity Discrimination

    • Missing Number


Step 2 how to identify the level of material for monitoring progress l.jpg
Step 2: How to Identify the Level of Material for Monitoring Progress

  • Generally, students use the CBM materials prepared for their grade level.

  • However, some students may need to use probes from a different grade level if they are well below grade-level expectations.


Step 2 how to identify the level of material for monitoring progress52 l.jpg
Step 2: How to Identify the Level of ProgressMaterial for Monitoring Progress

  • To find the appropriate CBM level:

    • Determine the grade-level probe at which you expect the student to perform in math competently by year’s end.

      OR

    • On two separate days, administer a CBM test (either Computation or Concepts and Applications) at the grade level lower than the student’s grade-appropriate level. Use the correct time limit for the test at the lower grade level, and score the tests according to the directions.

      • If the student’s average score is between 10 and 15 digits or blanks, then use this lower grade-level test.

      • If the student’s average score is less than 10 digits or blanks, move down one more grade level or stay at the original lower grade and repeat this procedure.

      • If the average score is greater than 15 digits or blanks, reconsider grade-appropriate material.


Step 3 how to administer and score math curriculum based measurement probes l.jpg
Step 3: How to Administer and Score Math Curriculum-Based Measurement Probes

  • Students answer math problems.

  • Teacher grades math probe.

  • The number of digits correct, problems correct, or blanks correct is calculated and graphed on student graph.


Computation l.jpg
Computation Measurement Probes

  • For students in grades 1–6.

  • Student is presented with 25 computation problems representing the year-long, grade-level math curriculum.

  • Student works for set amount of time (time limit varies for each grade).

  • Teacher grades test after student finishes.


Computation55 l.jpg
Computation Measurement Probes

Student Copy of a First Grade Computation Test


Slide56 l.jpg

Computation Measurement Probes


Computation57 l.jpg
Computation Measurement Probes

  • Length of test varies by grade.


Computation58 l.jpg
Computation Measurement Probes

  • Students receive 1 point for each problem answered correctly.

  • Computation tests can also be scored by awarding 1 point for each digit answered correctly.

  • The number of digits correct within the time limit is the student’s score.


Computation59 l.jpg
Computation Measurement Probes

ü

ü

ü

ü

ü

ü

ü

ü

ü

Correct Digits: Evaluate Each Numeral in Every Answer

4507

4507

4507

2146

2146

2146

2

61

4

2361

2

1

44

3 correct

4 correct

2 correct

digits

digits

digits


Computation60 l.jpg
Computation Measurement Probes

Scoring Different Operations

Examples:

23

8 184

16

24

24

0

22

x 43

66

880

946

4

1

1

  • 158

  • 29

  • 129

18

+16

34

3 correct digits

2 correct digits

2 correct digits

3 correct digits


Computation61 l.jpg
Computation Measurement Probes

Division Problems with Remainders

  • When giving directions, tell students to write answers to division problems using R for remainders when appropriate.

  • Although the first part of the quotient is scored from left to right (just like the student moves when working the problem), score the remainder from right to left (because student would likely subtract to calculate remainder).


Computation62 l.jpg
Computation Measurement Probes

Scoring Examples: Division with Remainders

Correct Answer

Student

s Answer

4 0 3 R 5 2

4 3 R 5

(1 correct digit)

ü

2 3 R 1 5

4 3 R 5

ü

ü

(2 correct digits)


Computation63 l.jpg
Computation Measurement Probes

Scoring Decimals and Fractions

  • Decimals: Start at the decimal point and work outward in both directions.

  • Fractions: Score right to left for each portion of the answer. Evaluate digits correct in the whole number part, numerator, and denominator. then add digits together.

    • When giving directions, be sure to tell students to reduce fractions to lowest terms.


Computation64 l.jpg
Computation Measurement Probes

Scoring Examples: Decimals


Computation65 l.jpg
Computation Measurement Probes

Correct Answer

Student

s Answer

6

7 / 1 2

6

8 / 1 1

(2 correct digits)

ü

ü

5

1 / 2

5

6 / 1 2

(2 correct digits)

ü

ü

Scoring Examples: Fractions


Computation66 l.jpg
Computation Measurement Probes

Samantha’s

Computation

Test

  • Fifteen problems attempted.

  • Two problems skipped.

  • Two problems incorrect.

  • Samantha’s score is 13 problems.

  • However, Samantha’s correct digit score is 49.


Computation67 l.jpg
Computation Measurement Probes

Sixth Grade

Computation

Test

  • Let’s practice.


Computation68 l.jpg
Computation Measurement Probes

Answer Key

  • Possible score of 21 digits correct in first row.

  • Possible score of 23 digits correct in the second row.

  • Possible score of 21 digits correct in the third row.

  • Possible score of 18 digits correct in the fourth row.

  • Possible score of 21 digits correct in the fifth row.

  • Total possible digits on this probe: 104.


Concepts and applications l.jpg
Concepts and Applications Measurement Probes

  • For students in grades 2–6.

  • Student is presented with 18–25 Concepts and Applications problems representing the year-long grade-level math curriculum.

  • Student works for set amount of time (time limit varies by grade).

  • Teacher grades test after student finishes.


Concepts and applications70 l.jpg
Concepts and Applications Measurement Probes

Student Copy of a Concepts and Applications test

  • This sample is from a third grade test.

  • The actual Concepts and Applications test is 3 pages long.


Concepts and applications71 l.jpg
Concepts and Applications Measurement Probes

  • Length of test varies by grade.


Concepts and applications72 l.jpg
Concepts and Applications Measurement Probes

  • Students receive 1 point for each blank answered correctly.

  • The number of correct answers within the time limit is the student’s score.


Concepts and applications73 l.jpg
Concepts and Applications Measurement Probes

Quinten’s Fourth Grade Concepts and Applications Test

  • Twenty-four blanks answered correctly.

  • Quinten’s score is 24.


Concepts and applications74 l.jpg
Concepts and Applications Measurement Probes


Slide75 l.jpg

Concepts and Applications Measurement Probes

Fifth Grade Concepts and Applications Test—1

  • Let’s practice.


Slide76 l.jpg

Concepts and Applications Measurement Probes

Fifth Grade Concepts and Applications Test—Page 2


Concepts and applications77 l.jpg
Concepts and Applications Measurement Probes

Fifth Grade Concepts and Applications Test—Page 3

  • Let’s practice.


Concepts and applications78 l.jpg
Concepts and Applications Measurement Probes

Answer Key


Number identification l.jpg
Number Identification Measurement Probes

  • For kindergarten or first grade students.

  • Student is presented with 84 items and is asked to orally identify the written number between 0 and 100.

  • After completing some sample items, the student works for 1 minute.

  • Teacher writes the student’s responses on the Number Identification score sheet.


Number identification80 l.jpg
Number Identification Measurement Probes

Student Copy of

a Number

Identification test

  • Actual student copy is 3 pages long.


Number identification81 l.jpg
Number Identification Measurement Probes

Number Identification Score Sheet


Number identification82 l.jpg
Number Identification Measurement Probes

  • If the student does not respond after 3 seconds, point to the next item and say “Try this one.”

  • Do not correct errors.

  • Teacher writes the student’s responses on the Number Identification score sheet. Skipped items are marked with a hyphen (-).

  • At 1 minute, draw a line under the last item completed.

  • Teacher scores the task, putting a slash through incorrect items on score sheet.

  • Teacher counts the number of correct answers in 1 minute.


Number identification83 l.jpg
Number Identification Measurement Probes

Jamal’s Number

Identification

Score Sheet

  • Skipped items are marked with a (-).

  • Fifty-seven items attempted.

  • Three incorrect.

  • Jamal’s score is 54.


Number identification84 l.jpg
Number Identification Measurement Probes

Teacher Score

Sheet

  • Let’s practice.


Number identification85 l.jpg
Number Identification Measurement Probes

Student

Sheet—Page 1

  • Let’s practice.


Number identification86 l.jpg
Number Identification Measurement Probes

Student

Sheet—Page 2

  • Let’s practice.


Number identification87 l.jpg
Number Identification Measurement Probes

Student

Sheet—Page 3

  • Let’s practice.


Quantity discrimination l.jpg
Quantity Discrimination Measurement Probes

  • For kindergarten or first grade students.

  • Student is presented with 63 items and asked to orally identify the larger number from a set of two numbers.

  • After completing some sample items, the student works for 1 minute.

  • Teacher writes the student’s responses on the Quantity Discrimination score sheet.


Quantity discrimination89 l.jpg
Quantity Discrimination Measurement Probes

Student Copy of a

Quantity

Discrimination test

  • Actual student copy is 3 pages long.


Quantity discrimination90 l.jpg

Quantity Discrimination Score Sheet Measurement Probes

Quantity Discrimination


Quantity discrimination91 l.jpg
Quantity Discrimination Measurement Probes

  • If the student does not respond after 3 seconds, point to the next item and say “Try this one.”

  • Do not correct errors.

  • Teacher writes student’s responses on the Quantity Discrimination score sheet. Skipped items are marked with a hyphen (-).

  • At 1 minute, draw a line under the last item completed.

  • Teacher scores the task, putting a slash through incorrect items on the score sheet.

  • Teacher counts the number of correct answers in a minute.


Quantity discrimination92 l.jpg
Quantity Discrimination Measurement Probes

Lin’s Quantity

Discrimination

Score Sheet

  • Thirty-eight items attempted.

  • Five incorrect.

  • Lin’s score is 33.


Quantity discrimination93 l.jpg
Quantity Discrimination Measurement Probes

Teacher Score

Sheet

  • Let’s practice.


Quantity discrimination94 l.jpg
Quantity Discrimination Measurement Probes

Student

Sheet—Page 1

  • Let’s practice.


Quantity discrimination95 l.jpg
Quantity Discrimination Measurement Probes

Student

Sheet—Page 2

  • Let’s practice.


Quantity discrimination96 l.jpg
Quantity Discrimination Measurement Probes

Student

Sheet—Page 3

  • Let’s practice.


Missing number l.jpg
Missing Number Measurement Probes

  • For kindergarten or first grade students.

  • Student is presented with 63 items and asked to orally identify the missing number in a sequence of four numbers.

  • After completing some sample items, the student works for 1 minute.

  • Teacher writes the student’s responses on the Missing Number score sheet.


Missing number98 l.jpg
Missing Number Measurement Probes

Student Copy

of a Missing

Number Test

  • Actual student copy is 3 pages long.


Missing number99 l.jpg
Missing Number Measurement Probes

Missing Number

Score Sheet


Missing number100 l.jpg
Missing Number Measurement Probes

  • If the student does not respond after 3 seconds, point to the next item and say “Try this one.”

  • Do not correct errors.

  • Teacher writes the student’s responses on the Missing Number score sheet. Skipped items are marked with a hyphen (-).

  • At 1 minute, draw a line under the last item completed.

  • Teacher scores the task, putting a slash through incorrect items on the score sheet.

  • Teacher counts the number of correct answers in I minute.


Missing number101 l.jpg
Missing Number Measurement Probes

Thomas’s

Missing Number

Score Sheet

  • Twenty-six items attempted.

  • Eight incorrect.

  • Thomas’s scoreis 18.


Missing number102 l.jpg
Missing Number Measurement Probes

Teacher Score

Sheet

  • Let’s practice.


Missing number103 l.jpg
Missing Number Measurement Probes

Student

Sheet—Page 1

  • Let’s practice.


Missing number104 l.jpg
Missing Number Measurement Probes

Student

Sheet—Page 2

  • Let’s practice.


Missing number105 l.jpg
Missing Number Measurement Probes

Student

Sheet—Page 3

  • Let’s practice.


Slide106 l.jpg

Step 4: How to Graph Scores Measurement Probes

  • Graphing student scores is vital.

  • Graphs provide teachers with a straightforward way to:

    • Review a student’s progress.

    • Monitor the appropriateness of student goals.

    • Judge the adequacy of student progress.

    • Compare and contrast successful and unsuccessful instructional aspects of a student’s program.


Slide107 l.jpg

Step 4: How to Graph Scores Measurement Probes

  • Teachers can use computer graphing programs.

    • List available in Appendix A of manual.

  • Teachers can create their own graphs.

    • Create template for student graph.

    • Use same template for every student in the classroom.

    • Vertical axis shows the range of student scores.

    • Horizontal axis shows the number of weeks.


Slide108 l.jpg

Step 4: How to Graph Scores Measurement Probes


Slide109 l.jpg

Step 4: How to Graph Scores Measurement Probes

25

20

15

Digits Correct in 3 Minutes

10

5

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

Weeks of Instruction

  • Student scores are plotted on graph and a line is drawn between scores.


Slide110 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

  • Once a few scores have been graphed, the teacher decides on an end-of-year performance goal for each student.

  • Three options for making performance goals:

    • End-of-Year Benchmarking

    • Intra-Individual Framework

    • National Norms


Slide111 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

  • End-of-Year Benchmarking

  • For typically developing students, a table of benchmarks can be used to find the CBM end-of-year performance goal.



Slide113 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

Intra-Individual Framework

  • Weekly rate of improvement is calculated using at least eight data points.

  • Baseline rate is multiplied by 1.5.

  • Product is multiplied by the number of weeks until the end of the school year.

  • Product is added to the student’s baseline rate to produce end-of-year performance goal.


Step 5 how to set ambitious goals l.jpg
Step 5: How to Set Ambitious Goals Measurement Probes

  • First eight scores: 3, 2, 5, 6, 5, 5, 7, and 4.

  • Difference: 7 – 2 = 5.

  • Divide by weeks: 5 ÷ 8 = 0.625.

  • Multiply by baseline: 0.625 × 1.5 = 0.9375.

  • Multiply by weeks left: 0.9375 × 14 = 13.125.

  • Product is added to median: 13.125 + 5 = 18.125.

  • The end-of-year performance goal is 18 (rounding).


Slide115 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

National Norms

  • For typically developing students, a table of median rates of weekly increase can be used to find the end-of-year performance goal.


Slide116 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

National Norms

  • Median: 14

  • Fourth Grade Computation Norm: 0.70

  • Multiply by weeks left: 16 × 0.70 = 11.2

  • Add to median: 11.2 + 14 = 25.2

  • The end-of-year performance goal is 25


Step 5 how to set ambitious goals117 l.jpg
Step 5: How to Set Ambitious Goals Measurement Probes

National Norms

  • Once the end-of-year performance goal has been created, the goal is marked on the student graph with an X.

  • A goal line is drawn between the median of the student’s scores and the X.


Slide118 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

Drawing a Goal-Line

Goal-line: The desired path of measured behavior to reach the performance goal over time.


Slide119 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

  • After drawing the goal-line, teachers continually monitor student graphs.

  • After seven to eight CBM scores, teachers draw a trend-line to represent actual student progress.

    • The goal-line and trend-line are compared.

  • The trend-line is drawn using the Tukey method.

Trend-line: A line drawn in the data path to indicate the direction (trend) of the observed behavior.


Slide120 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

  • Tukey Method

    • Graphed scores are divided into three fairly equal groups.

    • Two vertical lines are drawn between the groups.

  • In the first and third groups:

    • Find the median data point and median instructional week.

    • Locate the place on the graph where the two values intersect and mark with an X.

    • Draw a line between the first group X and third group X.

    • This line is the trend-line.



Slide122 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

25

20

15

Digits Correct in 5 Minutes

10

5

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

Weeks of Instruction

Practice 1


Slide123 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

Practice 1


Slide124 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

25

20

15

Digits Correct in 5 Minutes

10

5

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

Weeks of Instruction

Practice 2


Slide125 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

Practice 2


Slide126 l.jpg

Step 5: How to Set Ambitious Goals Measurement Probes

  • CBM computer management programs are available.

  • Programs create graphs and aid teachers with performance goals and instructional decisions.

  • Various types are available for varying fees.

  • Listed in Appendix A of manual.


Slide127 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals

  • After trend-lines have been drawn, teachers use graphs to evaluate student progress and formulate instructional decisions.

  • Standard decision rules help with this process.


Slide128 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals

  • If at least 3 weeks of instruction have occurred and at least six data points have been collected, examine the four most recent consecutive points:

    • If all four most recent scores fall above the goal-line, the end-of-year performance goal needs to be increased.

    • If all four most recent scores fall below the goal-line, the student's instructional program needs to be revised.

    • If these four most recent scores fall both above and below the goal-line, continue collecting data (until the four-point rule can be used or a trend-line can be drawn).


Slide129 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals

30

Most recent 4 points

25

20

15

Digits Correct in 7 Minutes

10

Goal-line

5

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

Weeks of Instruction


Slide130 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals

30

25

20

15

Digits Correct in 7 Minutes

10

5

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

Weeks of Instruction

Goal-line

Most recent 4 points


Slide131 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals

  • Based on the student’s trend-line:

    • If the trend-line is steeper than the goal line, the end-of-year performance goal needs to be increased.

    • If the trend-line is flatter than the goal line, the student’s instructional program needs to be revised.

    • If the trend-line and goal-line are fairly equal, no changes need to be made.


Slide132 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals


Slide133 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals


Slide134 l.jpg
Step 6: How to Apply Decision Rules to Graphed Scores to Know When to Revise Programs and Increase Goals


Slide135 l.jpg

Step 7: How to Use Curriculum-Based Measurement Data Qualitatively to Describe Student Strengths and Weaknesses

  • Using a skills profile, student progress can be analyzed to describe student strengths and weaknesses.

  • Student completes Computation or Concepts and Applications tests.

  • Skills profile provides a visual display of a student’s progress by skill area.


Slide136 l.jpg

Step 7: How to Use Curriculum-Based Measurement Data Qualitatively to Describe Student Strengths and Weaknesses


Slide137 l.jpg

Step 7: How to Use Curriculum-Based Measurement Data Qualitatively to Describe Student Strengths and Weaknesses


Slide138 l.jpg

Other Ways to Use the Curriculum-Based Measurement Database Qualitatively to Describe Student Strengths and Weaknesses

  • How to Use the Curriculum-Based Measurement Database to Accomplish Teacher and School Accountability and for Formulating Policy Directed at Improving Student Outcomes

  • How to Incorporate Decision Making Frameworks to Enhance General Educator Planning

  • How to Use Progress Monitoring to Identify Nonresponders Within a Response-to-Intervention Framework to Identify Disability


Slide139 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

  • No Child Left Behind requires all schools to show Adequate Yearly Progress (AYP) toward a proficiency goal.

  • Schools must determine measure(s) for AYP evaluation and the criterion for deeming an individual student “proficient.”

  • CBM can be used to fulfill the AYP evaluation in math.


Slide140 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

  • Using Math CBM:

    • Schools can assess students to identify the number of initial students who meet benchmarks (initial proficiency).

    • The discrepancy between initial proficiency and universal proficiency is calculated.


Slide141 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

  • The discrepancy is divided by the number of years before the 2013–2014 deadline.

  • This calculation provides the number of additional students who must meet benchmarks each year.


Slide142 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

  • Advantages of using CBM for AYP:

    • Measures are simple and easy to administer.

    • Training is quick and reliable.

    • Entire student body can be measured efficiently and frequently.

    • Routine testing allows schools to track progress during school year.


Slide143 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

Across-Year School Progress


Slide144 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

Within-Year School Progress

(281)


Slide145 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

Within-Year Teacher Progress


Slide146 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

Within-Year Special Education Progress


Slide147 l.jpg

How to Use Curriculum-Based Measurement Data to Accomplish Teacher and School Accountability for Formulating Policy Directed at Improving School Outcomes

Within-Year Student Progress


Slide148 l.jpg

How to Incorporate Decision-Making Frameworks to Enhance General Educator Planning

  • CBM reports prepared by computer can provide the teacher with information about the class:

    • Student CBM raw scores

    • Graphs of the low-, middle-, and high-performing students

    • CBM score averages

    • List of students who may need additional intervention





Slide152 l.jpg

How to Use Progress Monitoring to Identify Non-Responders Within a Response-to-Intervention Framework to Identify Disability

  • Traditional assessment for identifying students with learning disabilities relies on intelligence and achievement tests.

  • Alternative framework is conceptualized as nonresponsiveness to otherwise effective instruction.

  • Dual-discrepancy:

    • Student performs below level of classmates.

    • Student’s learning rate is below that of their classmates.


Slide153 l.jpg

How to Use Progress Monitoring to Identify Non-Responders Within a Response-to-Intervention Framework to Identify Disability

  • All students do not achieve the same degree of math competence.

  • Just because math growth is low, the student doesn’t automatically receive special education services.

  • If the learning rate is similar to that of the other students, the student is profiting from the regular education environment.


Slide154 l.jpg

How to Use Progress Monitoring to Identify Non-Responders Within a Response-to-Intervention Framework to Identify Disability

  • If a low-performing student is not demonstrating growth where other students are thriving, special intervention should be considered.

  • Alternative instructional methods must be tested to address the mismatch between the student’s learning requirements and the requirements in a conventional instructional program.


Slide155 l.jpg

Case Study 1: Alexis Within a Response-to-Intervention Framework to Identify Disability


Slide156 l.jpg

Case Study 1: Alexis Within a Response-to-Intervention Framework to Identify Disability


Slide157 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

  • Using CBM toward reading AYP:

    • A total of 378 students.

    • Initial benchmarks were met by 125 students.

    • Discrepancy between universal proficiency and initial proficiency is 253 students.

    • Discrepancy of 253 students is divided by the number of years until 2013–2014:

      • 253 ÷ 11 = 23.

    • Twenty-three students need to meet CBM benchmarks each year to demonstrate AYP.


Slide158 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

400

X

(378)

300

Meeting CBM Benchmarks

Number Students

200

100

(125)

0

2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

2013

2014

End of School Year

Across-Year School Progress


Slide159 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

X

(148)

Within-Year School Progress


Slide160 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

Ms. Main (Teacher)


Slide161 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

Mrs. Hamilton (Teacher)


Slide162 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

25

20

15

Number Students on Track to

Meet CBM Benchmarks

10

5

0

Sept

Oct

Nov

Dec

Jan

Feb

Mar

Apr

May

June

2004 School-Year Month

Special Education


Slide163 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

Cynthia Davis (Student)


Slide164 l.jpg

Case Study 2: Darby Valley Elementary Within a Response-to-Intervention Framework to Identify Disability

Dexter Wilson (Student)


Slide165 l.jpg

Case Study 3: Mrs. Smith Within a Response-to-Intervention Framework to Identify Disability


Slide166 l.jpg

Case Study 3: Mrs. Smith Within a Response-to-Intervention Framework to Identify Disability


Slide167 l.jpg

Case Study 3: Mrs. Smith Within a Response-to-Intervention Framework to Identify Disability


Slide168 l.jpg

Case Study 3: Mrs. Smith Within a Response-to-Intervention Framework to Identify Disability


Slide169 l.jpg

Case Study 4: Marcus Within a Response-to-Intervention Framework to Identify Disability


Slide170 l.jpg

Case Study 4: Marcus Within a Response-to-Intervention Framework to Identify Disability

30

25

20

15

Digits Correct in 5 Minutes

10

5

0

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

Weeks of Instruction

High-performing math students

Middle-performing math students

Low-performing math students


Slide171 l.jpg

Curriculum-Based Measurement Materials Within a Response-to-Intervention Framework to Identify Disability

  • AIMSweb/Edformation

  • Yearly ProgressProTM/McGraw-Hill

  • Monitoring Basic Skills Progress/Pro-Ed, Inc.

  • Research Institute on Progress Monitoring, University of Minnesota (OSEP Funded)

  • Vanderbilt University


Slide172 l.jpg

Curriculum-Based Measurement Resources Within a Response-to-Intervention Framework to Identify Disability

  • List on pages 31–34 of materials packet

  • Appendix B of CBM manual


ad