CREATING QUALITY ASSESSMENTS Framing Questions

1. James Greene Harlan Independent School District July, 2012 CREATING QUALITY ASSESSMENTS Framing Questions

2. FRAMING QUESTIONS • Common factor • Example or illustration • Problem/solution • Conclusion from data (e.g. trends) • Sequencing • Image-based items • Inference • Identification/recognition • Application of knowledge • Comparison/Contrast or Analogy • Premise-consequence; If…then; Cause-effect • Case or scenario • Interpretation/translation

3. Identification/Recognition Items testing recognition of specific factual details or concepts (DOK 1) Which city is the capital of Kentucky? • Frankfort • Lexington • Louisville • Owensboro

4. EXPLANATION Reading passage on reproduction of flowering plants. Using information from the article, explain what pollination is and how it happens. “Event.” Which of these is the best explanation for what happened? A) B) C) D)

5. ILLUSTRATION OR EXAMPLE James Horn used these sources in a recent book about the English at Jamestown. Which of them is a secondary source? • William Strachey. The Historie of Travell into Virginia Brittania (1612; reprinted London: 1953) • Nicholas Canny, “The Ideology of English Colonization,” William and Mary Quarterly 30 (1973) • John Smith. Map of Virginia. (1624) • Wright Haile, ed. Jamestown Narratives: Eyewitness Accounts of the Virginia Colony, the First Decade: 1607-1617 (Champlain, Va: 1998)

6. Illustration or example: Which of these is an example of a transaction cost in manufacturing and selling Choco-Bars? Purchase of the chocolate and sugar used to make them Wages paid to the workers at the factory Amount paid for materials to package the bars

7. APPLICATION OF KNOWLEDGE An election involving four candidates for mayor has been held. Which of these is the best way to show the percentage of votes each candidate received? • Circle graph • Line graph • Scatterplot • Box plot • Histogram (from NAEP)

8. APPLICATION OF KNOWLEDGE Which of these units would be the best to use to measure the length of a school building? • Millimeters • Centimeters • Meters • Kilometers (from NAEP)

9. COMPARISONS Which of these structures do plant cells have that animal cells lack? A. Ribosomes B. Mitochondria B. Chloroplasts D. Nuclei —KCCT alt. Whose religious views would have differed most from those of the other three? A. John Calvin B. John Winthrop C. William Bradford D. William Penn

10. PREMISE—CONCLUSION Evidence suggests that 3.5 billion years ago Earth’s atmosphere had almost no oxygen gas. Approximately 1.8 billion years ago the oxygen concentration is thought to have increased to 15%. Today it is 20%. What most likely happened between 3.5 and 1.8 billion years ago to increase the amount of oxygen? • The number of photosynthetic plant species increased. • The number of animal species increased. • The amount of water on Earth increased. • The amount of solar radiation reaching Earth increased. KCCT alt.

11. IF…THEN Sarah has been looking at green algae using the low-power objective lens on her microscope. If she switches the lens to high power, what will she see in the field of view? A lot more cells but in lesser detail. The same number of cells but in lesser detail. The same number of cells but in greater detail. Fewer cells but in greater detail. NAEP alt.

12. Scenario A local hamburger stand offers the following choices: ketchup mayonnaise cheese onions lettuce mustard pickles tomatoes How many different hamburger combinations can be selected by selecting one, two, all, or none of these items? A)16 B) 38 C) 66 D) 88 KCCT

13. Identifying the common factor Which issue did the Quasi-War, the Barbary Wars, and the War of 1812 have in common? • Suppressing international terrorism • Repeated violations of treaty obligations • Establishing freedom of the seas • Attempts to force the U.S. to pay bribes

14. EVALUATION Short biographical sketch of Lisa McGowan who is running for President (one paragraph) Based on the information contained in the passage, one of Lisa’s primary opponents has charged that she does not meet the Constitutional requirements to be President. Using your knowledge of the Constitution, evaluate the accuracy of this claim.

15. INTERPRETATION Using details from the essay "Twins," explain what E. B. White means when he says, "We encountered better luck than we had bargained for." • This graph depicts temperature of: • Water heated on a stove and allowed to cool • Harlan on a day in mid-July • Person with a cold • Oven while a cake is baking • —NAEP

16. EVALUATION Reading passage “----” Do you think the statements by Abigail Adams in the first paragraph are an effective way to begin the article? Explain why or why not using information from the article. —NAEP

17. EVALUATION Professor McCall has written an article on the Puritans in which he makes these assertions: • They welcomed people of diverse beliefs. • They viewed marriage as a contract with economic advantages. • They believed God was calling them to create a model society. • They respected Indians as children of God like themselves. continues on next slide

18. EVALUATION ITEM CONTINUED As we know, historians must be able to back their assertions with evidence from reliable sources. Based on this standard and your knowledge of the Puritans, what kind of job has Prof. McCall done? • Great. All his assertions can be defended. • Okay. Three of four assertions can be defended. • Questionable. The majority of assertions cannot be defended. • Poor. None of his assertions can be defended.

19. SEQUENCING What is the correct order for the levels of organization in living systems from the simplest to the most complex? (Note that not all levels of organization are included.) • Elements Ü molecules Ü cells Ü tissues Ü organs • Molecules Ü tissues Ü cells Ü organs Ü organisms • Molecules Ü elements Ü tissues Ü organs Ü organisms • Cells Ü organs Ü tissues Ü organisms Ü molecules NAEP

20. INFERENCE • Based on what happens in the story, which of these represents the most likely cause of the reader saying “figs” instead of “pigs”? • The reader needs glasses. • The reader is teasing his brother. • The reader doesn’t know how to decode words very well. • The reader is secretly wishing he had some figs to eat. (Based on students’ having read “Ant and the Three Little Figs” by Betsy Byars)

21. SOURCES OF EXAMPLES • KCCT. Taken from released items from the Kentucky Core Content Test. http://www.education.ky.gov/KDE/Instructional+Resources/Curriculum+Documents+and+Resources/Released+Test+Items/ • NAEP. Taken from the National Assessment of Educational Progress databank. http://nces.ed.gov/nationsreportcard/itmrlsx/landing.aspx • Other items original to presenter