1 / 36

Module VII

Module VII. Universal Scoring Rules. 2014-2015 NJ APA Teacher Training - Module VII. This PowerPoint in its entirety is for the exclusive use of New Jersey educators. All other uses of this document are forbidden without written permission from the NJDOE.

kaori
Download Presentation

Module VII

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Module VII Universal Scoring Rules 2014-2015 NJ APA Teacher Training - Module VII. This PowerPoint in its entirety is for the exclusive use of New Jersey educators. All other uses of this document are forbidden without written permission from the NJDOE.

  2. It is a requirement that two pieces of evidence must be submitted for each APA entry. If an entry does not have at least two pieces of evidence (OR has more than four pieces of evidence) per entry, it will receive a score of zero for all dimensions. Two pieces of evidence are all that is required for APA. TheUniversal Scoring Rules and all APA Requirements must be met on two pieces of evidence in order for the entry to be scored based on the APA Scoring Rubric. Otherwise, the entry will receive a zero for all dimensions. For more information on acceptable evidence, review Module III of the training and your 2014-2015 Procedures Manual. Evidence 2014-2015 NJ APA Teacher Training - Module VII

  3. Universal Scoring Rules • The evidence must include the student’s name. • The evidence must include the complete date (month/day/year). • Verify that the dates fall within the appropriate collection period: • September 2, 2014 - November 14, 2014 for the first piece of evidence • December 8, 2014 - February 13, 2015 for the second piece of evidence • The evidence must be presented in the appropriate format. • The evidence must reflect the student’s mode of communication. • The evidence must include at least 5 items. • The evidence must show student responsesfor at least 5 items. • The evidence must assess the entire link while connecting to the essence of the CPI, standard, and strand. • Both pieces of evidence must assess the same CPI Link and skills. • The evidence must not include more than the skills contained within the CPI Link. Note: The USRs pertain to both student work samples. 2014-2015 NJ APA Teacher Training - Module VII

  4. Universal Scoring Rules Rules we have covered in earlier modules: • The evidence must include the student’s name. • The evidence must include the complete date (month/day/year). • Verify that the dates fall within the appropriate collection period: • September 2, 2014 - November 14, 2014 for the first piece of evidence • December 8, 2014 - February 13, 2015 for the second piece of evidence Note: The complete date must be written on the evidence at the time the activity is completed. No dates should be left blank, you may not put the date on at a later time, and you may not change a date in order to make it fit in to a collection period. 2014-2015 NJ APA Teacher Training - Module VII

  5. Universal Scoring Rules Rules we have covered in earlier modules: • Appropriate format • All activities must be presented in the format of a student work sample or acceptable photographs that meet evidence requirements. • Acceptable photographs include a series of captioned photographs evidencing the student performing the skill OR • A photograph of a student work sample that is too large or bulky to fit into a portfolio binder • If an inappropriateformat is used as evidence, the entry will be considered unscorable and will receive a zero for each dimension of the APA Scoring Rubric. Inappropriate format includes, but is not limited to: • Data charts • Photographs that do not follow the guidelines provided in Module III • True/False • Yes/No • Videotapes or DVDs • Audiotapes 2014-2015 NJ APA Teacher Training - Module VII

  6. Universal Scoring Rules (continued) Rules we will cover now: The evidence must reflect the student’s mode of communication. The evidence must include at least 5 items. The evidence must show student responses for at least 5 items.. The evidence must assess the entire link while connecting to the essence of the CPI, standard, and strand. Both pieces of evidence must assess the same CPI Link and skills. The evidence must not include more than the skills contained within the CPI Link. 2014-2015 NJ APA Teacher Training - Module VII

  7. Rule 4: Mode of Communication • Mode of Communication: means by which  a student accesses, comprehends, and responds to information that is being communicated; may involve specialized aids, supports, and assistive technology. • All activities must be presented in a format that allows the student to review each item and his/her answer, even when photographs or scribing are used to document the assessment. • This means that the student’s mode of communication must be used for each activity • for example, if the student uses tactile cues to communicate, then the activities used to assess the student must be presented with tactile cues. 2014-2015 NJ APA Teacher Training - Module VII

  8. Mode of Communication 5.9.8B1 Far Link: Identify various objects in our solar system - must include more than the planets* The student’s mode of communication must be used for each activity. • The student is asked to identify various objects in the solar system. • Because this student is visually impaired, the activity is presented to him in braille and with tactiles from which to choose his responses. + v + I 2014-2015 NJ APA Teacher Training - Module VII

  9. Rule 5: Five Items 2014-2015 NJ APA Teacher Training - Module VII An activity submitted as evidence must include at least 5 test items. • For example: • A student will classify 5 (or more) animals as either herbivore, omnivore, or carnivore, making sure each type is identified at least one time. • A student will identify 5 (or more) parts of the circulatory system. • A student will identify at least 3 examples of earth’s rotation, and at least 2 examples of the earth’s revolution (or vice versa).

  10. Rule 5: Five Items • The Five Items Resource found within the Content Guide and Five Items Resource document was created to provide teachers with examples of what constitutes five items for certain CPI Links where it may not be apparent. • This resource can be found on the Questar website at • https://nj-servicepoint.questarai.com • CPI Links for which examples are included in the Five Items document are denoted with an asterisk at the end of the link statement. 2014-2015 NJ APA Teacher Training - Module VII

  11. Five Items - “And” Many links include more than one skill. When a link says “and,” both/all parts of the link need to be assessedin the evidence. • Pay attention to the verbs • e.g., 5.7.8B4 Matched Link – “Compare and contrast light absorption on two different objects*” • Compare and Contrast –The student might compare and contrast by providing 3 similarities and 2 differences between the objects, or any combination to make a total of 5 items. • Pay attention to the verbs • e.g., 5.5.12B1Matched Link– “Identify reasons for species extinction and provide examples*” • Identify and Provide- Both must be evidenced 5 times in each activity since the link is asking the student perform two different things. 2014-2015 NJ APA Teacher Training - Module VII

  12. Five Items - “And” • 5.9.8B1Matched Link: Compare and contrast the physical aspects of the Earth to other objects in our solar system* This example constitutes five items. Each question pertains to a similarity or a difference between Earth and another planet or object in our solar system. 2014-2015 NJ APA Teacher Training - Module VII

  13. Rule 5: Five Items 5.5.12B1 Matched Link: Identify reasons for species extinction and provide examples* Non- Example of 5 Items Example of 5 Items 2014-2015 NJ APA Teacher Training - Module VII

  14. Five Items - “And” Many links include more than one skill. When a link says “and,” both/all parts of the link need to be assessedin the evidence. • Pay attention to the nouns, too • e.g., 5.5.4A1 Far– “Identify predators and prey*” • There is only 1 verb in this link: IDENTIFY, but there are 2 nouns—PREDATORS and PREY. • Predators and Prey - Both must be evidenced across the five items in each activity since the conjunction was AND. 2014-2015 NJ APA Teacher Training - Module VII

  15. Example of Five Items - “And” When the Link has an “and” in it, 5 items are required acrossthe skills rather than 5 items for each part of the link. • For instance, 5.5.4A1 Far Link: Identify predators AND prey* • In this example, identifying 2 predators and 3 prey meets the 5 item requirement. 2014-2015 NJ APA Teacher Training - Module VII

  16. Example of Five Items- “And” When the Link has an “and” in it, 5 items across the skills are required rather than 5 items for each part of the Link. • For instance, 5.9.4A2 Near Link: Identify new moon, first quarter moon, full moon, and last quarter moon and arrange in order* • In this example, identifying the four phases is considered four items; putting the phases into the correct order is the fifth item. This meets the 5 item requirement. 2014-2015 NJ APA Teacher Training - Module VII

  17. Five Items Problem: Not Five Items There must be enough items to assess the skill with a balance of right/wrong options. In this example, only 3 of the 10 examples are chemical reactions. As such, there are not 5 items. Not Five Student Responses There are only 3 student responses. Choosing not to mark an item is not considered a response. 5.6.8B1 Far Link: Identify examples of a chemical reaction* Directions: Using a highlighter, identify examples of a chemical reaction. WARNING: Evidence like this will receive zero scores for all dimensions! 2014-2015 NJ APA Teacher Training - Module VII

  18. Five Items Five Items In this example, 6 of the 10 examples represent a chemical reaction, thus providing a representative balance of right to wrong options. Five Student Responses There are 10 student responses on this evidence. The student highlighted the 6 reactions AND marked the other reactions with an “X” for a total of 10 responses demonstrating the student’s knowledge of what makes a chemical reaction. 5.6.8B1 Far Link: Identify examples of a chemical reaction* Directions: Using a highlighter, identify examples of a chemical reaction. Draw an “X” through the others 2014-2015 NJ APA Teacher Training - Module VII

  19. Rule 6: Evidence of Student Responses • The student’s responses must be evident on a minimum of five items. • It is unacceptable for items to be left blank or marked “don’t know” or “no response.” • If the student makes random marks that show no indication of actual responses to the items on the activity, then the student’s responses are not evident, and that is unacceptable. • Student responses must clearly show an attempt to provide a response to the test items. • Be sure that all supports are in place so that the student has • an appropriate way to access materials and activities. • an appropriate way to communicate a response. • If needed, the student should be provided systematic prompting to elicit a response appropriate to the skill or concept. 2014-2015 NJ APA Teacher Training - Module VII

  20. Rule 6: Evidence of Student Responses Non-Example 5.9.8B1 Far Link Identify various objects in our solar system–must include more than planets* Problem: Not Five Student Responses Marking all items incorrect because the student failed to complete them or did not know the answers is not acceptable. There must be a minimum of 5 student responses for the evidence to be scorable. 2014-2015 NJ APA Teacher Training - Module VII

  21. Rule 6: Evidence of Student Responses Non-Example 5.8.4B2 Near Link: Label the steps of the water cycle (precipitation, surface runoff, evaporation, condensation)* Problem: Student Responses are Unclear The student made what appears to be random marks that show no indication of actual responses to the items on the activity. There must be a minimum of 5 readable student responses for the evidence to be scorable. See Content Guide for what constitutes five items for this specific link. 2014-2015 NJ APA Teacher Training - Module VII

  22. Rule 7: Assessing the Link: Connecting to the Essence In order to score an entry, the evidence must reflect the content, concepts, and skills of the Standard, Strand, CPI, and the entire CPI Link being assessed. Anytime you are unsure whether the evidence connects to the essence of the Standard, Strand, CPI, and CPI Link, refer to the following resources: • Content Guide and Five Items Resource documents • Standards Clarification Project • General Education Teachers • District Curriculum Personnel 2014-2015 NJ APA Teacher Training - Module VII

  23. Rule 7: Connecting to the Essence Standard: 5.5Characteristics of Life CPI: 5.5.8B1 Essence: Compare and contrast organisms using both internal and external characteristics Matched Link: Using internal and external characteristics, compare and contrast two or more organisms between two kingdoms Non-Example Example 2014-2015 NJ APA Teacher Training - Module VII

  24. Rule 8: Assess the Same CPI Link and Skills • Both pieces of evidence must assess the same CPI Link. • If two different Links/skills are assessed, the entry will receive a score of zero for all dimensions. 2014-2015 NJ APA Teacher Training - Module VII

  25. Rule 8: Assess the Same CPI Link and Skills 5.9.4A2 Far Link “Identify sun, Earth, new moon, first quarter moon, full moon, and last quarter moon*” Non-Example Assesses the link- Identify sun, Earth, new moon, first quarter moon, full moon, and last quarter moon* (Far Link) Assesses a different link- Identify new moon, first quarter moon, full moon and last quarter moon and arrange in order* (Near Link) 25 2014-2015 NJ APA Teacher Training - Module VII

  26. “Or” – Object of the Skill • Pay attention to skills that require the student to categorize or compare (e.g., links including verbs such as sort/match/ classify, etc.). • For example, 5.7.8B3 Near Link – “Classify objects as insulators or conductors of heat - both insulators and conductors must be represented*” • There is only one verb in this link: CLASSIFY. • The “or” is between the nouns INSULATORS and CONDUCTORS. These are the two classification systems that must be used when sorting objects. • The evidence mustshow the student having classified objects as insulators or conductors of heat. 2014-2015 NJ APA Teacher Training - Module VII

  27. Rule 8: Assess the Same CPI Link and Skills Initial evidence assesses just two categories: herbivores and carnivores. 5.5.4A1 Near Link: Classify organisms by whether they are herbivores, omnivores, or carnivores* Non-Example Final evidence assesses all three categories, as it should. Although the link specifies “or,” both activities must assess all three categories. 27 2014-2015 NJ APA Teacher Training - Module VII

  28. Rule 8: Assess the Same CPI Link and Skills 5.5.12A2 Far Link: Identify the structure and function of plant cells* Assessing different parts of the CPI Link Non-Example The final evidence assesses only identifying the function of the organelle (a different part of the link). • The initial evidence assess only identifying the structure of a plant cell (part of the link). Because each piece assessed a different part of the link, the entry will receive a score of “0” for all dimensions. 2014-2015 NJ APA Teacher Training - Module VII

  29. Rule 9: Must not include more than the skills contained within the CPI Link. • In order to score an entry, the evidence must reflect ONLY those skills contained in the CPI Link being assessed. • Skills assessed must reflect the content and concepts of the CPI, strand and standard, but not go beyond the complexity or difficulty level of the CPI Link assessed. • If the evidence assesses more than the skills contained in the Link, the entry will receive a score of zero for all dimensions. 2014-2015 NJ APA Teacher Training - Module VII

  30. Rule 9: Do Not Assess More Than the Link Non-Example 5.9.8B1 Far Link: Identify various objects in our solar system - must include more than planets* 2014-2015 NJ APA Teacher Training - Module VII

  31. Acceptable Phases of the Moon CPI 5.9.4A2: Recognize and describe the phases of the moon Essence of the CPI: Identify the basic pattern of the moon’s appearance and classify as new, first quarter, full, or last quarter. CPI 5.9.4A2 Near Link: Identify new moon, first quarter moon, full moon, and last quarter moon and arrange in order* When assessing phases of the moon, only use the following four phases: New Moon, First Quarter Moon, Full Moon and Last Quarter Moon. The 2004 Science Standards require that only the these four phases of the moon be assessed for CPI 5.9.4A2 2014-2015 NJ APA Teacher Training - Module VII

  32. Rule 9: Do Not Assess More Than the Link Example 5.5.12B1 Far Link: Given an extinct species, identify the reason for its extinction* Not Scored The activity required the student to identify both “endangered” and “extinct” species as part of a classroom lesson. However, because the CPI Link used for assessment only mentions extinct species, the teacher only scored the items that reflected “extinct” species. Since the teacher did not include the items about “endangered” species in the APA scores, this an acceptable piece of evidence. Extinct Species Scored 2014-2015 NJ APA Teacher Training - Module VII

  33. Review Information needed to answer these questions is found throughout Module VII of the training. You may go back to any part of the training or to the 2014-2015 Procedures Manual to find the answers. You should not continue with the training until you can answer all of these questions correctly. 2014-2015 NJ APA Teacher Training - Module VII

  34. Review • Is it acceptable for an activity to assess more than 5 items? • What does it mean to connect to the Essence of the CPI? • Is “September 12” a complete date? • If a link requires identifying the structure and function of plant cells, can you assess the plant cell’s structure in the initial evidence and the plant cell’s functions in the final evidence? 2014-2015 NJ APA Teacher Training - Module VII

  35. 5. Does this piece of evidence address the Essence of 5.9.4A1? Standard: Astronomy and Space Science Strand: A Earth, Moon and Sun System CPI: Observe patterns that result from the Earth’s position relative to the sun and rotation of Earth on its axis Essence: Understand the reasons for day, night, and year Far Link: Identify daytime and nighttime based on Earth’s rotation in relation to the sun* Activity description for final evidence: “Kahil was given a worksheet with five pictures of Earth. He then had to identify daytime and nighttime by labeling.” 2014-2015 NJ APA Teacher Training - Module VII

  36. Review Module VII Answers • Yes, as long as there are at least 5 items. • The CPI Link cannot be addressed in isolation. It is necessary to review the Standard, Strand, CPI, and Essence to ensure the Link is leading toward understanding of the CPI. • No. A complete date includes month, day, and year. • No. The full link must be assessed in both pieces of evidence. • Yes. It identifies daytime and nighttime based upon Earth’s rotation and its relation to the sun. 2014-2015 NJ APA Teacher Training - Module VII

More Related