1 / 18

Evaluation Misconceptions

Evaluation Misconceptions. Global Issues Problem Solving June 2010. Challenges Misconception: Must be well-written for a Yes. Fluency Keep the “spirit of brainstorming” Novice to expert are all acceptable

balin
Download Presentation

Evaluation Misconceptions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation Misconceptions Global Issues Problem Solving June 2010

  2. ChallengesMisconception: Must be well-written for a Yes Fluency • Keep the “spirit of brainstorming” • Novice to expert are all acceptable • It’s about the idea, not the writing; specific written pieces are not required; there is not one format • Must be logical cause or effect of the Future Scene, but may be inferred • Does not have to address charge or topic

  3. Novice Example People who do not live in Leabeau County may not be able to shop there.

  4. Experienced Example People who do not live in Leabeau County may not want to do their shopping there because they are not prepared for the test of the cashless society.

  5. Expert Examples Stores in Leabeau County may lose business because people who do not live in Leabeau County may not be prepared to function in a cashless society and so do their shopping elsewhere. Since all of Leabeau County is implementing the cashless society, people who do not live there may not be prepared to participate and may do their shopping elsewhere. As a result, stores in Leabeau County may lose business.

  6. ChallengesMisconception: Cause-effect requires if-then wording Clarity • Clarity is about the writing and the reasoning, NOT about the number of yeses for fluency • Telling what the problem is, why it’s a problem, and tying to the Future Scene is clarity • Logical cause-effect reasoning is clarity • A challenge by its very nature is cause-effect thinking; “if-then” is only one of many ways to express cause-effect thinking

  7. Accordingly As a result Because Consequently Due to For this reason If…then Nevertheless Since So that Therefore Thus Cause-Effect Words

  8. Underlying ProblemsMisconception: Absolute verbs should not be used Absolute Verbs • Scoring was changed in 2008 • Absolute verbs are related to focus: there should be NO impact on adequacy • There are times when an absolute verb is completely appropriate; at other times it may narrow the focus too much • Appropriateness must be considered; there is no specified point value for absolute verbs

  9. Appropriate Absolute Verb Example: For a situation involving water contamination, it would be perfectly appropriate to have a key verb phrase that says “how might we ensure safe water for the citizens…”

  10. Underlying ProblemsMisconception: Time can only be year from Future Scene Time Parameter • A variety of time parameters are acceptable; this seems to have been lost over time • Year of the Future Scene or reasonable years after that are okay (probably not 50 years in the future) • A phrase indicating time is also okay • The time parameter must then work reasonably well with the solutions

  11. Possible Time Parameters In 2042 and beyond By 2048 Before building is begun on LaunchX During the planning phase for the project

  12. Underlying ProblemsMisconception: Restatements are easy to identify. Restatements • Be careful and conservative when deciding that a UP is a restatement • It is recommended that there be agreement among multiple people that a UP is a restatement, not just the decision of a single evaluator • Agreement could be among multiple evaluators or between evaluators and evaluation director

  13. SolutionsMisconception: Solution must completely solve the UP. Relevance • Keep the “spirit of brainstorming” • Solutions must ADDRESS the key verb phrase; they do not have to completely solve it • Solutions do not need to EXPLICITLY state how the purpose is fulfilled; if it can be inferred that the purpose is not negated, it is fine • Solutions do NOT have to be humane; the action plan is evaluated for humaneness

  14. SolutionsMisconception: Elaboration equals a lot of writing. Elaboration • Elaboration is about the writing • It is not about the LENGTH of the writing, but about the elements • A logical who, a description of what will be done, and details about how it will work or why it is a good idea equal elaboration; parameters alone are not enough • Simply rewriting the key verb phrase or purpose for the details may not contribute to elaboration

  15. CriteriaMisconception: Generic vs specific is about Future Scene details Relevance • Generic versus specific criteria is about the CORE IDEAS, not about the details from the future scene • A criterion may be generic (e.g. last the longest) even if it has many future scene details • A specific idea (related to the topic; can’t be easily transferred) earns 3 points EVEN IF if it has NO details from the future scene

  16. Generic Examples WSW last the longest? (generic) WSW be most long-lasting in providing a stable environment for the orphans? (modified generic) Since many of the orphans are young and have many years before they are adults, WSW be the most long lasting? (justified generic)

  17. Specific Examples WSW be the most psychologically supportive? (specific/advanced) WSW best facilitate the adoption process? (specific/advanced) WSW best provide for basic needs?(specific/advanced)

  18. Generic/Specific Confusion WSW be most long-lasting in providing a stable environment? (modified generic) WSW provide the most stable environment for the long term? (specific/advanced)

More Related