Data for student success examining student work to inform instruction
Download
1 / 65

Data for Student Success Examining Student Work to Inform Instruction - PowerPoint PPT Presentation


  • 178 Views
  • Uploaded on

Data for Student Success Examining Student Work to Inform Instruction. “It is about focusing on building a culture of quality data through professional development and web based dynamic inquiries for school improvement.”. Investigating Module: Examining Student Work to Inform Instruction.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Data for Student Success Examining Student Work to Inform Instruction' - lucas


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Data for student success examining student work to inform instruction

Data for Student Success Examining Student Work to Inform Instruction

“It is about focusing on building a culture of quality data through professional development and web based dynamic inquiries for school improvement.”


Investigating module examining student work to inform instruction
Investigating Module: Examining Student Work to Inform Instruction

  • Professional Development

  • Resources to support

  • Inquiry tool to support


Module examining student work to inform instruction
Module: Examining Student Work to Inform Instruction Instruction

  • www.data4ss.org

    • Outcomes

    • Agenda

    • Work templates

    • Protocol

    • PowerPoint

  • Resources for ISDs to adapt to their audience for the module

  • Please cite Data 4SS for work used


Beyond the surface level
Beyond the Surface Level Instruction

You can’t “guarantee” what you don’t monitor

Mike Schmoker

Moving to the student level…


Activity objectives
Activity Objectives Instruction

  • This activity shows us the power of examining student work.

  • This activity allows us to hear the professional dialogue that occurs as teachers come to agreement on criteria for proficiency.

  • This activity allows us to understand teachers misconceptions and the understanding of the GLCE assessed.


Protocol
Protocol Instruction

  • Middle School – Teachers analyzing writing to a prompt

    • Segment 2

    • Segment 3


Comparative item analysis
Comparative Item Analysis Instruction

  • 6th grade

  • Reading

  • Is this GLCE assessed? If so, what has been our school performance?

  • How often is this GLCE assessed?


6 th grade reading comprehension
6 Instructionth Grade Reading Comprehension


Protocol1
Protocol Instruction

  • Middle School – Teachers analyzing writing to a prompt

    • Segment 2

    • Segment 3

  • As you watch Segment 3, take notes on the challenges faced by the teachers as they begin the protocol.


Student learning problem
Student Learning Problem Instruction

  • How could the teachers have used this information to begin the school year to impact learning?

  • What questions do you have about the student learning problem, and what data will answer those questions?

  • Defining the learner-centered problem shifts away from the blame game.


6 th grade reading comprehension1
6 Instructionth Grade Reading Comprehension


Student achievement
Student Achievement Instruction

  • Schmoker cites in Results Now

    • Instruction itself has the largest influence on achievement.

    • The two things that matter most: What is being taught and how well.

    • Regardless of what a state policy or district curriculum spells out, the classroom teacher decides…what topics to cover.” (Manzo, 2003)


Student work
Student Work Instruction

  • Examining student work is about teachers looking at individual student demonstration of learning – evaluating, determining instructional needs, planning for instruction, teaching to the objective determined as the next step in student learning

    • Student oral responses

    • Student writing

    • Student test results – answers to questions, multiple choice, short answers

    • Student performance


What do our students know and what are they able to do
What Do Our Students Know And What Are They Able To Do? Instruction

  • What do our students know?

  • What is the next instructional need?

    • Based on student work, what is their next step in learning? What is the learning challenge?

  • Define the learner-centered problem – the problem or challenge in a student’s understanding or skills that interferes with the student’s performance

  • Focus must be on the learning


Moving towards knowing the learner
Moving Towards Knowing the Learner Instruction

  • Analyzing student responses

    • Understand

      • a student’s response is the end product of his/her thinking

      • there is a logic to the thinking process that the student used

  • Need to answer questions such as:

    • Do students have any skills or knowledge to build on?

    • Do we need a total reteaching of a content?

    • Are students lacking skills and/or content knowledge?

    • Is the design of the assessment itself an issue?


Examining student work
Examining Student Work Instruction

  • Examining student work

    • Neutral, observable data

    • Challenges assumptions

    • Helps build common understanding of knowledge and skills students need

    • Leads to discussions of work quality

      • What are we considering proficient?

    • Supports a culture of improvement


Examining student work protocol
Examining Student Work Protocol Instruction

  • Resource book – Section 4

  • Mathematics – Grade 6 MEAP Fall 2005

  • What are we asking students to do? What is the mathematics behind the task?

    • Do the problem

    • Make a list of the skills/concepts/understandings


Examining student work protocol continued
Examining Student Work Protocol continued Instruction

  • What would a proficient student need to do to be successful?

    • Make a list of the criteria for success

    • Prioritize the list – What is critical for the student to have in place to be proficient?


Examining student work protocol continued1
Examining Student Work Protocol continued Instruction

  • Examine the student work samples against the prioritized list

  • Sort into two piles – proficient, not proficient


Examining student work protocol continued2
Examining Student Work Protocol continued Instruction

  • What are the strengths of the proficient students?

  • What are the challenges of the non-proficient students?


Examining student work protocol continued3
Examining Student Work Protocol continued Instruction

Based on this information –

  • What students need additional support?

  • What are the next learning steps for these students in the next 3-6 weeks?


Examining student work protocol continued4
Examining Student Work Protocol continued Instruction

  • How will you group them?

  • What resource will you use? How will you provide instruction?

  • How will you know they have learned it? What evidence will you collect? When?


Examining student work protocol continued5
Examining Student Work Protocol continued Instruction

  • For those students that are proficient, what are the next learning steps in the next 3-6 weeks?

  • How will you group them?

  • What resource will you use? How will you provide instruction?


Examining student work protocol continued6
Examining Student Work Protocol continued Instruction

  • How will you know they have learned it? What evidence will you collect? When?


Examining student work protocol1
Examining Student Work Protocol Instruction

  • Knowing your LEAs, is examining student work to this level common practice?

  • How would using this protocol on a regular basis impact student achievement?


  • We have been looking from a teacher’s point of view with the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • What would need to be in place to develop this culture, if we know that results happen at the student level?


Building the culture to examine student work
Building the Culture to Examine Student Work the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • What are the systemic pieces needed in a school to measure student progress over time? What needs to occur?

    • Decisions are made to collect data.

    • Assessments are developed and given.

    • Data is collected in some format and provided by teachers.

    • Data is analyzed and used to make instructional decisions by teachers.

    • Data and student samples are discussed by grade level teams and administrators.

    • Student work is used to determine proficiency and the next learning steps.


A principal s data journey an evolution
A Principal’s Data Journey - An Evolution the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Decision made three years ago to collect data in comprehension – retelling

  • Assessment given and data collected

  • Discoveries

    • Unable to determine what the data was measuring.

    • Conversations with teachers revealed misconceptions about the assessment, what it measured, and how it impacted student learning.


Activity objective
Activity Objective the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • This activity is designed to support administrators to shift from data collection to data analysis.

  • This activity is designed to provide a scaffold to begin data discussions.

  • This activity will enable schools to shift the emphasis from data collection to data analysis.


Data conference strategy
Data Conference - Strategy the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • What process needs to be in place to begin the monitoring of student work?

  • Scaffold for school leaders to begin to monitor for student learning

  • Resource book – Section 4


Scenario
Scenario the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • In 06/07 the District Curriculum Coordinator mandated a requirement for a comprehension assessment to be completed 3 times a year K-8. (Data Inventory)

  • Student responses were to be scored and data collected in a table format.

  • This data was sent to the Curriculum Coordinator and never seen again.


Scenario1
Scenario the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • A 08/09 A new Curriculum Coordinator has instructed principals to continue with the assessment, but expects the principal to analyze their building data as it relates to the student achievement goals.

  • Looking at the data collected, what do you do with it?

  • What process is used to begin to make sense of the data?


Retelling assessment
Retelling Assessment the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • What are we assessing? Why?

  • A Retelling –

    • Provides information on comprehension, sense of story structure, and oral language complexity

    • Provides insight on how students organize and process text as well as interpreting and comprehending text

    • Allows the reader/listener to structure responses according to personal and individual interpretations of the text


Examine the data
Examine the Data the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Process for data analysis

    • Determine proficiency

      • On a 4 point rubric 3 is proficient

      • On a 6 point rubric 4 is proficient

    • Summarize the data

      • What percent of the students are proficient?

        • 1st data collection

        • 2nd data collection

      • Change in proficiency?

    • Student work samples – available?


Examine the data continued
Examine the Data continued the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Using the Five Critical Questions of Learning

    • What is it we expect them to learn?

    • How will we teach so that they can learn?

    • How will we know when they have learned it?

    • How will we respond when they do not learn?

    • How will we respond when they already know it?


Keep in mind
Keep in mind… the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • The quality of the learning information is dependent upon the quality of the assessment data gathered.

  • The teacher needs to see the link between the usefulness of the data being gathered and the learning information about the student it will provide.


Instruction for learning
Instruction for Learning the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • It is what the teacher knows and understands about how the quality of the assessment data determines the quality of learning instruction that occurs in the classroom


Planning the data conference
Planning the Data Conference the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Using PD resource – Planning A Data Conference and the Five Critical Questions for Learning – plan for the discussion

    • As a team using the resources

    • Plan individually how you would lead the discussion

  • Role play discussion

    • Principal

    • Teacher C – Mr. Dean

    • Teacher A – Mrs. Smith


Data conference follow up
Data Conference Follow-Up the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • As the principal, what are your next steps?

  • As the teacher, what are your next steps?

  • What will you see/hear in your classroom if students are learning?

  • How will you know? What evidence will you collect?


What is evidence
What is evidence? the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Initial data conference will set the stage

  • Set expectations

    • Data to be collected

      • What are we assessing?

    • Data to be analyzed

      • What is the data telling us?

    • Evidence to bring

      • Student work is the vehicle


Student work a vehicle for learning
Student Work – A Vehicle for Learning the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

“Teachers have lately been required to conduct exhaustive, student-by-student reading assessments that can take days to conduct. But few are told how to use their results. We never encountered a single case where teachers used these assessment results to adjust or improve instruction; they used them to group or regroup students.” – Mike Schmoker


Protocol2
Protocol the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Elementary – Third grade teachers analyzing student work – retelling

    • Segment 2

    • Segment 3

    • Segment 4

  • Middle School – Teachers analyzing writing to a prompt

    • Segment 2

    • Segment 3


Summative versus formative
Summative versus Formative the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Summative – Assessment of learning

Formative - Assessment for learning

How does this apply to a classroom?


Application to our leas
Application to our LEAs the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

What do administrators and leadership teams need to know and be able to do as a result of this module?

Where are your LEAs in this first step of data analysis?

Think about what you will need to put in place to support them.


Starting with the end in mind
Starting With the End in Mind the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • What is the non-negotiable by which we are measured?

  • What do we currently have that will support our understandings of what is being measured?

  • Can teachers unpack the knowledge and skills required by the state assessment?


Creating a culture of quality data
Creating a Culture of Quality Data the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

The most promising strategy for sustained, substantive school improvement is developing the ability for school personnel to function as professional learning communities.

DuFour and Eaker, 1998


In highly effective plcs
In Highly Effective PLCs… the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Teams of teachers evaluate the effectiveness of instruction and curriculum by establishing student achievement goals. Teacher teams discuss previous years’ trend data and examine specific areas of program weakness. Achievement goals can focus on reducing failure rates, increasing access to rigorous curricula, increasing the percent of students attending college, and improving student performance on district and state exams.


What is a plc
What is a PLC? the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Professional

Learning

Community


Components of a plc
Components of a PLC the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Shared mission, vision and values

Collective inquiry

Collaborative teams

Action orientation and experimentation

Continuous improvement

Results-oriented


The driving engine of a plc
The driving engine of a PLC… the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Is the collaborative team,on which members work interdependentlyto achieve a common goal for which each team member is mutually accountable.


Why plcs
Why PLCs? the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Because we must change…

Every enterprise has to become a learning institution and a teaching institution. Organizations that build in continuous learning in jobs will dominate the twenty-first century. Drucker


Why plcs1
Why PLCs? the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Because we must change…

  • You cannot have students as continuous learners and effective collaborators, without teachers having the same characteristics.

    -Fullan


Continuum of community function
Continuum of Community Function the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

Toxic Laissez-faire Congenial Collaborative Accountable

Toxic – All about the teacher, adults not nice to one another or to the students

Laissez-faire – Teacher centered, autonomous, individual contractors

Congenial – Counterfeit, confuse niceness w/collaborative, focus not on kids

Collaborative – Have structures and skills in working together for improved student achievement

Accountable – Able to acknowledge and deal with difficult data effectively;

Move beyond familiar solutions and approaches; Let go of instructional practices that do not work; Call one another on unmet expectations or violated norms. Source: Skillful Leader II, Warnock presentation


Change is difficult
CHANGE is the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.difficult…

Those who undertake a 2nd Order Change - such as transforming their schools into Professional Learning Communities must realize that change is difficult but not impossible. Anxiety, discomfort and conflict will accompany 2nd Order Change initiatives.


Change the new constant
Change – The New Constant the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Leadership traits can positively AND negatively effect achievement (for students and organizations)

  • Second Order Change is the only transformational change


1 st and 2 nd order change

First Order Change the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.:

Extension of past

Within existing paradigms

Consistent w/ current norms, values

Incremental

Linear

Implemented w/ current knowledge, skills

Implemented by experts

Second Order Change:

Break w/ past

Outside existing paradigms

Conflicts w/ current norms, values

Complex

Non-linear

Requires new knowledge, skills

Implemented by stakeholders

1st and 2nd Order Change


Balanced leadership research
Balanced Leadership Research the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • McREL’s work (69 studies/research) has determined there are

    • 11 critical leadership responsibilities when leading 2nd Order change

  • As these responsibilities were analyzed

    • 7 positively correlate

    • 4 negatively correlate


Positive correlates to 2 nd order change
Positive Correlates to 2 the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.nd Order Change


Negative correlates to 2 nd order change
Negative Correlates to 2 the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.nd Order Change


Complex change
Complex Change… the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Requires leadership greater than one person can provide. Distributed leadership maximizes the collective strengths of individuals in a coherent, adaptive, and sustainable organization. It requires individuals to assume responsibility, take action, learn and grow for the benefit of the whole.


Managing complex change source ambrose adapted from villa and thousand 1995
Managing Complex Change the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.Source: Ambrose, Adapted from Villa and Thousand (1995)


8 common mistakes
8 Common Mistakes the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

  • Allowing too much complacency

    • Establish a sense of urgency

  • Failing to create powerful guiding coalition

    • Create guiding coalition

    • ID critical number of champions re: change process

  • Underestimating the power of vision

    • Vision = direction, alignment, inspiration

    • Without direction, individuals “do their own thing”

    • Lack of direction leads to “permission” or “debate”


  • 8 common mistakes1
    8 Common Mistakes the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

    • Under communicating the vision by a power of 10

      • 2nd Order Change requires credible and frequent communication

      • Important to communicate vision often

      • Unite leadership focused on vision

      • Action aligned to vision

  • Permitting structural, cultural obstacles to block change process

    • Confront obstacles: PD, structures, staff, policy


  • 8 common mistakes2
    8 Common Mistakes the protocol, we need to shift the work to explore what administrators can do to support faculties so that examination of student work can become part of the school culture.

    • Failing to create short-term wins

      • Build on incremental gains; avoid “long march”

      • ID goals, performance criteria, celebrate

  • Declaring victory too soon

    • Know difference between “win” and “victory”

    • Successful change must be anchored in culture

    • Celebration impetus to tackle bigger problems

  • Neglecting to anchor changes firmly in culture

    • “Change” is part of the way we do things

    • Behaviors must be rooted in social norms, shared values



  • ad