Quality school portfolio decision support system transforming data into information
1 / 19

Quality School Portfolio Decision Support System: Transforming Data into Information - PowerPoint PPT Presentation

  • Uploaded on

Quality School Portfolio Decision Support System: Transforming Data into Information. John J. Lee Senior Researcher. UCLA Graduate School of Education & Information Studies Center for the Study of Evaluation (CSE)

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' Quality School Portfolio Decision Support System: Transforming Data into Information' - kolya

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Quality school portfolio decision support system transforming data into information

Quality School PortfolioDecision Support System:Transforming Data into Information

John J. Lee

Senior Researcher

UCLA Graduate School of Education & Information StudiesCenter for the Study of Evaluation (CSE)

National Center for Research on Evaluation, Standards, and Student Testing (CRESST)

The quality school portfolio qsp
The Quality School Portfolio (QSP)

  • Without tools to investigate and understand results, more testing will not impact educational practice

  • Software for use by educators to organize, collect, interpret, and respond to complex data

  • UCLA, OERI, Stuart, and Joyce Foundation support

Qsp goals
QSP Goals

  • Transform test and other results into usable, actionable form

  • Create coherent information structure for all members of the educational community (policymakers, administrators, teachers, and parents)

  • Encourage using information as the basis for making decisions about educational options and services

  • Raise capacity and efficacy of educators

  • Communicate findings in intuitive displays

Learning to use results qsp features
Learning to Use Results: QSP Features

  • Relies on external and internal sources of information

  • Easy access and display

  • Custom queries

  • Disaggregation

  • Report preparation

Applying qsp
Applying QSP

  • Use for school monitoring and improvement

  • For distance learning assessment reporting

  • For distributed program evaluation (LA’s BEST; Artful Learning)

  • Disaggregation

  • Individual longitudinal records


How can the school focus on particular populations?

System Groups

Custom Groups

Combo Groups

Conditional disaggregation eight filters
Conditional Disaggregation: Eight Filters

  • Hispanic +

  • Boys +

  • 9th Grade +

  • Spanish L1 +

  • Redesignated English

  • Magnet schools +

  • GPA below 2.0 +

  • Less than 2 years in the school

Resource kit functions
Resource Kit Functions

  • Clustered topics of resources

  • Selection or modification of instruments in a cluster given a description

  • Supports Acrobat Reader and Rich Text Formats

  • Customized entry of standard surveys, etc., to permit local use of evaluation data and simultaneous export of information to centralized sources

Qsp resource kit
QSP Resource Kit

  • Local data to answer local questions

  • Staff and student surveys, interview and observation protocols

  • Data entry mechanisms, e.g., student work—in process (digital portfolios)

  • Online assessments or surveys

  • Transfer into Data Manager


  • QSP Web (currently in development)

  • Data analysis from descriptive to growth projection

  • Flexible report wizard

  • Improved Web training component

User challenges
User Challenges

  • Learning to ask productive questions

  • Looking at measures over time

  • Level of technical sophistication, e.g., hierarchical models, trajectories

  • Reports appropriate to various audiences and stakeholders

Continuing research a sample of impact questions
Continuing Research: A Sample of Impact Questions

  • Who is helped? What kinds of schools, teachers, and students? How do experience, beliefs, knowledge condition impact?

  • Do administrative practices change at school, district and board levels?

  • What happens in classrooms? Is student growth affected? For how long? What kind of combination of information is needed (CRT/NRT, process)?