Introduction to Data Inquiry and BPS Data Warehouse

1. Introduction to Data Inquiry and BPS Data Warehouse SY 12-13 Data Facilitators Meeting #2 Office of Research, Assessment and Evaluation

2. Introduction to DESE’s Data-Driven Inquiry and Action Cycle • BPS Data Warehouse • MCAS Reports • Leading and Lagging Indicators Agenda

3. According to DESE: • “The Cycle provides a structure that takes data use from asking the right questions to getting results. It is an iterative process in which the district [school] uses data to target and support continuous improvement….But analyzing data alone will not result in continuous improvement. Concrete actions that are grounded in evidence and continually monitored through the collection and analysis of multiple forms of data are critical to achieve improved results.”1 What is the Data-Driven Inquiry and Action Cycle? 1 District Data Team Toolkit, Module 0: Introduction to the Toolkit, p. 1, http://www.doe.mass.edu/apa/dart/lg.html, retrieved 8/8/2012.

4. What does the Data-Driven Inquiry and Action Cycle look like? As used in the DESE District Data Team Toolkit, Module 0, p. 2.

5. Getting Ready: 4 primary domains of data Adapted from: Bernhardt, V. L. (2004). Data Analysis for Continuous School Improvement. Larchmont: Eye on Education , as used in the DESE District Data Team Toolkit, Module 1, p. 14.

6. Designed for district data teams, but can be utilized within schools by shifting focus to the school level • Broken into 6 modules to guide teams through the Data-Driven Inquiry and Action Cycle • http://www.doe.mass.edu/apa/dart/lg.html DESE’s Data Team Toolkit

7. Module 1: Getting Ready http://www.doe.mass.edu/apa/ucd/ddtt/GettingReady.pdf Module 2: Inquiry http://www.doe.mass.edu/apa/ucd/ddtt/Inquiry.pdf Module 3: Information http://www.doe.mass.edu/apa/ucd/ddtt/information.pdf Module 4: Knowledge http://www.doe.mass.edu/apa/ucd/ddtt/Knowledge.pdf Module 5: Action http://www.doe.mass.edu/apa/ucd/ddtt/Action.pdf Module 6: Results http://www.doe.mass.edu/apa/ucd/ddtt/Results.pdf DESE’s Data Team Toolkit

8. How to Log In Go to bpsdepot.mybps.org • Type in your User ID and Password, and click LoginBrowser tips: • Turn off all popup blockers such as ones that come with browser, Yahoo, Google, etc. Data Warehouse: Getting Ready • Uncheck the box for Show this page in the future to bypass this screen in subsequent logins • Click My home to proceed

9. Site Layout & Navigation Home screen Your saved reports Prebuilt reports Data Warehouse: Getting Ready Save Download *Depending on access level, you may see more or less reports on your home page.

10. MCAS Reports – by Class Inquiry: How have my current and past students performed on the MCAS assessments? What areas of curriculum did they perform well on and what areas did they struggle with? Information: Results located in the MCAS Reports folder on the Home Screen Data Warehouse: Inquiry and Information

11. MCAS Reports – by Class Data Warehouse: Inquiry and Information

12. MCAS Reports – by Class Data Warehouse: Inquiry and Information

13. MCAS Reports – by Class My Elementary Data Warehouse: Inquiry and Information

14. MCAS Reports – by Class Data Warehouse: Inquiry and Information

15. Which standard areas were strongly emphasized on the test? • Which areas did my current students struggle with? • On which areas did they perform well? MCAS Reports – by Class Data Warehouse: Inquiry and Information

16. While viewing the report, Class MCAS Results With Standards (in previous slide), scroll further down to the section on Class Responses as shown below. Tip MCAS Reports – by Class & Item Inquiry: On the MCAS assessments, which questions gave my students the most difficulty? Information: Results located in the MCAS Reports folder on the Home Screen Data Warehouse: Inquiry and Information

17. MCAS Reports – by Class and Item Data Warehouse: Inquiry and Information • Every year, MA DESE only releases certain items from each MCAS subject test.

18. Which test items are associated with what standards? • Are the difficult items associated with one of the emphasized standards? • What can you learn about students’ strengths and weaknesses based on questions they answered correctly and incorrectly? Data Warehouse: Inquiry and Information

19. While viewing Class MCAS Results (in previous slide), click on a standard link to drill through. Tip MCAS Item Bank I have identified Nonfiction as an area with strong emphasis on the grade 4 MCAS ELA test. Where can I find sample questions for this standard to use with my students? Data Warehouse: Inquiry and Information

20. The questions are ordered from easiest to hardest based on State Percent Correct. • Click on a question number to pull up the question on a new screen. Tip MCAS Item Bank Data Warehouse: Inquiry and Information

21. Which test questions have the same level of difficulty as the standard you are reviewing for your class? • Are there commonalities or patterns among harder test questions? • What concepts and skills are targeted in the harder test questions? Data Warehouse: Inquiry and Information

22. MCAS Reports – by Student Inquiry: On the MCAS assessments, how have individual students performed? What areas of the curriculum are they struggling with and in what areas are they performing well? Information: Results located in the MCAS Reports folder on the Home Screen Data Warehouse: Inquiry and Information

23. My Elementary (5555) Banker, Anna [987654] 987654 Banker, Anna • SGP: Student Growth Percentile (1-99). It measures how much a student's performance has improved from one year to the next relative to his or her academic peers: other students statewide with a similar MCAS test score history. If a 4th grade student has an SGP of 42 in ELA, that means that between grades 3 and 4 he/she improved more than 42 percent of students statewide with a similar MCAS test score history. • CPI: Composite Performance Index. It is a 100-point index that assigns 100, 75, 50, 25, or 0 points to each student participating in MCAS and MCAS-Alt tests based on their performance. The average of all students’ points in a school or a group constitutes a school or student group's CPI for that subject. The CPI is a measure of the extent to which students are progressing toward proficiency (a CPI of 100) in ELA, mathematics, and science. Tip MCAS Reports – by Student Data Warehouse: Inquiry and Information

24. Tip • For best printing results, choose View in PDF Format. MCAS Reports – by Student Banker, Anna [987654] Data Warehouse: Inquiry and Information

25. MCAS Reports – by Student Data Warehouse: Inquiry and Information

26. MCAS Reports – by Student Data Warehouse: Inquiry and Information

27. How well did the student perform compared to all students in the school, the district, and the state? • In the areas of emphasis on the test, how well did the student perform? • On which areas of emphasis does the student need to improve? Data Warehouse: Inquiry and Information

28. Leading and Lagging Indicators • New interactive data inquiry tool • Provides key indicators on students enrolled in schools • School and classroom planning • Progress monitoring • Data inquiry Data Warehouse: Inquiry and Information

29. Leading and Lagging Indicators • School Level Data • Teacher Level Data • Class Level Data Data Warehouse: Inquiry and Information • Plan, monitor, analyze by specific indicator

30. Leading and Lagging Indicators: Enrollment – Home Page Data Warehouse: Inquiry and Information • Each student group is linkable to a demographic profile table of those students

31. Leading and Lagging Indicators: Off-Track History • Drill down to specific subgroups of students • Available for each indicator Data Warehouse: Inquiry and Information

32. Scavenger Hunt • Complete the Data Warehouse Scavenger Hunt using: • Class Listings by Teacher • Student MCAS Results • Leading and Lagging Indicators Data Warehouse: Scavenger Hunt

33. BPS Personnel Contact Info