1 / 38

UK’s Program Review Orientation: The Role of Planning, Institutional Research & Assessment

UK’s Program Review Orientation: The Role of Planning, Institutional Research & Assessment. Mia Alexander-Snow, PhD Planning & Institutional Effectiveness Tara Rose, MPA Assessment Roger Sugarman, PhD Institutional Research . Program Review Orientation Overview.

hank
Download Presentation

UK’s Program Review Orientation: The Role of Planning, Institutional Research & Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. UK’s Program Review Orientation:The Role of Planning, Institutional Research & Assessment Mia Alexander-Snow, PhD Planning & Institutional Effectiveness Tara Rose, MPA Assessment Roger Sugarman, PhD Institutional Research

  2. Program Review Orientation Overview • Institutional Effectiveness & Assessment • Program review overview • Program review schedule & current process • Educational units participating in 2012-2013 cycle • Program review components: self study, external review, and implementation plan • How does the office of the Vice President for Institutional Effectiveness inform Periodic Program Review?

  3. What is institutional effectiveness? “The institution engages in ongoing, integrated, and institution-wide research-based planning and evaluation processes that incorporate a systematic review of programs and services that (a) results in continuing improvement and (b) demonstrates that the institution is effectively accomplishing its mission”(SACS Core Requirement 2.5).

  4. What is assessment at UK? “Assessment is used to monitor the University’s effectiveness in achieving its mission, vision, and goals. The University and its units shall demonstrate an explicit use of assessment results to facilitate resource allocation and budgeting decisions in support of their strategic plans and to ensure quality enhancement” (UK AR 1:4)

  5. What assessment activities monitor UK’s Institutional Effectiveness efforts? Strategic Planning • Identifies and prioritizes the actions the University and its units can take to help it best accomplish the University’s goals and fulfill its mission (AR 1:4)

  6. What assessment activities monitor UK’s Institutional Effectiveness efforts? Annual Progress Reporting • Dynamic process for reviewing, updating and revising strategic planning efforts over a 3-5 year period • Answers the following questions in a systematic and thorough way : • “How are we doing? ---Actual Results • “What things are working? ---Reflection and Analysis • “What needs to happen next?” ---Improvement Action

  7. What assessment activities monitor UK’s Institutional Effectiveness efforts? 6 yr Periodic Program Review : the primary vehicle for assessment of educational and administrative units and for documentation of institutional effectiveness (AR 1:4). • 254 Units participate in Program Review • 113 Administrative and Educational Support units • 18 Colleges and Schools • 95 Academic departments ( 365 Academic degree & certificate programs) • 28 Research Centers & Institutes • As of 7/24/12—reported by UK registrar’s

  8. What are the purposes of program review?

  9. The Role of the Office of Planning in Program Review

  10. What is UK’s Program Review Schedule? Schedule: http://www.uky.edu/IRPE/ie/program_review.html • Purpose: • communicate to organizational entities the full 6-yr review cycle and when units can expect to undergo program review • Goals: • provide the transparent and accurate maintenance of the review schedule for the university’s educational and administrative units; and • monitor unit progress

  11. What units are scheduled for the 2012-2013 Program Review cycle? • College of Agriculture • 2 departments (4 degree programs)/ college-wide reviews • College of Arts & Sciences • 3 Departments (10 degree programs) • College of Dentistry • College-wide/2 degree programs • College of Public Health • 1 Research Center • College of Medicine • 1 Center/12 Clinical Units & Departments

  12. What units are scheduled for the 2012-2013 Program Review cycle? • College of Agriculture • Community & Leadership Development (delayed to 2013-2014) • Merchandising, Apparel & Textiles (deferred to 2013-14) • College-wide • Horticulture

  13. What units are scheduled for the 2012-2013 Program Review cycle? • College of Arts & Sciences • Earth & Environmental Sciences • Mathematics • Sociology • Modern & Classical Language, Literature ,Culture (Delayed to 2014-2015)

  14. What units are scheduled for the 2012-2013 Program Review cycle? College of Medicine • Basic Science Departments: • Medical Sciences • Microbiology, Immunology, & Molecular Genetics (request deferral)) • Toxicology • Clinical Departments: • Internal Medicine (request deferral) • Neurology • Neurosurgery • Obstetrics & Gynecology • Ophthalmology & Visual Sciences • Pathology & Laboratory Medicine (request deferral) • Physical Medicine and Rehabilitation • Radiology (request deferral) • Center: • Center on Drug & Alcohol Research

  15. What units are scheduled for the 2012-2013 Program Review cycle? • College of Public Health • KY Injury Prevention & Research Center

  16. What are the components of UK’s program review process?

  17. What are the components of UK’s program review process?

  18. What is the focus of the External Review? • Examination of the self-study/accreditation report • Use of appropriate data collection techniques to assure objectivity; • Assessment of the validity of conclusions reached in self-study; and • Identification of additional strengths and recommendations for quality enhancement.

  19. How is the External Review conducted? • External Review Committee (comprised of members outside the unit and UK) • 6-8 Appointed Members • Appointed by Dean (educational departments and degrees) • Appointed by Provost (College-wide) • Majority Faculty (Educational Units) • 2-faculty in same discipline or college and who are external to University • 1-2 ex-officio members, appointed to support external review committee • Conducts external review, meets with unit and its leadership to discuss preliminary findings and writes report.

  20. How does Accreditation fit into the External Review Process? • Fully Accredited Programs: Accreditation Self-Study, Accreditation Review and Accreditation Report • May Substitute for: • UK’s self-study • UK’s External Review, and • UK’s External Review Committee Report • Will NOT Substitute for: • Program Review Implementation Plan • Partially Accredited Programs : Accreditation Review and Recommendation Report : • May ONLY Substitute for: • External Reviewer (s) for the UK External Review

  21. What are the components of UK’s program review process?

  22. What is the purpose of the Implementation Plan? • sets agenda for change and quality enhancement over the next 5-7 year cycle. • unit faculty, staff, and/or students under the leadership of unit head define unit agenda based on self-study and external review report/recommendations. • must be approved by unit Chief Administrative Officer (CAO). • used by unit to document future plans and resource needs for consideration in budgetary decision-making. • folded into strategic plan and annual progress reports.

  23. The Role of Assessment in Program Review

  24. What is assessment? Assessment is the process by which … “the institution identifies expected outcomes for its educational programs and its administrative and educational support services; assesses whether it achieves these outcomes; and provides evidence of improvement based on analysis of those results” (SACS Comprehensive Standard 3.3.1).

  25. Program improvement Student learning outcomes Data collection Assessment methods Timeline/ schedule Student Learning Outcomes Assessment Process Faculty achieve consensus on learning outcomes to be assessed, and map outcomes to curriculum Faculty and staff collaborate to interpret assessment data and develop strategies to improve student learning outcomes Continuous improvement cycle Faculty choose assessment methods appropriate to the outcomes, purpose of assessment, and student population Faculty and staff work together to gather formative and summative assessment data and compile for review Faculty develop timeline for gathering assessment data, both formative and summative

  26. How does the Office of Assessment inform program review?

  27. Designing a program-level Assessment Plan • Mission Statement • Assessment Oversight • Program-level Student learning outcomes • Opportunity to revise student learning outcomes • Ensure the use of Overt Verbs: Bloom’s Taxonomy • Review and re-align outcomes in accordance to university academic learning • Map Courses to Outcomes • Assessment Methods and Measures at Entry and Exit • Must include direct and indirect measures for each outcome • Which components of the outcome will be assessed and when • Be sure to include your current Program Review information

  28. Designing a program-level Assessment Plan…continued • Data Collections • When, how, what, and who • Data Analysis • Assessment cycle and annual date for analyzing data • Teaching Effectiveness – NEW • Identify measures of teaching effectiveness • Efforts to improve • Plans to evaluate students post-graduate success • Using Assessment data for continuous Improvement • Annual reporting and reflections • Appendices • Include report forms, curriculum maps, rubrics, other important materials

  29. The Role of Institutional Research in Program Review

  30. How does IR inform Program Review?

  31. What IR sources inform Program Review? Student-Related Data • Freshman Profile (ACT Scores & High School GPAs) • Headcount Enrollments (10 years) • Degrees Conferred (10 years) • Retention and Graduation Rates • Surveys • Senior • Alumni • NSSE • Campus Climate

  32. What IR sources inform Program Review? Faculty-Related Data • Course History Information (total enrolled, # of sections) • Student Credit Hours (by semester and course level) • Teacher/Course Evaluations • Instructional Faculty Salaries (by CIP code, rank and gender)

  33. What other institutional data sources inform Program Review? Other Sources • The College Profile Reports (on IR website) • The Graduate School • Annual Statistical Report • Doctoral Placement Report • GRE Report • National Research Council Report • Office of Sponsored Projects Administration • www.research.uky.edu/ospa/info/spifi.html Sources

  34. Institutional Data Sources Institutional data compiled by the UK Office of Institutional Research can be found at: www.uky.edu/IRPE/ir.html www.uky.edu/IRPE/ie/supportdata.html www.uky.edu/IRPE/colleges.html

  35. Questions?What is the Program Review Calendar? *Calendar: Purpose: • communicates steps and timeline for completing program review; and • ensures timely completion *Refer to educational unit calendar for 2012-2013 cycle: http://www.uky.edu/IRPE/ie/program_review.html

  36. Contact Information Mia Alexander-Snow Office for Planning & Institutional Effectiveness Website: http://www.uky.edu/IRPE/ie.html Tara Rose Office of Assessment Website: http://www.uky.edu/IRPE/assessment.html Roger Sugarman Office of Institutional Research Website: http://www.uky.edu/IRPE/welcome.html

More Related