1 / 15

A closer look at reviews

This seminar highlights core issues, compliance with ESG standards, distribution of scores, relevant arguments for grading, and the value added by recommendations.

smcneil
Download Presentation

A closer look at reviews

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A closer look at reviews Tove Blytt Holmen 2nd ENQA Reviewers’ Seminar, Mannheim, November 2016

  2. Core issues • A gradedscaleofcompliance • The useofrecommendations • Interpretationof standards in ESG 2015 • ESG 2.1 Considerationofinternalqualityassurance • ESG 3.1 Activities, policy and processes for qualityassurance • ESG 3.5 Resources 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  3. Judgement on compliance Compliance with each of the ESGs in Part 3 and 2 separately • Fully compliant: the agency acts entirely in accordance with the given standard, which is implemented in an effective manner. • Substantially compliant: the agency is to a large extent in accordance with the given standard, the principle / spirit of which is followed in practice. • Partially compliant: some aspects or parts of the standard are met while others are not. The interpretation of the standard is correct, but the implementation is not effective enough. • Not compliant: the agency fails to comply with the standard 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  4. Distribution of scores on compliance 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  5. Which arguments are relevant when the panel concludes on a grade? • Are all grades as easy to handle? • Why do we use fully compliant far more than partly compliant? • Are graded conclusions usable to any standard? 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  6. The ENQA touch - value added • Recommendations 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  7. Number of recommendations related to scoring 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  8. The structure of ERR on conclusions makes it easy for an external reader to move around in the different reports. • «The review panel has no particular recommendations for XXXX besides guaranteeing a coherent and consistent use of framework under which the agency is operating. … … • Recommendations and “Fully Compliant”? replace txt View menu > Header and footer

  9. The ENQA touch - value added • Recommendations • How many? 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  10. ESG 2.1 Consideration of internal quality assurance • External quality assurance should address the effectiveness of the internal quality assurance processes as addressed in Part 1 of the ESG. 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  11. ESG 2.1 Consideration of internal quality assurance • External quality assurance should address the effectiveness of the internal quality assurance processes as addressed in Part 1 of the ESG. Agency I: The review panel noted that the standards had not been amended following publication of the revised ESG. In the interviews the review panel tested the extent to which Agency I ensures the link between internal and external quality assurance through inclusion and consideration of the standards of Part 1. Whilst the panel were assured that consideration had been payed to the standards, no evidence was available … Agency II: ESG standards Part 1 are listed against the QA activities of the agency, followed by a separate analysis for each standard. Agency III: ESG standards Part 1 are listed against the national criteria. Due to national legislation, some aspects are not subjected to accreditation such as part of ESG 1.4, 1.5, 1.6 and the full 1.8 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  12. ESG 2.1 Consideration of internal quality assurance • External quality assurance should address the effectiveness of the internal quality assurance processes as addressed in Part 1 of the ESG. Agency I: The review panel noted that the standards had not been amended following publication of the revised ESG. The review panel tested the extent to which XXX ensures the link between internal and external quality assurance through inclusion and consideration of the standards of Part 1. whilst the panel were assured that consideration had been payed to the standards, no evidence was available … Recommend to undertake a comprehensive mapping – substantially compliant Agency II: ESG standards Part 1 are listed against the QA activities of the agency, followed by a separate analysis for each standard. Recommend to strengthen, encourage and pay more attention to … substantially compliant Agency III: ESG standards Part 1 are listed against the national criteria. Due to national legislation, some aspects are not subjected to accreditation such as part of ESG 1.4, 1.5, 1.6 and the full 1.8 Recommend to integrate all aspects – substantially compliant 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  13. Keep the balance! Evidence + Analysis + Conclusion 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  14. The ENQA touch - value added • Recommendations for follow-up • Commendations? 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

  15. Reviewers + Process + Report • A fascinating team of reviewers: different countries, cultures, competencies and experiences • Universal, well known standards • Agencies with quite different backgrounds 2nd Reviewers’ Seminar, 10 November 2016, Tove Blytt Holmen

More Related