1 / 38

Writing a good evaluation report

Writing a good evaluation report. Support to strengthening the higher education system in azerbaidjan. October 2019. Training session N0.2 Eliane Kotler Michelle Houppe. General Steps of Procedures. WRITING A GOOD REPORT. Writing a good report. 1 2 3.

bburgos
Download Presentation

Writing a good evaluation report

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Writing a good evaluation report • Support to strengthening the highereducation system in azerbaidjan • October 2019 • Training session N0.2 • Eliane Kotler • Michelle Houppe

  2. General Steps ofProcedures

  3. WRITING A GOOD REPORT

  4. Writing a good report 1 2 3

  5. Writing a good report • The report relies onthe SER: • to confirm ou infirm the self-analysis (double check) • assess the quality of the whole SE approach

  6. Writing a good report A - the content • The report must beuseful • Allow the evaluated program to assessits position (national environment) • Help to takedecision and manage the program Requisite: • give an appreciation about the quality of the program • rely on facts and figures (for examplewith tables in attachment) • give a clear and verifiedpicture, thanks to the visit • formulaterecommendations

  7. Writing a good report • The information gathered (SER + visit) allowsthe evaluators to: • Assess the quality of the program • Evaluateits trend, itstrajectory • Giverecommendations for the future

  8. WRITING A GOOD REPORT B - the writing

  9. Key points of the report • The report has to be objective, evidencebased, useful • Objective • No personal jugement • Evidence based • The report has to providereferences to the SER, to datas given • Useful • The recommendations have to bebased on the strengths and weaknesses. • They have to berealistic, feasable and understandable. • METHODOLOGY • Sum up your notes and compare to yourneeds • Draftyour contribution : • No personalization, no direct criticalview on a person

  10. Structure of the Report • Institution Identity Sheet • Introduction whichprecises the main features of the programme and itsposition within the institution • On-site visit description • Presentation of the institution's self-evaluation approach • Composition of the panel of experts • On-site visit description • III. Analysisof the study programme: • Programme aims and learning outcomes • Curriculum design • Teaching staff • Facilities and learning resources • Study process and students‘ performance assessment • Programme management • The strengths and the weaknesses have to behighlightedfor eachevaluation area • Recommendationshave to beprovided • IV. CONCLUSION • General Strengths, Weaknesses and Recommendations

  11. Studyprogrammeanalysis

  12. Evaluation Standards in a nutshell Key words • What do youneed to assess ? • What are youtrying to demonstrate ? • In order to evaluate if the program is: • compliant: A • mostlycompliant: B • partiallycompliant: C • non-compliant: D

  13. 1. Programme aims and learningoutcomes Key words

  14. 2. Curriculum design Keywords ECTS

  15. 3. Teaching staff Key words

  16. 4. Facilities and learningresources

  17. 5. Study process and Students’performanceassessment STUDENT SUCCESS

  18. 6. Programme management Key words

  19. Draftingscheme Key words

  20. Provisional report drafting • Each expert writes a comment about hisownfield of interview: • Not too long (length to bedefined) • Clear • Objective: evaluativebut evidence-based • Argued • The President of the committeereads the entire report (and sometimesre-writessome parts of it) • The report issigned by the President • The name and quality of the experts are precised on the report (at the beginningor at the end)

  21. Best practices • Avoid conditional sentences, deliver a clear message • Do not be too prescriptive; • Avoid using specific cultural contextual references; • Do not extend sentences across many lines.

  22. Best practices • Evaluation report should not repeat information provided in the SER: NO COPY/PASTE • Evaluation report should not be descriptive but analytical • Factual information about the study programme should be correct • Not only weaknesses but also strengths should be emphasized • Enough attention should be devoted to the conclusions • Attention to be paid about how recommendations of previous evaluation were implemented.

  23. The evaluation report drafting -1 • The report has to bethe result of a collegialanalysis. • At the end of the on-site visit, the experts have a final debriefing (3 hours) together to define the strenghts, weaknesses and recommendations. • Then, every expert candrafthis/herown part, takingintoaccountthiscollegial position

  24. The evaluation report drafting -2 -

  25. The evaluation report drafting-3 -

  26. Beginning of the report, 2 examples • 1- PRESENTATION OF THE INSTITUTION’S SELF-EVALUATION APPROACH • After the first contacts withANB staff, by …., xxxUniversity set up a dedicatedcommitteearound the Head of Education Department and the head of School of Education, in order to monitor the self-evaluation process. Five groups of staff werecreated, and 10 meetings wereheldbetweenmarch and april 2019. • The self-evaluation report, datedjune 2019, is a rather consistent document, withsomeredundancies, and somelacking information. All in all, itisratherwellorganized, and clearlywritten. It followsthe various areas and fields of the AZ externalevaluation standards framework, and addressesall criteria. However the indicatorscorresponding are not alwaysinformed. • The SWOTanalysis of eachcriteriaisuneven: somecriteria have been analysed in a deepway, others are lesscomplete.

  27. Beginning of the REPORT, 2 examples • 1- PRESENTATION OF THE INSTITUTION’S SELF-EVALUATION APPROACH • After the first contacts withANB staff, by …., xxx University set up a dedicatedcommitteearound the Head of the Department, The Deputy Dean of the Facultyand the Head of the department of Az…, in order to monitor the self-evaluation process. Seven groups of staff werecreated, and 10 meetings wereheldbetweenapril and may 2019. • The self-evaluation report, datedjune 2019, is a rather consistent document, withsomeredundancies, and somelacking information. It isneverthelesswellorganized, and clearlywritten. It followsthe various areas and fields of the AZ externalevaluation standards framework, and addresses in detail all criteria. • It reveals the excellent state of mind of the institution as regards to the process of self-evaluation, and its good understanding and awareness of the definedcriteria. The SWOTanalysis of eachcriteriaisquitecompleteand detailed, and seems to have been an opportunity for a deep self-criticalanalysis. The number of demonstrations and regulationslisted in annexisconsistent. The well-developed quality management culture of the programmeseems to be an important asset for a pertinent self-evaluationapproach.

  28. Recommendationexample: Teaching staff

  29. Recommendationexample : studentsmobility programmes

  30. Workshop – ASOIU computer Eng.Criteria 1 - Write a report about criterias: • 1.1 • 1.2/1.3 • 1.5 • 1.6

  31. How to write: 1/findings2/analysis3/recommendations • 1.1 • every information required about the teaching documents isprovided and available on the website. However the aims of the study program are not reallydescribed. • After the visit, itappearsthat… • The committeesuggests to provide a precise description of the goals of the programme and employmentopportunities for graduates, in order to informstudents and stakeholders. The best waywouldbepublicity on the website and during job fairs.

  32. How to write the report • 1.2/ 1.3 • The expectedlearningoutcomes are specified, with a lot of details. The committeewonders if all thesecompetencieswereactuallyacquired at BA level. The comparisonwith MA competencies shows … • The links with the labormarket are not specified in a convincingway. • After discussion withemployers, the committebelievesthat…

  33. How to write the report • 1.5 • The regionalcontextis not analyzed: as a consequence, the committeecannotevaluate if the learningoutcomes are on line with the development of the business activities in the area. • After meeting with the members of the Board, the committeerecommends to developperiodicalinternships and practicallessons. A final report couldbeevaluated by a mixed jury panel: teaching staff and professionaltogether.

  34. How to write the report • 1.6 • Employabilityis a real concern for the programme. However, the committeedoes not know how the career center operates in an effective way. • After the visit, … • The committeerecommends to publish job and training offers, to train students to write CV and behaveduring job interviews.

  35. Conclusion: 1. Strengths • A quite good use of the website, whichneeds to befurtherdeveloped • The competenceapproachis effective • The issue of employabilityistakenintoaccount

  36. conclusion: 2. Weaknesses • The labormarketis not sufficientlyinvolved in the program: • Design of the program • Update of the content • Internshipsopportunities • 2. The goals of the program are not defined in a practical and satisfactoryway

  37. Conclusion: 3. Recommendations • The goals of the program have to bedefined more clearly and made publiclyavailable. • An overallview of the global pictureneeds to beprovided. • The links withemployersneed to beStrenghtened: invite them to stand in the board/Council of improvment, in jury panels, or to givelessons.

More Related