1 / 11

The democratisation of evaluation David Gough

The democratisation of evaluation David Gough Democratisation of Research Methods, ESRC Methods Festival, St Catherine’s College, Oxford, 10 th July 2014. EPPI-Centre Social Science Research Unit Institute of Education University of London 18 Woburn Square London WC1H 0NR

rania
Download Presentation

The democratisation of evaluation David Gough

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The democratisation of evaluation David Gough Democratisation of Research Methods, ESRC Methods Festival, St Catherine’s College, Oxford, 10th July 2014 EPPI-Centre Social Science Research Unit Institute of Education University of London 18 Woburn Square London WC1H 0NR Tel +44 (0)20 7612 6397 Fax +44 (0)20 7612 6400 Email eppi@ioe.ac.uk Web eppi.ioe.ac.uk/ The EPPI-Centre is part of the Social Science Research Unit at the Institute of Education, University of London

  2. What is democracy? A system of government by the whole population or all the eligible members of a state, typically through elected representatives Oxford Dictionaries A form of government in which all eligible citizens participate equally—either directly or indirectly through elected representatives—in the proposal, development, and creation of laws. It encompasses social, religious, cultural, ethnic and racial equality, justice, and liberty. The term originates from the Greek δημοκρατία (dēmokratía) “ rule of the people“ Wikipedia

  3. Democracy and evaluation • The evaluation of democracy – not addressed by this presentation • Being democratic about how you evaluate: • To be more productive (instrumental) • To enable those affected to be involved • Evaluation as a democratic activity / shared examination of values and data • Evaluation activity as a change agent

  4. Issues • Perspectives: • Ideology, social values, theory and priorities • Research questions and methods • Participation • Engagement • Power and control • Research questions and methods required or preferred by particular approaches to democratic evaluation (and the extent of implicit/explicit value specification )

  5. Four types of DE (J.C Greene 2006) Social values? • Democratic evaluation: engaging with participants (rather than Bureaucratic by ministries or Autocratic by universities) • Deliberative DE: explicitly democratic / ensure that engage with all including weaker groups • Participative E: partners in the construction of knowledge / equity • Critical E: critical political analysis of macro structural issues Research methods?

  6. Example 1: Systematic review • PHSE students • Their review – we were technicians • We guessed that their choice would be ‘How to prevent and stop bulling’ • It was in fact: ….. Participative E: Technical methods + user perspectives + user control

  7. Example 2:NICE Guidance • Topic for guidance from government • Consultation and stakeholder meeting • Stakeholder Guidance Advisory Group • Commission evidence and develop guidance • Explicit social values (SV) policy (e.g.cost effectiveness/equity/rigour/transparency) DE + PE ++: Deliberative process + technical methods + user power + built in SV perspectives + SV of process

  8. Example 3: Participative process evaluation • Cornwall (2014): IDS Working Paper 2014: 437 To understand the dynamics of change in a nutrition education programme in Kenya • Stakeholder analysis: roles & relationships • Expectations and experiences of the prog. • Analysis by probing +ve and –ve experiences with stakeholders PE of process + exploratory + critique of ‘technocratic evaluation methods

  9. Components of evaluation Not just questions and methods. Also: • Perspectives • Participation • Power and control • Other implicit or explicit values Democracy in research involves all of these. Democratic values suggest that they should therefore all be explicit transparent methods and part of evaluation standards

  10. Thank you for your attention Websites EPPI-Centre Website http://eppi.ioe.ac.uk EIPPEE Website: http://www.eippee.eu Evidence and Policy: http://www.policypress.co.uk/journals_eap.asp Twitter @EPPICentre @ProfDavidGough @EIPPEEnet Email d.gough@ioe.ac.uk EPPI-Centre Social Science Research Unit Institute of Education University of London 18 Woburn Square London WC1H 0NR Tel +44 (0)20 7612 6397 Fax +44 (0)20 7612 6400 Email eppi@ioe.ac.uk Web eppi.ioe.ac.uk/ The EPPI-Centre is part of the Social Science Research Unit at the Institute of Education, University of London

  11. An introduction to systematic reviews: Sage Publications Ltd Gough D, Oliver S, Thomas J (2013) Learning from Research: Systematic Reviews for Informing Policy Decisions: A Quick Guide. London: Alliance for Useful Evidence., Nesta. http://www.alliance4usefulevidence.org/assets/Alliance-FUE-reviews-booklet-3.pdf Gough D, Thomas J, Oliver S (2012) Clarifying differences between review designs and methods. Systematic Reviews Journal. http://www.systematicreviewsjournal.com Gough D, (2013) Meta-narrative and realist reviews: guidance, rules, publication standards and quality appraisal.BMC Medicine, 11:22 http://www.biomedcentral.com/1741-7015/11/22

More Related