1 / 20

Evaluation of RD Programs: State of the Art

Jordan WREN June 2008. 2. Interest is high

herbst
Download Presentation

Evaluation of RD Programs: State of the Art

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

    1. Evaluation of R&D Programs: State of the Art Presented at Washington Research Evaluation Network - WREN Workshop June 6, 2008 Gretchen Jordan Sandia National Laboratories, USA gbjorda@sandia.gov, 505-844-9075

    2. Jordan WREN June 2008 2 Interest is high– and all over the map To name just a few – WREN OECD Workshop on Rethinking Evaluation in Science and Technology. Paris 30.10.2007 (TIP Working Group) Atlanta S&T Policy Conferences American Evaluation Association Annual Conference- RTD Evaluation Topical Interest Group (most international of the TIGs!) European RTD Evaluation Network European Court of Auditors review of Evaluation of European Union RTD Programs Investments in Health Research: Defining the Best Metrics --Canadian Academy of Health Sciences Economic returns of medical research --Swedish Research Council, Medicine NSF Science of Science and Innovation Policy grants program American Chemical Society Petroleum Research Fund

    3. Jordan WREN June 2008 3 Research Assessment in U.S.

    4. Jordan WREN June 2008 4 A glimpse of state of the art of RTD Evaluation From presentations of that Topical Interest Group at the American Evaluation Association 2007 Conference Evaluation Systems Frameworks Methods

    5. Evaluation Systems

    6. Jordan WREN June 2008 6 Evaluation in the Policy Cycle

    7. Jordan WREN June 2008 7

    9. Systemic Evaluation Frameworks

    10. Jordan WREN June 2008 10 The intellectual battle has culminated in a ‘national innovation systems’ perspective …

    11. Jordan WREN June 2008 11 All these work together…Key indicators for innovation bottlenecks/ policy objectives

    12. Jordan WREN June 2008 12 An Example of Roadmap

    13. Jordan WREN June 2008 13

    14. Methods

    15. Jordan WREN June 2008 15 Recent attempts to use peer review at a high level recognise systems complexity - and are being driven to use background studies, increasingly using innovation system and evaluation specialists

    16. Jordan WREN June 2008 16

    17. Jordan WREN June 2008 17 Historical Tracing Method Forward tracing from R&D to downstream outcomes Backward tracing from a selected outcome to upstream R&D

    18. Jordan WREN June 2008 18 Second Generation Patent Tree for US 5348822, Issued to Ovonic Battery Company in 1994

    19. Jordan WREN June 2008 19

    20. Jordan WREN June 2008 20 We can also look at integration to see how it is correlated with other measures. Doing this we see that our Integration measure has a very weak correlation with both the number of authors per paper and the number of affiliations per paper. So, working with a lot of people from different departments does not contribute very much to integration as we measure it.We can also look at integration to see how it is correlated with other measures. Doing this we see that our Integration measure has a very weak correlation with both the number of authors per paper and the number of affiliations per paper. So, working with a lot of people from different departments does not contribute very much to integration as we measure it.

    21. Jordan WREN June 2008 21 Summary and Conclusions Vision and Agenda of NSF-sponsored 2001 Workshop remain: Vision: More valuable and valued R&D assessment contributes to broad community understanding of S&T innovation systems and how they lead to and are influenced by social, technical, economic, and political development. Proposed Agenda: Better networks, more training Better data and methods Research on Innovation, Societal and Regional impacts, and Complexity of emerging research organizations Communicate Better!

More Related