1 / 23

Frank Cunningham Evaluation DG INFSO European Commission

Using Network Analysis to Assess Systemic Impacts of Research 12 th November 2009 AEA Annual Conference, Orlando, USA. Frank Cunningham Evaluation DG INFSO European Commission. Main Points. - EU Framework Programme Research

blakemichael
Download Presentation

Frank Cunningham Evaluation DG INFSO European Commission

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using Network Analysis to Assess Systemic Impacts of Research 12th November 2009AEA Annual Conference, Orlando, USA Frank Cunningham Evaluation DG INFSO European Commission

  2. Main Points - EU Framework Programme Research - The needs for new appraoches to evaluation of Research - Evaluative Studies - Main Findings - March (Brainstorming) Workshop held in Brussels - Recommendations & Next Steps

  3. EU Framework Programmes evolutionComplementary instruments and wider mobilisation of resources eTEN eTEN CIP ICT Policy Support Programme eContent eContent Modinis Ambient-Assisted Living FP6 IST ICT in FP7 Art. 169 FP5 IST ACTS ESPRIT JTIs ARTEMIS (Embedded Systems) TELEMATICS ENIAC (Nano-Electronics) 3,984 m Euros + 216 m Euros 9,050 m Euros 3,625 m Euros + 200 m Euros ETPs ETPs 9 Technology Platforms in ICT … FP4 FP5 FP6 FP7 (1994-1998) (1999-2002) (2003-2006) (1999-2002)

  4. EU Framework Programme 7 and CIP • Total budget of €50.5B over 7 years (2007-13) • Information and Communication Technologies (ICT) €9.11B • Average annual EU investment in ICT-RTD of over €1.25B • EU investment about 3% of total ICT-RTD in Europe • Competitiveness and Innovation Framework Programme (CIP) - €3.625 over 7 years (2007-13) ICT-PSP ~ €700M

  5. Making the best possible use of the evaluation findings

  6. Current Evaluation and Impact Assessment Methodologies • Commission has considerable experience in evaluation and monitoring of effectiveness of EU RTD investments over the last 15 years. • Focused mainly on ‘outputs’ rather than impacts. • Focused mainly on ‘project’ level and on the ‘private-return’ to RTD participants. • Now increased attention is given to results-based assessment and macro-economic and social impacts of EU RTD.

  7. New Approaches to Evaluation of Research • Aho Report; present evaluation techniques tend to undervalue the contribution of R&D to innovation and wealth creation. • New Evaluation methodologies and tools are required to identify the systemic effects on increased R&D spending • A higher quality evidence base and more focus on ‘systemic’ effects on research-innovation-competitiveness links

  8. Knowledge is Networked • Innovation requires combining scientific, design, engineering and operational knowledge from different sources • An individual or organization rarely has all the knowledge needed for the whole process of innovation • The types of skills and knowledge of research activity is unknown at the start • The most efficient way to create knowledge is enable researchers themselves to identify what is needed, to find each other, link up, and share resources • The knowledge-creating process can be facilitated by understanding how this happens

  9. Innovation Systems and Research • Innovative firms do not innovate in isolation but in interaction with other ‘actors’ • In ‘Innovation Systems’ the links between innovation actors are crucial • Collaborative R&D and Deployment Programmes are one important way of strengthening linkages • Partnerships through collaboration networks helps to achieve ‘critical mass’ of dispersed EU R&D and Deployment resources

  10. From Linear to Open/Systemic Innovation From linear innovation RTD Deployment Progress Measurement IST-FPs Modinis eTEN eGov.nt eContent Demonstrated European Value Added. But increased potentials from further integration) To Open/Systemic innovation on Value Chains - CIP Best Use • Responding to the i2010 Challenge • Minimising risks of uptake (esp. for SMEs) • Pooling resources and technical requirements (e.g. for information space – interoperability) • Fostering inclusion and Sustainability • Creating “similarity”/”replicability” effects in Member States Progress Report RTD + = Deployment ICT PSP IST-FPs

  11. Series of Evaluative Studies • DG INFSO Evaluation Unit commissioned a series of evaluative studies to help us develop our understanding of: • The structuring effects of FP ICT networks(RAND Europe – 2004/5) • Their international reach(CESPRI – Bocconi Univ. - 2005) • The linkages between EU research and deployment and regional innovation systems(CESPRI - 2006)

  12. RTD-Innovation Linkage in EuropeObstacles Our evaluative analysis revealed two structural obstacles: • The low participation of the most innovative SMEs in the EU FP research • Poor linkage between the new knowledge and those able to exploit it at the regional level ..and that - While FP ICT RTD is highly networked , most regional and deployment innovation networks are not

  13. RTD-Innovation Linkage in EuropeOvercoming Obstacles • Regional innovation networks are considerably strengthened by links to EU ICT research networks. • The most important hubs in the regional deployment and innovation are private companies, notably SMES • A key linkage is between SMEs at regional level and Global ICT Knowledge Hubs

  14. Potential Leverages • ~ €54B on EU RTD and Deployment • ERDF Funding ~€320B (2007-13) • 20% (~€65B) spend on innovation actions • Innovation in Public Procurement • ~ 16% of European GDP - ~ €2Trillion

  15. Network Analysis Brainstorming Workshop Brussels on 5th March 2009

  16. Workshop Objectives a) ToFormulate of next steps in the development and deepening our understanding of the linkages between RTD & deployment programmes and innovation systems… ..through evaluative studies based on network analysis b) To make recommendations on how to make further contributions to capacity building in this area of evaluative analysis

  17. Questions/Issues 1 - What is the relationship between research networks and the overall innovation diffusion and deployment system? - What is the interaction between the various types of networks? (connections between network layers) • Research Networks • Deployment Networks • Policy Networks • Regional/Innovation Networks

  18. Questions/Issues 2 • How can we develop a better understanding both of linkages and the nature of ‘hubs’ (as gatekeepers, tech transfer actors, regional administration etc)? • Can ‘gatekeeper hubs’ become over-dominant? - How can the links between EU research & deployment and systems of innovation be strengthened at EU, MS and Regional Levels? - Can we identify where and how the leverage of EU research on regional innovation initiatives can be strengthened?

  19. Questions/Issues 3 Time Dimension – How do we best take into account that networks, hubs and clusters are not ‘born’ fully formed but emerge over time? ..taking into account the structural evolution and the overall innovation network and the evolution over time of regional networks Directionality of links • Links are not static, • some are symmetric and bi-directional,biare mostly bidirectional • In others knowledge flow are mainly in one direction How do we take this into consideration in our analysis?

  20. Data Requirements - Node (mainly participant) data - Programme link data (project data, incl. possibly financial) - External link data (patents, publications, institutional links)

  21. March ’09 Workshop Recommendations • Policy Impact Simulation • Monitor Networking effects over time • Knowledge Production vs Diffusion • Development of existing Network Analysis Tools

  22. Next Steps • Assessment of trends and evolution of the EU ICT Research and Deployment Landscape (Study 2009) • Significant part of the evidence base for interim evaluations of CIP and FP7 ICT Research • Continued improvements in data acquisition and archiving • Build-up of network analysis skills and tools ‘in-house’.

  23. Further Information Overview of Innovation Systems Evaluative Work • http://ec.europa.eu/dgs/information_society/evaluation/studies/index_en.htm Contact • Frank Cunningham, • Evaluation Unit, • DG INFSO • Email: frank.cunningham@ec.europa.eu • Tel + 32-2-296-8119

More Related