Institute for the Promotion of Innovation
This presentation is the property of its rightful owner.
Sponsored Links
1 / 16

Institute for the Promotion of Innovation By Science and Technology in Flanders PowerPoint PPT Presentation


  • 57 Views
  • Uploaded on
  • Presentation posted in: General

Institute for the Promotion of Innovation By Science and Technology in Flanders. BEHAVIOURAL ADDITIONALITY Evaluation Beyond the Linear Innovation Model. Research and the Knowledge Based Society – Measuring the Link European Conference on good practices in research evaluation and indicators

Download Presentation

Institute for the Promotion of Innovation By Science and Technology in Flanders

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Institute for the promotion of innovation by science and technology in flanders

Institute for the Promotion of Innovation

By Science and Technology in Flanders


Behavioural additionality evaluation beyond the linear innovation model

BEHAVIOURAL ADDITIONALITYEvaluation Beyond the Linear Innovation Model

Research and the Knowledge Based Society –

Measuring the Link

European Conference on good practices in

research evaluation and indicators

Galway, May 24 th 2004

Jan Larosse, IWT-Flanders


Behavioural additionality overview

Behavioural Additionality : Overview

  • Why Behavioural Additionality?

  • R&D Subsidies in 'interactive mode'

  • BA in many dimensions

  • Traditional vs Behavioural Additionality

  • IWT practice: 'internalised' additionality

  • Challenges for evaluation methodoloy


Behavioural additionality why

Behavioural Additionality: Why?

  • 1. Need for 'systemic' evaluations

  • - Different nature of knowledge as production factor

  • - Social return=

  • (Private Return + Spillovers)*Additionality

  • Additionality: role of governments

  • Behaviour catches interaction effects in innovation system

  • 2. Need for ‘bridging’ concept:

  • Bridging different traditions of evaluation

  • Micro-foundation of systemic evaluation

  • - Theory has to catch-up on policy practice


Institute for the promotion of innovation by science and technology in flanders

I

N

N

O

V

A

T

I

O

N

S

Y

S

T

E

M

Spillovers

Sector

Cluster

Partner

home >

home >

sitemap >

sitemap >

Firms

C

L

I

E

N

T

International and local

environment

R&D

Application

Contract

Follow-up

Project

Design

Innov. Effect

Interaction

Budget

I

W

T

deze pagina is voorbehouden voor grote schema's

Criteria

Milestones

Government

Publicity

Input

Impact

Output :

Projects succeeded

Policy

Objectives.

Proces

Evaluation

Others

Research Infrastructure

Intermediaries

Framework Conditions

Complementairy Impacts

5

5

5


Institute for the promotion of innovation by science and technology in flanders

home >

home >

sitemap >

sitemap >

R&D

C

L

I

E

N

T

Application

Contract

Follow-up

Project

Design

Innov. Effect

Firms

AwarenessIntake

Criteria

Milestones

Evaluation

INTERACTION

Budget

I

W

T

Impact

Government

Input

Proces

Output Projects accomplished

Policy

Objectives

6

6

6


Institute for the promotion of innovation by science and technology in flanders

Behavioural Additionality in many dimensions

home >

sitemap >

7


Traditional additionality vs behavioural additionality

Linear model: Input Add. proxy for innovation outcome

Behaviour of applicants as 'black box‘

Allocation behaviour as sufficient theoretical foundation)

'Optimality' of allocations as reference

Non-linear model Interactivity key to innovation performance

Behaviour of applicants is focus

Different kinds of behaviour (markets, hierarchies, networks) in innovation system

‘Real world’ as reference

Traditional Additionality vs Behavioural Additionality


Traditional additionality vs behavioural additionality1

6. Focus on evalution of impact on the firm

7. Evaluation of single instruments

8. Impact assessment is main challenge

9. Problem of counterfactual analysis

(finding identical control groups)

6. Shift to evaluation of spillovers to the system

7. Evaluation of complementarity of instruments (leverage)

8. Policy learning is main challenge (improving policy design)

9. Problem of comparative analysis (similar situations, never alike)

Traditional Additionality vs Behavioural Additionality


Traditional additionality vs behavioural additionality2

10. Money transfer is central :Redistributive role of government

Additionality versus ‘crowding out’

= negative connotation

10. Interaction is central:Catalyser role of governmentAdditionality as ‘value added’= positive connotation

Traditional Additionality vs Behavioural Additionality


Institute for the promotion of innovation by science and technology in flanders

home >

sitemap >

11


Institute for the promotion of innovation by science and technology in flanders

home >

sitemap >

12


Evaluation of effectiveness with ba beyond the linear innovation model

Evaluation of Effectiveness with BA :Beyond the Linear Innovation Model

  • 1. Traditionalevaluation(linear model)

  • - Innovaton performance = mechanical result

  • (output follows input)

  • - Market failure : government can correct underinvestment by innovating firms

  • - Input additionality (proxy for output additionality)

  • 2. Systemicevaluation(interactive model)

  • - Innovation performance = result of interaction

  • (mutual adaptation)

  • - Systemic failures : government as a co-actor

  • - Behavioural additionality (micro-foundation for systemic evaluation of role government)


Evaluation of effectiveness with ba policy learning

Evaluation of Effectiveness with BA :Policy Learning

  • Is Additionality (still) a useful concept?- ‘making the difference’!- learning versus optimality

  • What adaptations are needed to evaluation methodologies?- complexity as a solution?- comparative vs counterfactual method?

  • How to use the evaluation of BA in policy learning- include behaviour of agencies!- policy mix is implied!


Evaluation of effectiveness with ba taking it further

Evaluation of Effectiveness with BA :Taking it Further

  • 1. Research Agenda

  • - Conceptual clarification

  • - Measurement as occasion for learning (not only legitimising)

  • - Comparative research as (international) policy learning

  • 2. How to organise learning

  • - Communities of practice of evaluators

  • - Communication with policy makers

  • 3. Integration in broader agenda’s

  • - Oecd-TIP / TAFTIE / EU


Institute for the promotion of innovation by science and technology in flanders

Institute for the Promotion of Innovation

By Science and Technology in Flanders

Bischoffsheimlaan 25

B-1000 Brussels

Tel.: +32 (0)2 209 09 00

Fax.: +32 (0)2 223 11 81

E-mail: [email protected]

www.iwt.be


  • Login