Introduction of research and development project evaluation system at nedo
This presentation is the property of its rightful owner.
Sponsored Links
1 / 23

Introduction of Research and Development Project Evaluation System at NEDO PowerPoint PPT Presentation


  • 120 Views
  • Uploaded on
  • Presentation posted in: General

Introduction of Research and Development Project Evaluation System at NEDO. 28 October 2005 CES/AEA Conference in the Sheraton Centre, Toronto. Momoko OKADA New Energy and Industrial Technology Development Organization(NEDO). -CONTENTS-. ABOUT NEDO R&D EVALUATION SYSTEM AT NEDO

Download Presentation

Introduction of Research and Development Project Evaluation System at NEDO

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Introduction of research and development project evaluation system at nedo

Introduction of Research and Development Project Evaluation System at NEDO

28 October 2005CES/AEA Conference in the Sheraton Centre, Toronto

Momoko OKADA

New Energy and Industrial Technology Development Organization(NEDO)


Contents

-CONTENTS-

  • ABOUT NEDO

  • R&D EVALUATION SYSTEM AT NEDO

    -INTERMEDIATE & EX-POST EVALUATIONS

    -FOLLOW-UP MONITORING& EVALUATIONS

  • CLOSING


About nedo

-ABOUT NEDO-

  • Establishment

    -Established in October 1980 as a semi-governmental organization under the supervision of METI.

    - Original activities :

       ・national R&D projects on new energy

    -Current activities :

    ・Support of industrial technology R&D (in 1988),

    ・Support of environmental technology R&D (in 1990), and

    ・Introduction and promotion of new energy and energy conservation

    technology( in1993).

    -NEDO became an Incorporated Administrative Agency as of October 2003 in the process of recent government reform.


About nedo1

-ABOUT NEDO-

  • Mission

    -NEDO’s current missions are:

      ・Promote new energy and energy conservation technologies through R&D and subsidy programs,

    ・Conduct and support industrial technology R&D, and

    ・Enhance international cooperation concerning energy and other

    technologies.


About nedo2

Machinery System Technology Development Dept.

Environment Technology Development Dept.

Fuel Cells & Hydrogen Technology Development Dept.

New Energy Technology Development Dept.

Energy Conservation Technology Development Dept.

Coal Projects Dept., Coal Mine Subsidence Dept.

-ABOUT NEDO-

  • Organization

    Staff : approximately 1,000 Budget : US$2.1 billion (FY2005)

Headquarters

Chairman, President & Executive Directors

Auditor

General Management Depts.

General Affairs; Accounting; Assets Management; Inspection and Operational Management; and Information and Systems.

Electronic & Information Technology Development Dept.

Nanotechnology & Materials Technology Development Dept.

Policy Planning and Coordination Dept

Biotechnology & Medical Technology Development Dept.

R&D Project Evaluation Dept.

R&D Promotion Dept.

Energy and Environment Policy Dept.

International Projects Dept.


About nedo3

-ABOUT NEDO-

  • R&D support

    -R&D support is NEDO’s core activity.

    ・58% of the total budget (US$1.2 billion) is allocated for R&D activities in FY 2005.

    ・Number of NEDO’s R&D projects in FY2005 is 174.

NEDO’s R&D Technology Areas

  • - Electronics and information- Environment

  • Nanotechnology and materials- Fuel cells and hydrogen

  • Biotechnology and medical technology- New energy

  • Machinery systems- Energy conservation


About nedo4

-ABOUT NEDO-

  • Challenge for NEDO

    -Need more effective and efficient operation through:

    ・Improved services, and

    ・Flexible resource management


R d evaluation at nedo

-R&D EVALUATION AT NEDO-

  • R&D Project Management Cycle

Policy Planning and Coordination Dept.

PLAN

Board of

Executive Directors

Technology Development Depts.

SEE

DO

R&D Project Evaluation Dept.


R d evaluation at nedo1

-R&D EVALUATION AT NEDO-

  • Purposes of R&D Project Evaluations

    as an important part of the R&D project management cycle.

    -To reflect economic and social needs on R&D activities,

    -To implement R&D projects more effectively and efficiently, and

    -To improve project management system


R d evaluation at nedo2

-R&D EVALUATION AT NEDO-

  • 5 Principles of Evaluation at NEDO

Transparent -Public disclosure of evaluation results,

methods, and reflections

Explicit -Encourage discussions

Effective -Adopt an evaluation method for self-

improvement of management

Neutral -External evaluators

Efficient -Simple evaluation procedures


Introduction of research and development project evaluation system at nedo

Ex-ante

evaluation

(2004-)

At R&D theme

selection

Intermediate

evaluation

(2001-)

In the middle of project term

Ex-post

evaluation

(2001-)

1 year following

project completion

Follow-up

monitoring &

evaluation

(2004-)

For 5 years after

project completion

Project implementation

Post-project activity

-R&D EVALUATION AT NEDO-

  • R&D Project Evaluations


R d evaluation at nedo3

-R&D EVALUATION AT NEDO-

  • Intermediate & Ex-post Evaluations

    -In all procedures, 5 principles are followed

    -Each project is assessed and evaluated from the following areas :

    ・purpose and strategy,

    ・project management,

    ・R&D achievements, and

    ・prospect for practical applications and other impacts


R d evaluation at nedo4

-R&D EVALUATION AT NEDO-

  • Intermediate & Ex-post Evaluations

    - R&D Evaluation Methodology (Rating Method)

1. Each evaluator grades (A, B, C or D) for each evaluation item.

A: Excellent, B: Good, C: Acceptable, D: Not acceptable

2. An average of rating is used as an indicator.

A=3, B=2, C=1, D=0

【example】

Items for evaluation

average

ratings

1.

Purpose and strategy

2.3

A

A

B

B

B

B

2.

Project management

1.8

A

B

C

B

C

B

3.

R&D achievement

1.5

B

C

C

C

B

B

4.

Prospect for practical applications and other impacts

1.2

B

B

D

C

C

C


R d evaluation at nedo5

-R&D EVALUATION AT NEDO-

Score Results for Ex-post Evaluation in FY2004

3.0

X+Y=4

Excellent

2.5

20

3,4

8,30

14

11

15

X+Y=3

6

5,10,28

2.0

22

1

2

Good

3.0

25

13,24

12

27

26

Prospect for practical applications (Y)

18

9

17

29

7

1.5

9

2.5

21

23

1.0

2.0

16

0.5

1.5

0.0

1.0

0.0

0.5

1.0

1.5

2.0

2.5

3.0

R&D achievement (X)


R d evaluation at nedo6

SubcommitteeD

SubcommitteeB

SubcommitteeC

SubcommitteeA

Promoting Department

Evaluation Secretariat

Promotion Department

Project Participants

-R&D EVALUATION AT NEDO-

  • Intermediate & Ex-post Evaluations

Public (citizens)

Releasing of evaluation results to the public

NEDO

Reflection of evaluation results in projects, etc.

Chairman

(13 persons)

Evaluation report

R&D Project Evaluation Committee

Deliberation and approval of the evaluation report (draft)

(4-9 persons)

Preparation of evaluation report (draft)

Explanation of the project


R d evaluation at nedo7

-R&D EVALUATION AT NEDO-

  • Intermediate & Ex-post Evaluations

    -In response to evaluation results:

    • Lessons learned from ex-post evaluations may be reflected upon other on-going or new projects.

    • Intermediate evaluations may result in modification or termination of projects.

  • Responses to Intermediate Evaluation Results

(start)

*some items are overlapping: all items added up do not match the total


R d evaluation at nedo8

-R&D EVALUATION AT NEDO-

  • Follow-up Monitoring & Evaluations (since 2004)

    -Objectives of this new initiative are:

    ・To understand in what ways specifically the outcome of R&D provides benefits to the public

    ・To reflect the outcome of R&D in improvement of the management and planning function at NEDO


R d evaluation at nedo9

Post-Project Activities of Private Companies

Post-Project Activities

NEDO’s R&D Project

(3-5 years)

Practical

Applications

Commercialization

R&D

Tracked with the Follow-up Monitoring

-R&D EVALUATION AT NEDO-

  • Follow-up Monitoring & Evaluations


Introduction of research and development project evaluation system at nedo

-R&D EVALUATION AT NEDO-

  • Follow-up Monitoring & Evaluations

    -NEDO initiatives as of October 2005:

    Subjects: 56 R&D projects , 642 entities

    ・These projects subject to follow-up monitoring & evaluations have received ex-post evaluation in FY2002-2003.

    ・These entities include private companies, universities, research institutes, and public institutions.


R d evaluation at nedo10

-R&D EVALUATION AT NEDO-

  • Follow-up Monitoring & Evaluations

    • Findings:

      -64% of the above entities are currently conducting post-project activities.

      -22% of the entities have reached a stage of practical applications or commercialization of R&D achievements.

      *Detailed information is being collected from 51 entities.

    • Utilization:

      -Make suggestions for improvement

      -Document key points to R&D management as a guideline


Closing

CLOSING

・Evaluations will play an increasingly important

role in:

-Improving performance of NEDO as an Incorporated Administrative Agency, and

-Facilitating effective and efficient implementation of

R&D project managements.


Introduction of research and development project evaluation system at nedo

CLOSING

  • NEDO intends to

    • ・Review the current evaluation system

    • ・Make appropriate modifications

    • ・Propose new initiatives


Introduction of research and development project evaluation system at nedo

Thank you for your kind attention.

To be continued…


  • Login