Introduction of Research and Development Project Evaluation System at NEDO. 28 October 2005 CES/AEA Conference in the Sheraton Centre, Toronto. Momoko OKADA New Energy and Industrial Technology Development Organization(NEDO). -CONTENTS-. ABOUT NEDO R&D EVALUATION SYSTEM AT NEDO
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Introduction of Research and Development Project Evaluation System at NEDO
28 October 2005CES/AEA Conference in the Sheraton Centre, Toronto
New Energy and Industrial Technology Development Organization(NEDO)
-INTERMEDIATE & EX-POST EVALUATIONS
-FOLLOW-UP MONITORING& EVALUATIONS
-Established in October 1980 as a semi-governmental organization under the supervision of METI.
- Original activities :
・national R&D projects on new energy
-Current activities :
・Support of industrial technology R&D (in 1988),
・Support of environmental technology R&D (in 1990), and
・Introduction and promotion of new energy and energy conservation
-NEDO became an Incorporated Administrative Agency as of October 2003 in the process of recent government reform.
-NEDO’s current missions are:
・Promote new energy and energy conservation technologies through R&D and subsidy programs,
・Conduct and support industrial technology R&D, and
・Enhance international cooperation concerning energy and other
Machinery System Technology Development Dept.
Environment Technology Development Dept.
Fuel Cells & Hydrogen Technology Development Dept.
New Energy Technology Development Dept.
Energy Conservation Technology Development Dept.
Coal Projects Dept., Coal Mine Subsidence Dept.
Staff : approximately 1,000 Budget : US$2.1 billion (FY2005)
Chairman, President & Executive Directors
General Management Depts.
General Affairs; Accounting; Assets Management; Inspection and Operational Management; and Information and Systems.
Electronic & Information Technology Development Dept.
Nanotechnology & Materials Technology Development Dept.
Policy Planning and Coordination Dept
Biotechnology & Medical Technology Development Dept.
R&D Project Evaluation Dept.
R&D Promotion Dept.
Energy and Environment Policy Dept.
International Projects Dept.
-R&D support is NEDO’s core activity.
・58% of the total budget (US$1.2 billion) is allocated for R&D activities in FY 2005.
・Number of NEDO’s R&D projects in FY2005 is 174.
NEDO’s R&D Technology Areas
-Need more effective and efficient operation through:
・Improved services, and
・Flexible resource management
Policy Planning and Coordination Dept.
Technology Development Depts.
R&D Project Evaluation Dept.
as an important part of the R&D project management cycle.
-To reflect economic and social needs on R&D activities,
-To implement R&D projects more effectively and efficiently, and
-To improve project management system
Transparent -Public disclosure of evaluation results,
methods, and reflections
Explicit -Encourage discussions
Effective -Adopt an evaluation method for self-
improvement of management
Neutral -External evaluators
Efficient -Simple evaluation procedures
At R&D theme
In the middle of project term
1 year following
For 5 years after
-R&D EVALUATION AT NEDO-
-In all procedures, 5 principles are followed
-Each project is assessed and evaluated from the following areas :
・purpose and strategy,
・R&D achievements, and
・prospect for practical applications and other impacts
- R&D Evaluation Methodology (Rating Method)
1. Each evaluator grades (A, B, C or D) for each evaluation item.
A: Excellent, B: Good, C: Acceptable, D: Not acceptable
2. An average of rating is used as an indicator.
A=3, B=2, C=1, D=0
Items for evaluation
Purpose and strategy
Prospect for practical applications and other impacts
Score Results for Ex-post Evaluation in FY2004
Prospect for practical applications （Ｙ）
R&D achievement (X)
Releasing of evaluation results to the public
Reflection of evaluation results in projects, etc.
R&D Project Evaluation Committee
Deliberation and approval of the evaluation report (draft)
Preparation of evaluation report (draft)
Explanation of the project
-In response to evaluation results:
*some items are overlapping: all items added up do not match the total
-Objectives of this new initiative are:
・To understand in what ways specifically the outcome of R&D provides benefits to the public
・To reflect the outcome of R&D in improvement of the management and planning function at NEDO
Post-Project Activities of Private Companies
NEDO’s R&D Project
Tracked with the Follow-up Monitoring
-R&D EVALUATION AT NEDO-
-NEDO initiatives as of October 2005:
Subjects: 56 R&D projects , 642 entities
・These projects subject to follow-up monitoring & evaluations have received ex-post evaluation in FY2002-2003.
・These entities include private companies, universities, research institutes, and public institutions.
-64% of the above entities are currently conducting post-project activities.
-22% of the entities have reached a stage of practical applications or commercialization of R&D achievements.
*Detailed information is being collected from 51 entities.
-Make suggestions for improvement
-Document key points to R&D management as a guideline
・Evaluations will play an increasingly important
-Improving performance of NEDO as an Incorporated Administrative Agency, and
-Facilitating effective and efficient implementation of
R&D project managements.
Thank you for your kind attention.
To be continued…