1 / 39

Prof. Dr. Hsien-Chun Meng Science and Technology Information Center (STIC)

Making a Grope for an Understanding of Taiwan’s Scientific Performance through the Use of Quantified Indicators. Prof. Dr. Hsien-Chun Meng Science and Technology Information Center (STIC) National Science Council 2002/12/. Outline . Research Background Research Goals Methodology

karan
Download Presentation

Prof. Dr. Hsien-Chun Meng Science and Technology Information Center (STIC)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Making a Grope for an Understanding of Taiwan’s Scientific Performance through the Use of Quantified Indicators Prof. Dr. Hsien-Chun Meng Science and Technology Information Center (STIC) National Science Council 2002/12/

  2. Outline • Research Background • Research Goals • Methodology • Results & Discussion • Future Works • References

  3. Research Background • Insufficient bibliometric indicators to evaluate scientific research performance in Taiwan • Limited inquiry function of NSI and JCR • Lack of international comparison of the performance with benchmarking countries • STIC has aggressively involved in evaluating scientific activities

  4. Research questions… • Is Taiwan’s research performance world class? • Has the performance improved or deteriorated? • What are the relatively strong and weak fields?

  5. Research Goals • To assess the position of Taiwan’s S&T research system in an international comparative perspective • To identify relative strengths and weaknesses of scientific fields • To serve as a reference for technology policy formulation and for the future allocation of innovation resources

  6. Methodology • Methodology : Bibliometric Method • Study Scope : • Time interval : 1995~2001 • Benchmarking Country Selection : • 7 advanced countries • 4 developing countries in Eastern Asia • CWTS Classification system : • 7 broad areas 43 fields

  7. Advanced Countries United States of America Japan United Kingdom France Germany Netherlands Israel Developing Countries in Eastern Asia South Korea Peoples Republic of China Singapore Taiwan Benchmarking Country Selection

  8. CWTS Classification system

  9. CWTS Classification system

  10. Bibliometric Indicators (1) • P: Publications • An indicator of scientific productivity and specialization of a country • Cx: Citations excluding self-cited • a frequently cited paper has had a greater influence on subsequent research activities • A measure of impact of research in the scientific community and recognition of scientific quality

  11. Bibliometric Indicators (2) • CPPx: Average number of citations per publication (excluding self-cited) • CPPx/FCSm: normalized citation impact • FCSm: World citation average in the subfields • CPPx/FCSm score within the range of 0.8 and 1.2 is considered world average; above 1.2 indicates citation impact levels significantly above world average.

  12. Data sources • ISI database • SCI (Science Citation Index) • SSCI (Social Sciences Citation Index) • AHCI (Arts & Humanities Citation Index) • Specialty Citation Indexes: “CompuMath”, “Biotechnology”, “Biochemistry”, “Chemistry”, “Materials Science”, “Neurosciences”

  13. Result and Discussion

  14. Overview of publication output • Country ranking in worldwide publication output (96’~01’)

  15. Overview of publication output • Growth rates in total publication output

  16. TAIWAN CHINA SINGAPORE SOUTH KOREA Research profiles of 4 Asian countries

  17. Research profiles comparison(Asian 4 countries V.S. Advanced countries) Eastern Asia(4 countries) Advanced Countries Including United States of America Japan United Kingdom, France Germany Netherlands Israel Including Taiwan Peoples Republic of China South Korea Singapore

  18. Trend of research profiles in Taiwan

  19. Research profiles in Taiwan (43 fields)

  20. Research profiles in Taiwan (43 fields)

  21. Scientific impact of selected countries • COMPUTER SCIENCES, MATHEMATICS AND NATURAL SCIENCE

  22. Scientific impact of selected countries • ENGINEERING SCIENCE

  23. Scientific impact of selected countries • MEDICAL AND LIFE SCIENCE

  24. Scientific impact of selected countries • SOCIAL AND BEHAVIORAL SCIENCES

  25. Scientific impact of selected countries • LAW, ARTS, HUMANITIES AND MULTIDISCIPLINARY SCIENCE

  26. Scientific impact comparison(Within Asian 4 countries) *(Ranking) CPPx/FCSmx

  27. Scientific impact comparison(Within Asian 4 countries) *(Ranking) CPPx/FCSmx

  28. Scientific impact comparison(Within Asian 4 countries) *(Ranking) CPPx/FCSmx

  29. Scientific impact comparison(Within Asian 4 countries) *(Ranking) CPPx/FCSmx

  30. Future Works (1) • Micro level bibliometric analyses of Taiwanese science • Bibliometric data of 279 subfields in the period of 1995-2001 • Other bibliometric indicators are included: • CPPx/JCSm: compare the impact factor with the worldwide average in the same journal sets • JCSm/FCSm: to evaluate whether the country publishes in top journals • Breakdown of output (P) and impact (CPPx/FCSm) into ‘international collaboration’ and ‘national work’

  31. Impact: Low Average High Example 1 Scientific Research Profile Output And Impact in Physics 1991 - 2000 Field (Impact Score= CPPx/FCSmx) ＊CPPx：The average numbers of citations per publication (excluding self-citations) ＊FCSmx：The average citation rate of all papers in the fields in which the group is active. ＊Impact Score (CPPx/FCSmx) within 0.8 and 1.2 is considered world average; scores above 1.2 indicates citation impact levels significantly above world average.

  32. Impact: Low Average High Example 2 Scientific Research Profile Output And Impact in Physics 1991 - 2000 Field (Impact Score= JCSm/FCSm) ＊JCSmx：The average citation rate of all papers published in the ISI-covered journals in which a group has published. ＊FCSmx：The average citation rate of all papers in the fields in which the group is active. ＊Impact Score (JCSmx/FCSmx) within 0.8 and 1.2 is considered world average; scores above 1.2 indicates citation impact levels significantly above world average.

  33. Future Works (2) • The research performance of Taiwan’s universities/institutions • 55 universities and 20 institutions are included • Breakdown of output and impact into scientific fields • International collaboration will be analyzed

  34. Impact: Low Average High Example 1 Institutional Research Profile Output And Impact Per Institute 1991 - 2000 Taiwan's most active Physics institutes Field (Impact Score= CPPx/FCSmx) ＊CPPx：The average numbers of citations per publication (excluding self-citations) ＊FCSmx：The average citation rate of all papers in the fields in which the group is active. ＊Impact Score (CPPx/FCSmx) within 0.8 and 1.2 is considered world average; scores above 1.2 indicates citation impact levels significantly above world average.

  35. Impact: Low Average High Example 2 Institutional Research Profile Output And Impact Per Institute 1991 - 2000 Taiwan's most active Physics institutes Field (Impact Score= JCSm/FCSm) ＊JCSmx：The average citation rate of all papers published in the ISI-covered journals in which a group has published. ＊FCSmx：The average citation rate of all papers in the fields in which the group is active. ＊Impact Score (JCSmx/FCSmx) within 0.8 and 1.2 is considered world average; scores above 1.2 indicates citation impact levels significantly above world average.

  36. Impact: Low Average High Collaboration analysis Cooperation Profile:Output And Impact Per Type 1991- 2000 Taiwan’s 5 largest Physics institutes Field (Impact Score= CPPx/FCSm) ＊CPPx：The average numbers of citations per publication (excluding self-citations) ＊FCSmx：The average citation rate of all papers in the fields in which the group is active. ＊Impact Score (CPPx/FCSmx) within 0.8 and 1.2 is considered world average; scores above 1.2 indicates citation impact levels significantly above world average.

  37. Impact: Low Average High Collaboration analysis Cooperation Profile:Output And Impact Per Type 1991- 2000 Taiwan’s 5 largest Physics institutes Field (Impact Score= JCSm/FCSm) ＊JCSmx：The average citation rate of all papers published in the ISI-covered journals in which a group has published. ＊FCSmx：The average citation rate of all papers in the fields in which the group is active. ＊Impact Score (JCSmx/FCSmx) within 0.8 and 1.2 is considered world average; scores above 1.2 indicates citation impact levels significantly above world average.

  38. Future Works (3) • The links between scientific knowledge and patents • To evaluate the contribution of science to technological development in Taiwan–academia-industry linkages • To identify knowledge flows in the domestic S&T system (e.g., public-private R&D networks; role of patent citations) • To develop a model to describe the relationships (e.g., links, flows, users, providers, feedbacks)

  39. Reference • New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications • H. F. Moed, R. E. De Bruin, T. N. van Leeuwen, Scientometrics, 5(1995) 381-422 • Mapping the scientific performance of German medical research • R. J. W. Tijssen, T. N. van Leeuwen, A. F. J. van Raan, 2002 • Bibliometric mapping as a science policy and research management tool

More Related