Republic of Slovenia Slovenian Research Agency Tivolska 30 Ljubljana, Slovenia

1. Republic of SloveniaSlovenian Research AgencyTivolska 30Ljubljana, Slovenia Dr. Franci Demšar Director http://www.arrs.gov.si/sl/ Maribor, 5. June 2008

2. Young country with rich scientific culture! • The begining of science and technology to the late Middle Ages • First book in Slovenian language - 1550 • University of Ljubljana - 1919 • Slovenian Academy of Science and Arts - 1938 • modern research institutes - after 2. world war • parallel and complementary concept of S&T policy from 60’s • autonomous institutional construction of S&T policy from 1991

3. Contents: • About Slovenian Research Agency • Some facts about theresearch system in Slovenia • Trends of outputs of research activities in Slovenia • Research evaluation system of SRA • Transparency of the SRA work

4. Strategic level Government of the RS Science & technology council Policy level Ministry of Defence MHEST Operational level Executive level Scientific Community Other ministries SRA Institutional design and position of the SRA

5. SRA main areas of operation Promotion of excellent and applicative research Monitoring and analysing Objective evaluation Funding of research

6. A brief description of the SRA logo A graphic image of the manuscript of the Logarithm Tables by Slovenian mathematician, physicist and artillery officer Jurij Vega.

7. Establishing: November 2004, Government of the Republic of Slovenia • Status: a legal person of public law; indirect user of the budget of the Republic of Slovenia • Mission: performing professional tasks relating to implementation of the adopted National Research and Development Programme • Budget: 150 million € per year (2006)

8. Total ARRS research funding by budget category (2007) 150 Mio €

9. MHEST SRA SAZU ME MIS MD Slovenian budget for S&T, 2005-2009 (public sources)

10. Contents: • About Slovenian Research Agency • Some facts about theresearch system in Slovenia • Trends of outputs of research activities in Slovenia • Research evaluation system of SRA • Transparency of the SRA work

11. Institutionalresearch landscape • 4 Universities: • University of Ljubljana (26 faculties) • University of Maribor (12 faculties) • University of Primorska (7 faculties) • University of Nova Gorica (6 faculties) • National Research Institutes (15) • Private (non-profit) ResearchInstitutes (ca. 100) • Research unites in business (ca. 300)

12. Evolution of research organizations in Slovenia

13. Number of Researchers in FTE

14. Share of changes of researchers in last ten years

15. Number of female researchers in FTE by sector of performance

16. Government funding of R&D in 90’s:

17. R&D expenditure as a proportion of GDP (%) in Slovenia and in selected countries

18. Expenditures (in €) for R&D per inhabitant

19. Comparative structure of the sources of financing R&D expenditure

20. Funding from different sources as a % share of RD expenditure by sector of performance Fi Fi Fi

21. Contents: • About Slovenian Research Agency • Some facts about theresearch system in Slovenia • Trends of outputs of research activities in Slovenia • Research evaluation system of SRA • Transparency of the SRA work

22. Comparison of the structure of publishing

23. Intensity of changes for publications and citations

25. Number of EU patent applications per million population, 2004

26. Annual growth of EU patent applications

28. Contents: • About Slovenian Research Agency • Some facts about theresearch system in Slovenia • Trends of outputs of research activities in Slovenia • Research evaluation system of SRA • Transparency of the SRA work

29. Research evaluation system in Slovenia

30. Nomination of the body Selected by the body Peers Scientific merit Socio-economic sign. Bodies, participating in the evaluation process SRA scientific council of the discipline Temporary body for projects evaluation Panel of experts

31. Short project applications - outline Projects selected on the basis of A1 + A2 + A3 & B1 + B2 + B3 100 % of available quota Projects selected on the basis of expert panel assessment 100 % of available quota I. phase II. phase Call for submission of full proposals Assessments are send to applicants Just selected projects are invited Evaluation made by the panel on the basis of peer review (international) – 2 per project Final priority list of projects Panel: scientific body & international peers Scientific Council of the Agency Evaluation system

32. Main principles of the evaluation - 1 Quantitative criteria • Quality of scientific records • Mark A1– publications in last 5 years SICRIS (cobiss) • Mark A2– standardized number of citations (WoS) • Scientific and socio-economic relevance • Mark A3– money from sources other that SRA

33. Contents: • About Slovenian Research Agency • Some facts about theresearch system in Slovenia • Trends of outputs of research activities in Slovenia • Research evaluation system of SRA • Transparency of the SRA work

34. 1 Transparency = corruption The role of transparency in research policy • Enables accountability of public servants and reduces potentials of corruption • Enhance the identification with solutions • Resolves the (potential) conflict of interests • Increased effectiveness because of the “invisible hands of public”

35. Milestones in developing transparency • 1958 – first report on work of Boris Kidrič Fund • 1994 – creation of centralised bibliographic system (COBISS) • 1997 – first “White book on financing” published inthe Internet • 1997 – obligatory inclusion of bibliographies into COBISS • 1998 – Development of Slovenian Current Information System (SICRIS) • 1998 – timetable for all national calls published in internet a year in advance • 2006 – online “White book on financing” where all transactions are presented in a real time

36. Key element of the system – legitimacy of procedures • Inclusion of researchers in different points of the procedure e.g. Evaluation methodology – unique for each field of science Researchers Scientific Council of the Discipline SRA Scientific Council

37. ARRS and Transparency

38. Elements of transparency • Transparency of instruments • Transparency of Procedures • Financial Transparency • Transparency of results of the research

39. Elements of transparency • Transparency of instruments • Annual plan of public calls • Timetable of evaluation process • Guidelines prepared by the Ministry of higher education science and technology; • Published names peers and members of decision-making bodies

40. Annual plan of public calls

41. Timetable of evaluation process

42. Guidelines prepared by the Ministry

43. Elements of transparency • Transparency of procedures • Evaluation methodology– unique for each field of science • Transparent membership in expert bodies (published on SRA home page) • Procedure of peers selection is known in advance • Evaluation criteria (questions for peers) are prepared, adopted and published in advance • Publicly available results of selection process

44. Evaluation methodology

45. Results of evaluation

46. Elements of transparency • Financial Transparency • Annual financial reports (White book on financing) • Up-to date overview of distribution of budget(online white book)

47. Annual report on financing

48. Up-to date financing overview

49. Elements of transparency • Transparency of research results • Use of COBISS bibliographic system • Use of SICRIS system and its abstracts of research work • The most important scientific results • Socio-economic significance of research • Use of international citation indexes (ISI, CSA and other bibliographic databases • In the future implementation of full text database

50. COBISS bibliographic system