Projects / Programmes
Efficient governance of scientific-research system
| Code |
Science |
Field |
Subfield |
| 5.04.02 |
Social sciences |
Administrative and organisational sciences |
Public services |
| Code |
Science |
Field |
| S274 |
Social sciences |
Research methodology in science |
| Code |
Science |
Field |
| 5.06 |
Social Sciences |
Political science |
Scientific-research system
Research
Innovation
Evaluation of research impact
National research agencies
Researchers (6)
| no. |
Code |
Name and surname |
Research area |
Role |
Period |
No. of publicationsNo. of publications |
| 1. |
19760 |
PhD Simon Čadež |
Economics |
Head |
2016 - 2018 |
455 |
| 2. |
19293 |
PhD Maja Klun |
Economics |
Researcher |
2016 - 2018 |
865 |
| 3. |
15690 |
PhD Barbara Murovec |
Art history |
Researcher |
2016 - 2018 |
371 |
| 4. |
30838 |
PhD Marko Ropret |
Economics |
Researcher |
2016 - 2018 |
83 |
| 5. |
38583 |
Maja Urh |
|
Technical associate |
2017 - 2018 |
0 |
| 6. |
15203 |
PhD Barbara Vodopivec |
Historiography |
Researcher |
2017 - 2018 |
210 |
Organisations (3)
Abstract
The importance of innovation for economic and social well-being is at the forefront of most strategic documents at the EU level. The European Union`s growth strategy - EUROPE 2020 (European Commission, 2010, p. 5) prioritizes three elements, one of which is 'the development of the economy based on knowledge and innovation'. The growing importance of knowledge in modern, knowledge-based economies (Marrano et al, 2009) has triggered a pronounced trend of increasing the creation of knowledge and research productivity (Colyvas et al, 2002), also known under the paradigm "publish or perish" (Gendron, 2008; Long et al, 2009). In the EU and the USA, more than 90% of new scientific discoveries are disseminated to the general public in the form of scientific publications (Cohen et al, 2002).
The heart of national research and innovation systems in knowledge-based economies are national research agencies that govern (manage) these systems (Abramo et al, 2008; Bonaccorsi et al, 2006; Geuna and Martin, 2003). Some of the most typical national agencies are: "Research Assessment Exercise" in the UK, "Research Excellence Framework" in Australia and "Performance-based Research Fund" in New Zealand. These agencies periodically evaluate research performance of individual research institutions within the country and based on assessed performance also allocate national research funds across institutions (universities, research institutes, other research organizations) (Abramo in D'Angelo, 2009).
Parallel to the increasing institutional pressures to generate new knowledge, the quantification of research productivity is also increasing (Van Raan, 2005; Cadez, 2013). The key problem in measuring the creation of knowledge is the objective assessment of the quantity and quality of the created knowledge. Two main groups of methods are bibliometric evaluation and informed peer review (Cadez, 2013). Literature often offers arguments that bibliometric methods are a more objective and universal means of research work assessment, as publications and citations are measurable and internationally comparable (Abramo & D’Angelo, 2009; Deng & Lin, 2012; Juznic et al, 2010). But the fact is that most national systems are based on a combination of both methods (Abramo and D'Angelo, 2009, Cadez, 2013; Juznic et al, 2010).
Recently, a tendency has emerged to assess the effects of research work more broadly than just through publications and citations (Cadez et al, 2016; Gendron, 2008). An important step in this direction can be seen in the UK, where in the traditional "Research Assessment Exercise” the Agency will no longer evaluate only publications; for the first time, research institutions and individual researchers will have to demonstrate also broader social "effects" of their research (REF, 2014). Since the method of measuring these "effects" has not yet been developed, this is causing a lot of discomfort and uncertainty among research institutions and individual researchers (Reidpath and Allotey, 2010).
In Slovenia, the role of a national authority for governance (management) of a national research and innovation system is carried out by the Slovenian Research Agency (hereinafter: ARRS). ARRS has in the past established probably the most quantitative and transparent system for evaluation of research performance on a global scale which represents an important basis for allocation of programme and project funding; their allocation is namely based primarily on the past performance of researchers and institutions, as evaluated by ARRS. System of evaluation is highly sophisticated. ARRS evaluates the research output of each researcher, group of researchers, department or research institution to two decimal places, which is often mistakenly interpreted as an objective assessment of the quality and quantity of research work (Cadez et al, 2016). The system is also exceptionally transparent as this information is accessible to anyone with Internet access.
Significance for science
The aim of the project is to develop a new methodology for valuation of scientific research and its effects. Current models and systems of scientific research evaluation (that influence the careers of many exceptional individuals) promote an inflation of publications, yet many of these are not contributing to innovation, solving the problems of modern time and understanding the phenomena surrounding us. Warnings are emerging by many that in the scientific community the measure of scientific activity (publications) has become more important than the purpose (expanding knowledge and innovation).
The suggested improvements to the model of evaluation of scientific research and its impact bear potential for tremendous effect on the development of science in the future. One could view this as a potentially paradigmatic transition into a “normal state” where scientists would fulfill their mission (to advance new knowledge and innovation) and not merely accumulate publications, often with no impact even among fellow researchers. During the project members of the team will also get in contact with international researchers, an endeavour that could potentially lead to a long-term research cooperation and promotion of Slovenian science overseas.
Significance for the country
Systems of scientific research evaluation have tremendous influence in modern knowledge based economies as they exert impact on innovativeness of entire economies and companies within them. One of the anticipated project results is a proposal to improve instruments, criteria and indicators of Agency that would include also wide socially-economic effects on economy and promote innovativeness of firms and the transfer of solutions from research to business practice.
The proposed model will endeavour that limited public national funds are channeled into areas where their economic multiplication is highest. This is important - not all research achievements are equally important, same as not all innovation has the same economic impact. More efficient funding of research could potentially incentivize innovation with large economic multiplication effects (e.g. new products, new companies, new jobs, new investments, etc) that, in turn, would materialize in a growth of gross domestic product and welfare of all citizens.
Most important scientific results
Final report
Most important socioeconomically and culturally relevant results
