Projects / Programmes source: ARIS

Developing an integrated model of indicators for monitoring and evaluating the effectiveness of e-government policies

Research activity

Code Science Field Subfield
5.04.01  Social sciences  Administrative and organisational sciences  Public administration 

Code Science Field
S170  Social sciences  Political and administrative sciences 

Code Science Field
5.09  Social Sciences  Other social sciences 
policy evaluation, project evaluation, e-government, e-government matrics, e-government quality indicators
Evaluation (rules)
source: COBISS
Researchers (10)
no. Code Name and surname Research area Role Period No. of publicationsNo. of publications
1.  18942  PhD Aleksander Aristovnik  Economics  Researcher  2011 - 2014  942 
2.  03313  PhD Jaroslav Berce  Social sciences  Researcher  2011 - 2013  293 
3.  23497  PhD Barbara Brečko  Sociology  Researcher  2011 - 2012  120 
4.  28239  PhD Tina Jukić  Administrative and organisational sciences  Researcher  2011 - 2014  165 
5.  20223  PhD Simona Kustec  Political science  Researcher  2012 - 2014  471 
6.  30418  MSc Aleksander Novaković  Computer science and informatics  Researcher  2011 - 2014 
7.  32754  PhD Dalibor Stanimirović  Systems and cybernetics  Researcher  2011 - 2014  203 
8.  16302  PhD Ljupčo Todorovski  Computer science and informatics  Researcher  2011 - 2014  445 
9.  10155  PhD Vasja Vehovar  Sociology  Researcher  2011 - 2014  844 
10.  02262  PhD Mirko Vintar  Computer science and informatics  Head  2011 - 2014  420 
Organisations (3)
no. Code Research organisation City Registration number No. of publicationsNo. of publications
1.  0582  University of Ljubljana, Faculty of Social Sciences  Ljubljana  1626957  40,347 
2.  0590  University of Ljubljana, Faculty of Public Administration  Ljubljana  1627163  8,798 
3.  2323  IPMIT Institute for Project management and Information Tecnology Ltd.  Ljubljana  1294105 
E-government development has been one of the most significant development areas for public sector modernization in the last decade. Annually, Slovenia invests approximately 120 million euro in the development of e-government and the European Union around 50 billion euro. However, several studies have pointed out that these enormous investments have not brought the expected results. User acceptance of e-government services is far below government expectations; the expected effects in terms of reducing costs and increasing the efficiency of public administration are missing; the organizational changes expected to bring greater efficiency, reduce administrative barriers and costs are still in their infancy. All these facts suggest that decision-making on e-government policies and projects should be based on measurable and verifiable indicators of their short-and long-term effects. Key research challenges we are facing in this area are associated with the development of indicator models as well as metrics and tools, which could provide applicable support to government decision makers and facilitate more qualified and quantified preparation, implementation and evaluation of e-government policies (ex-ante or ex-post). Research is based on the hypothesis that existing models and tools for evaluation of e-government policies do not provide enough valuable information to government decision makers in conducting quality decision-making. According to the available basic and applied research, it is possible to extract the key decision-making levels, monitored by the current indicators and measurement models utilizing the quantitative and/or qualitative indicators, namely: the infrastructure level, project level, organizational level, political/sociological level, national level. These groups of indicators are now appearing in dozens of different, completely inconsistent models and approaches.   The research framework consists of three phases: state of the art, development of the models and development of a IT solution prototype for decision-making. The research comprises an analysis and synthesis of theoretical research and existing models, which will provide a basis for the development of integral model of indicators for evaluation of e-government policies and projects. Model is designed to support decision-making at the five outlined levels, which are emphasized in the evaluation of e-government policies and projects. Measurable and verifiable indicators from these five levels provide an integrated assessment of e-government policy. Based on this five-level model analytical-hierarchical decision-making model will be developed, which will combined with appropriate ICT tools (e.g. Web-HIPRE) enable all key stakeholders to conduct the evaluation of either planned or already implemented policies and projects (ex-ante or ex-post). To alleviate the problems with data filling and maintain the simplicity of the model usage, we will also develop a database of all the indicators and their attributes. In addition, the applicability of the developed models and tools will be tested on a few trial cases from practice and optimized in cooperation with the Ministry of Public Administration.    Expected results of the research project, namely the developed integrated model of indicators, an indicators database and related decision support tools represent a significant advance in research of metrics for evaluation of e-government policies and projects. The obtained results will provide an applicable support for planning and evaluating national e-government policies, while methodologically, the developed models will be adaptable to other fields of public policy evaluation, as well. We believe that expected results fully correspond to European directive on reducing administrative burdens and costs for 25 % till 2012 as well as priority in this call which emphasizes the more intensive use of ICT in the public sector and development of public policies.
Significance for science
Metrics in the field of monitoring the development of e-government is still in its infancy due to the novelty and the rapid development of the field. Multitude of research institutions around the world as well as international organizations of the United Nations, OECD, EU, etc is engaged in its development. This led to dozens of approaches, models and indicators, but they are substantively and methodologically completely uncoordinated and therefore incomparable. The most important achievement of the research is therefore to develop a unified / coherent multi-level model of indicators and their main attributes. Multilevel model is designed to allow vertical aggregation of indicators of the project to the national level.
Significance for the country
The results have universal significance for the international community and for Slovenia. That is the reason why we have developed a catalog of indicators in two languages. The catalog has wider applicability not only in the field of e-government, but also in some related areas as it contains a number of indicators, which have economical, political science or organizational aspects.
Most important scientific results Annual report 2011, 2012, 2013, final report, complete report on dLib.si
Most important socioeconomically and culturally relevant results Annual report 2011, 2012, 2013, final report, complete report on dLib.si
Views history