Original scientific paper
https://doi.org/10.17535/crorr.2017.0027
A research project ranking method based on independent reviews by using the principle of the distance to the perfectly assessed project
Rudolf Scitovski
orcid.org/0000-0002-7386-5991
; Department of Mathematics, University of Osijek, Trg Ljudevita Gaja 6, Osijek, Croatia
Mario Vinković
; Faculty of Law, University of Osijek, Stjepana Radića 13, Osijek, Croatia
Kristian Sabo
; Department of Mathematics, University of Osijek, Trg Ljudevita Gaja 6, Osijek, Croatia
Ana Kozić´
; Faculty of Education, University of Osijek, Cara Hadrijana 10, Osijek, Croatia
Abstract
The paper discusses the problem of ranking research projects based on the assessment obtained from n ≥ 1 independent blinded reviewers. Each reviewer assesses several project features, and the total score is defined as the weighted arithmetic mean, where the weights of features are determined according to the well-known AHP method. In this way, it is possible to identify each project by a point in n-dimensional space. The ranking is performed on the basis of the distance of each project to the perfectly assessed project. Thereby the application of different metric functions is analyzed. We believe it is inappropriate to use a larger number of decimal places if two projects are almost equidistant (according to some distance function) to the perfectly assessed project. In that case, it would be more appropriate to give priority to the project that has received more uniform ratings. This can be achieved by combining different distance functions. The method is illustrated by several simple examples and applied by ranking internal research projects at Josip Juraj Strossmayer University of Osijek, Croatia.
Keywords
multi-criteria decision making; project evaluation; lp-distance; AHP
Hrčak ID:
193541
URI
Publication date:
30.12.2017.
Visits: 1.409 *