Better measures for evaluating researchers
Scientific researchers' performance requires proper assessment in order to allow for quality and relevance of knowledge production in science and innovation. However, there has been a discrepancy between the criteria used in performance assessment and the broader social and economic function of research. Furthermore, there is a lack of quantitative measures that are applicable at the individual level as well as for recognition for new types of work performed. In an effort to address these problems, the EU-funded project 'Academic careers understood through measurement and norms' (ACUMEN) has created criteria and guidelines for good evaluation practices. Each researcher has a portfolio on their career and contributions. In this way, they can highlight their key achievements. It also has information related to expertise, outputs and influence of each academic and the portfolio contains a narrative that can be used to explain academic merit. ACUMEN has set its method of evaluation apart from the rest by creating a new perspective, looking at constructive and performance effects and analysing the diversity aspect. It has accomplished this through a comparative analysis of current peer-review systems in Europe as well as novel peer-review practices. New web-based indicators were developed as were web-based evaluation tools. The work also has implications for evaluation practices for women's career development. Main findings are disseminated through a literature review, a peer review and a survey. The completed portfolio will be useful in the field of metrics and research evaluation.
Keywords
Evaluating researchers, performance assessment, research, academic careers, evaluation practices
