Ranking games

Eval Rev. 2015 Feb;39(1):102-29. doi: 10.1177/0193841X14524957. Epub 2014 Aug 4.

Abstract

Background: Research rankings based on bibliometrics today dominate governance in academia and determine careers in universities.

Method: Analytical approach to capture the incentives by users of rankings and by suppliers of rankings, both on an individual and an aggregate level.

Result: Rankings may produce unintended negative side effects. In particular, rankings substitute the "taste for science" by a "taste for publication." We show that the usefulness of rankings rests on several important assumptions challenged by recent research.

Conclusion: We suggest as alternatives careful socialization and selection of scholars, supplemented by periodic self-evaluations and awards. The aim is to encourage controversial discourses in order to contribute meaningful to the advancement of science.

Keywords: academic governance; motivation; rankings; selection; socialization.

Publication types

  • Review

MeSH terms

  • Humans
  • Motivation
  • Observer Variation
  • Organizational Innovation
  • Peer Review / methods*
  • Professional Competence / statistics & numerical data*
  • Publications / standards*
  • Publications / statistics & numerical data
  • Publishing / organization & administration
  • Science / organization & administration*
  • Universities / organization & administration