eCite Digital Repository

How to rank journals

Citation

Bradshaw, CJA and Brook, BW, How to rank journals, PLoS ONE, 11, (3) Article e014985. ISSN 1932-6203 (2016) [Refereed Article]


Preview
PDF
2Mb
  

Copyright Statement

Copyright 2016 Bradshaw, Brook. Licensed under Creative Commons Attribution 4.0 International (CC BY 4.0) https://creativecommons.org/licenses/by/4.0/

DOI: doi:10.1371/journal.pone.0149852

Abstract

There are now many methods available to assess the relative citation performance of peer-reviewed journals. Regardless of their individual faults and advantages, citation-based metrics are used by researchers to maximize the citation potential of their articles, and by employers to rank academic track records. The absolute value of any particular index is arguably meaningless unless compared to other journals, and different metrics result in divergent rankings. To provide a simple yet more objective way to rank journals within and among disciplines, we developed a κ-resampled composite journal rank incorporating five popular citation indices: Impact Factor, Immediacy Index, Source-Normalized Impact Per Paper, SCImago Journal Rank and Google 5-year h-index; this approach provides an index of relative rank uncertainty. We applied the approach to six sample sets of scientific journals from Ecology (n = 100 journals), Medicine (n = 100), Multidisciplinary (n = 50); Ecology + Multidisciplinary (n = 25), Obstetrics & Gynaecology (n = 25) and Marine Biology & Fisheries (n = 25). We then cross-compared the κ-resampled ranking for the Ecology + Multidisciplinary journal set to the results of a survey of 188 publishing ecologists who were asked to rank the same journals, and found a 0.68–0.84 Spearman’s ρ correlation between the two rankings datasets. Our composite index approach therefore approximates relative journal reputation, at least for that discipline. Agglomerative and divisive clustering and multi-dimensional scaling techniques applied to the Ecology + Multidisciplinary journal set identified specific clusters of similarly ranked journals, with only Nature & Science separating out from the others. When comparing a selection of journals within or among disciplines, we recommend collecting multiple citation-based metrics for a sample of relevant and realistic journals to calculate the composite rankings and their relative uncertainty windows.

Item Details

Item Type:Refereed Article
Keywords:journal ranking
Research Division:Information and Computing Sciences
Research Group:Library and information studies
Research Field:Informetrics
Objective Division:Information and Communication Services
Objective Group:Information services
Objective Field:Library and archival services
UTAS Author:Brook, BW (Professor Barry Brook)
ID Code:111825
Year Published:2016
Web of Science® Times Cited:25
Deposited By:Plant Science
Deposited On:2016-10-10
Last Modified:2018-03-28
Downloads:68 View Download Statistics

Repository Staff Only: item control page