Remaining problems with the "New Crown Indicator" (MNCS) of the CWTS
Preprint
Abstract
In their article, entitled "Towards a new crown indicator: some theoretical considerations," Waltman et al. (2010; at arXiv:1003.2167) show that the "old crown indicator" of CWTS in Leiden was mathematically inconsistent and that one should move to the normalization as applied in the "new crown indicator." Although we now agree about the statistical normalization (Optof & Leydesdorff, 2010; Van Raan et al., 2010), the "new crown indicator" inherits the scientometric problems of the "old" one in treating subject categories as a standard for normalizing differences in citation behavior among fields of science. Since we seem presently at the brink of developing a new "crown indicator," we further wish to suggest that these authors take into account that the "mean" is not a proper statistics for measuring differences among skewed distributions. Without changing the acronym of "MNCS," one could define the "Median Normalized Citation Score." This would relate the new crown indicator directly to the percentile approach that is, for example, used in the Science and Engineering Indicators of US National Science Board (2010; cf. Garfield & Pudovkin, in press; Plomp, 1990). The median is by definition equal to the 50th percentile. The indicator can thus easily be extended with the 1% (= 99th percentile) most highly-cited papers (Bornmann et al., in press). The seeming disadvantage of having to use non-parametric statistics is more than compensated by possible gains in the precision.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Normalization at the field level: Fractional counting of citationsJournal of Informetrics, 2010
- Caveats for the journal and field normalizations in the CWTS (“Leiden”) evaluations of research performanceJournal of Informetrics, 2010
- CWTS crown indicator measures citation impact of a research group's publication oeuvreJournal of Informetrics, 2010
- Percentile Rank and Author Superiority Indexes for Evaluating Individual Journal Articles and the Author’s Overall Citation PerformanceCollnet Journal of Scientometrics and Information Management, 2009
- Modifying the journal impact factor by fractional citation weighting: The audience factorJournal of the American Society for Information Science and Technology, 2008
- Can scientific journals be classified in terms of aggregated journal‐journal citation relations using the Journal Citation Reports?Journal of the American Society for Information Science and Technology, 2006
- Algorithmic procedure for finding semantically related journalsJournal of the American Society for Information Science and Technology, 2002
- The significance of the number of highly cited papers as an indicator of scientific prolificacyScientometrics, 1990
- Programmatic evaluation and comparison based on standardized citation scoresIEEE Transactions on Engineering Management, 1983
- Is citation analysis a legitimate evaluation tool?Scientometrics, 1979