PDPaul Donner

Paul Donner

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Paul Donner has a total of 28 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    The case for citation count ranges

    by Paul Donner

    Citation counts have a central role in scientometrics, but unlike references, they are not directly created by researchers writing papers. Citations are produced, or mediated, by citation indexes through the large-scale automated processing of cited reference data. This makes the citation the conceptual inversion of the cited reference.

  • Open Access

    The case for citation count ranges

    by Paul Donner

    Citation counts have a central role in scientometrics, but unlike references, they are not directly created by researchers writing papers. Citations are produced, or mediated, by citation indexes through the large-scale automated processing of cited reference data. This makes the citation the conceptual inversion of the cited reference.

  • Open Access

    Does citation context information enhance the validity of citation analysis for measuring research quality? An empirical comparison of peer assessments and enriched citations

    by Paul Donner, Stephan Stahlschmidt, Robin Haunschild, Lutz Bornmann

    As citation context information has entered the Web of Science (Clarivate) in recent years, one wonders whether the legitimacy and soundness of citation analyses for measuring research quality of publications can be improved by considering this information. The legitimacy and soundness of citation analysis can be established by assessing its construct validity. This can be done by studying how citation impact variables relate to generally accepted external validation data, like human expert assessments of research quality. In this study, we investigated the statistical associations of information extracted from structured citation context data—such as the position of citations in certain sections—with postpublication peer quality ratings from Faculty Opinions (H1 Connect) as external validity criterion data for publications in medicine and life sciences. We found that quantitative variables derived from citation contexts are correlated with human expert assessments over and above ordinary citation counts. Hence, the construct validity of citation analyses can be improved by incorporating citation context data into measurement models. The legitimacy and soundness of citation analyses for measuring research quality can be improved by considering this information.


  • Open Access

    The Data Infrastructure of the German Kompetenznetzwerk Bibliometrie: An Enabling Intermediary between Raw Data and Analysis

    by Marion Schmidt, Christine Rimmert, Dimity Stephen, Christopher Lenke, Paul Donner, Simone Gärtner, Niels Taubert, Thomas Bausenwein, Stephan Stahlschmidt

    Academic data infrastructures facilitate bibliometric research and reporting, as they link bibliometric data with research interests. In Germany, the Kompetenznetzwerk Bibliometrie (KB), a national consortium of 22 institutions, serves this purpose by hosting, probing, and curating large-scale bibliometric raw data from commercial and open providers. Users at partner institutions regularly apply the data infrastructure in workflows. Due to its former focus on commercial data, the KB’s infrastructure has not been detailed transparently to date. However, as an increasing number of bibliometric publications and reports rely upon it, this article provides a comprehensive documentation of the KB’s infrastructure specifically designed for bibliometric applications. It explains the conceptual considerations employed to define the infrastructure’s technical characteristics and procedures. Descriptions are provided regarding (1) the technical infrastructure, (2) the KB’s own database schema consistently applied across several bibliometric databases, (3) processing bibliometric raw data, (4) multi-dimensional quality assurance processes, and (5) additional data curation. By making these procedures transparent and open to scrutiny, we aim to bolster the reliability of our infrastructure and facilitate reproducible research while contributing to the broader discourse on transparency in the field of bibliometrics and providing input to other organisations developing similar infrastructures. Peer Review: https://www.webofscience.com/api/gateway/wos/peer-review/10.1162/qss.a.20


  • Are Citation Context Information Stronger Related to Peer Ratings Than Citation Counts? A Descriptive Analysis

    by German Centre for Higher Education Research and Science Studies (DZHW), Paul Donner, Stephan Stahlschmidt, Robin Haunschild, Lutz Bornmann

    In this study, we investigated whether citation context information is able to increase the validity of citation impact analyses to measure research quality compared to simple citation counts. We analyzed the statistical relationships of information extracted from structured citation context data in the Web of Science (Clarivate) such as the placement of citations within specific sections of an article with post-publication peer review quality ratings from Faculty Opinions (H1 connect), used as an external validity criterion for research quality. The study is based on publications in medicine and life sciences. Our findings reveal that quantitative metrics derived from citation contexts, particularly in-text citation counts, exhibit stronger correlations with expert evaluations compared to traditional citation counts. Consequently, integrating citation context data appears to improve the legitimacy and reliability of citation analyses as tools for assessing research quality.

  • Almost Always Unequal: Co-Authors’ Contributions to Scientific Publications

    by German Centre for Higher Education Research and Science Studies (DZHW), Paul Donner, Philippe Vincent-Lamarre, Canadian Institutes of Health Research (CIHR)

    Scientific work has become increasingly organized as teamwork and most research publications are now joint work of several co-authors. While of utmost importance for fair and valid research evaluation, the quantitative patterns of relative work contribution by team members to co-authored publications have remained opaque. Here we present an empirical study of contribution patterns. We analyze a large data set of author-provided percent contribution claims for co-authored scientific publications submitted as part of applications to scholarship programs. We find that the distribution of work input in co-authored publications is overwhelmingly unequal. This is in direct contrast to extant assumptions in research evaluation practice and professional science studies which presuppose equal contributions and do not adjust or weight publication and citation counts differentially by contribution. Such flawed methodology should be discontinued, as it unfairly disadvantages major contributors.

  • Open Access

    Alphabetical author order and co-author contributions in mathematics

    by Paul Donner, Przemysław Korytkowski

    In this study we investigate the relative contributions of co-authors to publications in mathematics. Mathematics is an interesting case for such research because it is one of only a few scientific disciplines in which alphabetical order of names of co-authors on publications is still the prevailing convention rather than contribution-based order. The study is based on unique data of publicly available author-provided quantitative contribution statements for co-authored papers from applications for habilitation degrees in Poland. This data allows us to investigate if alphabetical name order goes hand in hand with equally large contributions of co-authors or hides differences in contribution sizes. We find that the empirical contributions by co-authors are usually close to the equal contributions suggested by alphabetical order but in a substantial proportion of observations the equality assumption would be misleading about actual contributions. This has implications for bibliometric methodology. In mathematics, equal fractional counting of author contributions is close to the contributions declared by the authors themselves. We further find that authors who are habilitation applicants claim slightly more credit, ceteris paribus, than their non-applicant co-authors.


  • Open Access

    On author self-citations as carriers of scientific topic structure information

    by Paul Donner, Edwin Henneken

    Author self-citations are a somewhat controversial phenomenon. Some scholars maintain they are a normal, even indispensable, part of scientific referencing practice, while others claim they are frequently an expression of vanity and self-promotion. Citations are the basic data for citation network clustering, an important approach to creating bottom-up, data-driven, global taxonomic systems of research publications. Thus, the topical information content of self-citations is of particular interest in this context. Because it is not yet known how author self-citations affect such systems, we study the question of their influence on cluster solution topic quality in a citation network by experimentally reweighting self-citation edges by increasing and decreasing their link weights according to self-citation status and strength. As a case study, we investigate data in the field of astronomy and astrophysics. We assess the effects of self-citation manipulations by evaluating the quality of the resulting clustering solutions using diverse external data containing meaningful topic-structural information, namely topical journal special issues, cousage data from scientific literature database search logs, grant funding data, and intellectual paper-level classification assignments. We find that we can reliably improve clustering solution quality by emphasizing self-citation link weights.


  • Top Cited Papers
    Open Access

    Reference coverage analysis of OpenAlex compared to Web of Science and Scopus

    by Jack H. Culbert, Anne Hobert, Najko Jahn, Nick Haupka, Marion Schmidt, Paul Donner, Philipp Mayr

    OpenAlex is a promising open source of scholarly metadata, and competitor to established proprietary sources, such as the Web of Science and Scopus. As OpenAlex provides its data freely and openly, it permits researchers to perform bibliometric studies that can be reproduced in the community without licensing barriers. However, as OpenAlex is a rapidly evolving source and the data contained within is expanding and also quickly changing, the question naturally arises as to the trustworthiness of its data. In this report, we will study the reference coverage and selected metadata within each database and compare them with each other to help address this open question in bibliometrics. In our large-scale study, we demonstrate that, when restricted to a cleaned dataset of 16.8 million recent publications shared by all three databases, OpenAlex has average source reference numbers and internal coverage rates comparable to both Web of Science and Scopus. We further analyse the metadata in OpenAlex, the Web of Science and Scopus by journal, finding a similarity in the distribution of source reference counts in the Web of Science and Scopus as compared to OpenAlex. We also demonstrate that the comparison of other core metadata covered by OpenAlex shows mixed results when broken down by journal, where OpenAlex captures more ORCID identifiers, fewer abstracts and a similar number of Open Access status indicators per article when compared to both the Web of Science and Scopus.