Debate Over Bibliometric Analysis Quality Heats Up in Scientometrics
A new commentary published in the journal Scientometrics on August 27, 2026, has reignited an important debate about the quality and purpose of bibliometric analysis — the quantitative study of scientific literature, citations, and research output.
The Debate
The commentary, titled "Poor bibliometric studies do not make bibliometrics poor science: a response to Ellegaard," by Serhii Nazarovets of Borys Grinchenko Kyiv Metropolitan University, responds to an earlier critical evaluation by Ole Ellegaard of the University of Southern Denmark.
Ellegaard's paper, "The method of bibliometric analysis: a critical evaluation," published in Scientometrics in May 2026, raised concerns about the significant growth in the number of bibliometric analyses (BAs) of scientific publications. Ellegaard questioned whether many of these analyses are based on well-formulated research questions or whether they should be classified as statistical analyses that primarily serve to provide an overview of a field. He also suggested that some bibliometric studies might be more appropriately published as policy briefs, institutional reports, or working papers rather than in scholarly journals.
The Response
Nazarovets pushes back on this characterization, arguing that the existence of poor bibliometric studies does not invalidate bibliometrics as a scientific discipline. The commentary contends that flawed applications of a method should not be conflated with the method itself being flawed.
The exchange touches on several themes central to the field:
- Research quality: How to distinguish rigorous bibliometric research from superficial analyses
- Peer review: The role of journals in maintaining standards
- Publication channels: Whether bibliometric work belongs in scholarly journals or alternative formats like policy briefs and institutional reports
- The Leiden Manifesto: The widely-cited principles for responsible research metrics
Why This Matters
This debate is significant because bibliometric analysis has become increasingly influential in shaping research policy, funding decisions, and institutional evaluation worldwide. As the use of quantitative metrics grows — from university rankings to grant allocation to national research assessments — the rigor of the underlying methods matters more than ever.
The exchange also reflects a broader tension in the "science of science": as the tools for measuring research become more powerful and widely used, the field must grapple with questions about what constitutes valid measurement and how results should be interpreted and disseminated.
The commentary cites foundational work in the field, including the Leiden Manifesto for research metrics and Glänzel's call for standards in bibliometric research, situating the current debate within a longer history of methodological self-examination in the discipline.
Source: Nazarovets, S. "Poor bibliometric studies do not make bibliometrics poor science: a response to Ellegaard." Scientometrics (2026).
FIRAT Editorial
Research Contributor · Foresight Institute of Research and Translation
FIRAT Editorial contributes to FIRAT's mission of generating evidence-based research and translating scientific breakthroughs into sustainable African development.
