Research Impact Beyond the Journal Impact Factor
A journal-level average says little about any individual article — and even less about real-world influence. What to measure instead, and why it matters for African researchers.
A Story in Numbers
Same researcher. Two metrics. Very different verdicts.
A young agricultural economist publishes a 3-year randomised trial showing that a cassava-storage technique cuts post-harvest loss by 38% in Cross River State.
The paper is downloaded 4,200 times, referenced in a state extension handbook reaching 12,000 farmers, and discussed in two African Union policy briefs.
The Problem
Why the Impact Factor falls short
The Response
Two declarations that changed the conversation
“Do not use journal-based metrics, such as Journal Impact Factors, as a surrogate measure of the quality of individual research articles.”
As of 2025: 23,000+ individuals · 3,500+ organisations · 165 countries · NIH, UKRI, Wellcome (DORA, 2025)
Ten principles for responsible metrics. Quantitative evaluation should support qualitative expert judgement, not replace it. Protect local relevance from global-ranking pressure.
Hicks, Wouters, Waltman, de Rijcke & Rafols, Nature 520, 429-431
The Pivot
From journal-level to article-level evidence
What it tells you about the article
- The average of every other article in the journal
- Citation skew hidden inside one number
- No view of downloads, policy use, teaching adoption
- Penalises locally-essential, globally-niche work
- Same JIF for landmark paper and routine note
What you can now measure per article
- Citation count for the specific article
- Downloads, views, bookmarks (PLOS pioneered 2009)
- News mentions, policy citations, Wikipedia links
- Social-media engagement (Altmetric.com, 2011)
- Mendeley reader counts → real audience reach
What altmetrics capture that JIF misses
The 12,000 farmers become visible
The Bigger Question
Did this change the world?
Societal impact — what REF measures, and JIF can’t
6,361impact case studies assessed in the UK’s REF 2021 — documenting effects on economy, public policy, health outcomes, culture (UKRI, 2022)
For African research in agriculture, public health, water, education, climate adaptation — where citation lag is long but societal benefit is rapid — the societal-impact lens is essential.
What To Do About It
Three practical responses for African researchers + institutions
Researchers — diversify your evidence
Modern CVs should include article-level downloads, altmetric scores, policy citations, teaching adoption, and named user organisations. FRELIP indexes these signals automatically for African open-access work.
Institutions — adopt responsible-metrics policies
Sign DORA. Then do the harder work: rewrite promotion criteria so committees are obliged to consider article-level and societal-impact evidence (Ghana, Cape Town, APHRC lead the continent).
Funders — align evaluation frameworks
Wellcome, Gates, Plan S already require DORA-compliant assessment. TETFund, NRF South Africa and African Academy of Sciences can accelerate the shift continent-wide.
Explore open research on FRELIP
FRELIP surfaces article-level and societal-impact signals for African open-access scholarship — discovery, guides, journals and learning in one place.
References cited
- DORA. (2012). San Francisco Declaration on Research Assessment. sfdora.org/read/
- DORA. (2025). Signatories — DORA. sfdora.org/signers/
- Garfield, E. (2006). The history and meaning of the journal impact factor. JAMA, 295(1), 90-93. doi.org/10.1001/jama.295.1.90
- Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature, 520(7548), 429-431. doi.org/10.1038/520429a
- Larivière, V., et al. (2016). A simple proposal for the publication of journal citation distributions. bioRxiv. doi.org/10.1101/062109
- Lin, J., & Fenner, M. (2013). Altmetrics in evolution: Defining and redefining the ontology of article-level metrics. Information Standards Quarterly, 25(2), 20-26.
- Priem, J., Piwowar, H. A., & Hemminger, B. M. (2012). Altmetrics in the wild. arXiv. arxiv.org/abs/1203.4745
- UK Research and Innovation. (2022). REF 2021 results overview. ref.ac.uk/2021/
Published on FRELIP — Free eLibrary Portal · Born in Nigeria, built for the world.
frelip.org · info@frelip.org