Journal impact factors do not reflect article quality and impact

For many years, within the scientific and publishing arena, the journal impact factors (JIFs) has been the most commonly used and referred to approach of research output impact (quality) measurement approach.  This approach which focuses on journal quality measurement has many flows, research indicates.

Though it is still widely used, the journal impact factor has come under increasing scrutiny.  The main argument here is that JIF does not necessarily reflect the impact or quality of article published in a given journal, argues VéroniqueKiermer. The research conducted by team of researchers from Université de Montréal, Imperial College London, PLOSeLifeEMBO JournalThe Royal SocietyNature and Science, posted on BioRxiv  underscores that ‘article cannot be judged on the basis of the impact factor of the journal on which it is published.’ This is due to that fact that most articles published in high impact factor journals do not exhibit high impact level- mostly measured through article citation. The research found out that there are articles published in low impact factor journals and with a high impact factor; mostly measured though article citation. Conversely, there are many articles published in a high impact factor journals that make very little impact.

Despite its weaknesses the JIF remained the most widely used tool to evaluate scientists. This is mainly attributed to culture, convenience, and lack of proper alternatives.  ‘The misuse of the Impact Factor has become institutionalized,’ argues Véronique Kiermer.

The status quo is not sustainable. There is increasing awareness among the scholarly community about need for a change. The call for a shift from heavily relying on journals impact factor (which by itself a reflection of citation count) to accommodating diverse and reliable techniques to measure research quality and its impacts is gaining momentum. Among stakeholders consensus is building around superiority of Article Level Metrics (which measures individual articles impact) over the JIF as a barometer of research output quality and impact. This might usher new era of measuring articles quality based on every articles merit (ALM) not on the JIF.

According to Véronique Kiermer no single metric accurately reflects impact of different research output. That is the reason why measuring articles social media impact (share, like etc.) and download are becoming import impact measuring factors. Development of articles tracking technologies, through DOI (digital object identifier), has made this possible.

Scholars are pushing for multiple research quality measurement approaches. It seems that some publishers, researchers and research funders are responding to it; surely not at a desired speed.  This signals publishers’ and scholars’ gradual move towards fully embracing robust and reliable research quality measurement techniques.

Thanks for reading this article. Please comment on it and also do not forget to share it.

Related Post

covid-19, coronavirus, open access
5 Must-Reads to Understand How Open Access Can Shape Research on Covid-19

COVID-19 could kill the for-profit science publishing model. That would be a good thing. by Michael Hilrzik LA Times, March 3, 2020 “Of all the ways the current coronavirus crisis has upended commonplace routines — such as disrupting global supply chains and forcing workers to stay at home — one of the most positive is […]

Read more
november 2019, open access, must reads
Weekly Open Access Must-Reads (11-15 November 2019)

A selection of this week’s news, opinions and feature articles about open access, academia and the publishing industry.  1. Room for everyone’s talent Erkennen en waarderen in de wetenschap gaan drastisch veranderen (in Dutch) By Sicco de Knecht in Science Guide Date: 13 November 2019 Read it here in English or here in Dutch   […]

Read more
International OA week 2018: Designing Equitable Foundations for Open Knowledge

Open access has increasingly become the new norm. Countries and research funders are embracing open access. Many set targets to reach 100% open access before 2020. However, issues related to equitable sharing, diversity and inclusion is not fully addressed, according to a statement by SPARC. Open access should serve the need of all scholarly communities […]

Read more

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.