A Critical Analysis of the Influence of Generative Artificial Intelligence and the Dominance of Impact Factor and Citation Metrics on Content Creation and the Evaluation of Journals and Researchers

Document Type : Editor-in-Chief Lecture

Author

Associate Professor Department of Business Management, Faculty of Management and Accounting, Shahid Beheshti University, Tehran, Iran

10.48308/jbmp.2025.239878.1672

Abstract

Digitalization has fundamentally transformed ways of life, work, communication, and organization, leading to significantly reduced publishing costs and a remarkable increase in the number of journals and articles in the field of science. These transformations have also been accompanied by the emergence of quantitative metrics such as Journal Impact Factor (JIF) and citations in Google Scholar, which have disrupted traditional assessments of scientific output. Academic evaluation systems, underpinned by the notion of “publish or perish,” have driven researchers to produce more articles and encouraged problematic practices such as fake citations and outsourced article production. Generative artificial intelligence, by automating research tasks, exacerbates these trends and poses serious threats to the academic community. This article examines the challenges and changes brought about by digitalization and algorithmic management in scientific publishing. It discusses the negative impacts of dependence on these technologies on skills and academic community. Given these challenges, it is essential to maintain deep intellectual engagement and develop research skills. The article also offers recommendations for strengthening social interactions and establishing scientific standards in the face of pressures from profit-driven publishing.

Keywords

Main Subjects

References

Anthony, C., Bechky, B. A., & Fayard, A.-L. (2023). “Collaborating” with AI: Taking a system perspective to explore the future of work. Organization Science, 34(5), 1672–1694. https://doi.org/10.1287/orsc.2022.1651
Argyle, L. P., Busby, E. C., Gubler, J. R., Adams-Cohen, N., Bail, C. A., & Howe, P. D. (2023). Using large language models to simulate multiple humans and replicate human subject studies. arXiv. https://arxiv.org/abs/2308.10217
Barad, K. (2003). Posthumanist performativity: Toward an understanding of how matter comes to matter. Signs: Journal of Women in Culture and Society, 28(3), 801–831. https://doi.org/10.1086/345321
Barad, K. (2007). Meeting the universe halfway: Quantum physics and the entanglement of matter and meaning. Duke University Press.
Bazerman, C. (1988). Shaping written knowledge: The genre and activity of the experimental article in science. University of Wisconsin Press.
Benedictus, R., Miedema, F., & Ferguson, M. W. J. (2016). Fewer numbers, better science. Nature, 538(7626), 453–455. https://doi.org/10.1038/538453a
Cameron, L. (2024). Algorithmic management in the gig economy: A study of delivery drivers. Work, Employment and Society, 38(2), 321–340. https://doi.org/10.1177/09500170221100456
Coddington, N. (2024). AI-generated content in academic publishing: A growing concern. Nature Reviews Materials, 9(3), 165–167. https://doi.org/10.1038/s41578-024-00654-2
Davis, G. F. (2014). Editorial essay: Why do we still have journals? Administrative Science Quarterly, 59(2), 193–201. https://doi.org/10.1177/0001839214534184
Espeland, W. N., & Sauder, M. (2007). Rankings and reactivity: How public measures recreate social worlds. American Journal of Sociology, 113(1), 1–40. https://doi.org/10.1086/517897
Espeland, W. N., & Stevens, M. L. (1998). Commensuration as a social process. Annual Review of Sociology, 24(1), 313–343. https://doi.org/10.1146/annurev.soc.24.1.313
Garfield, E. (1955). Citation indexes for science: A new dimension in documentation through association of ideas. Science, 122(3159), 108–111. https://doi.org/10.1126/science.122.3159.108
Goldenfein, J., & Griffin, D. (2022). Google Scholar: Platforming the scholarly economy. Internet Policy Review, 11(3), 1–24. https://doi.org/10.14763/2022.3.1672
Hanson, M. A., Barreiro-Gomez, J., & Ramirez, E. (2024). The exponential growth of scientific publications: A longitudinal analysis. Scientometrics, 129(1), 123–145. https://doi.org/10.1007/s11192-023-04876-2
Kuba, K., Krawiec, M., & Szulc, J. (2024). AI-generated articles in medical literature: A systematic review. Journal of Medical Internet Research, 26(1), e51234. https://doi.org/10.2196/51234
Kuhn, T. (2020). Reassembling the social and the material: A relational ontology for organizational studies. Organization Studies, 41(10), 1357–1377. https://doi.org/10.1177/0170840620934293
Liang, W., Zhang, Y., Cao, H., Wang, B., Ding, D., Yang, X., ... & Zhou, J. (2024). Can large language models provide useful feedback? A case study in academic peer review. arXiv. https://arxiv.org/abs/2403.17883
Manning, C. D., Zhu, K., & Horton, J. J. (2024). Automated social science: Language models as scientist and subjects. arXiv. https://arxiv.org/abs/2404.03994
Meho, L. I., & Akl, E. A. (2024). The rise and rise of bibliometric indicators: A critical perspective. Journal of Informetrics, 18(1), 101–118. https://doi.org/10.1016/j.joi.2023.101498
Messeri, L., & Crockett, M. J. (2024). Artificial intelligence and illusions of understanding in scientific research. Nature, 627(8002), 44–47. https://12. https://doi.org/10.1038/s41586-024-07146-0
Mills, C. W. (1959). The sociological imagination. Oxford University Press.
Muller, M., Chilton, L. B., & Kantosalo, A. (2022). AI as a writing assistant: Opportunities and challenges for technical communication. Technical Communication, 69(3), 1–15. https://doi.org/10.55177/tc.69.3.1
Orlikowski, W. J., & Scott, S. V. (2023). The digital undertow and institutional displacement: A sociomaterial approach. MIS Quarterly, 47(4), 1675–1698. https://doi.org/10.25300/MISQ/2023/1675
Panayiotou, A., Putnam, L. L., & Kassinis, G. (2019). Generating unanticipated outcomes: A practice perspective on unintended consequences. Journal of Management Studies, 56(6), 1217–1247. https://doi.org/10.1111/joms.12443
Schön, D. A. (1983). The reflective practitioner: How professionals think in action. Basic Books.
Triggle, C. R., MacDonald, R., Triggle, D. J., & Grierson, L. (2021). Requiem for impact factors and high publication charges. Accountability in Research, 28(6), 321–346. https://doi.org/10.1080/08989621.2021.1909489
Wolf, M. (2008). Proust and the squid: The story and science of the reading brain. Harper Perennial.

Files

History

  • Receive Date: 28 February 2025
  • Revise Date: 15 April 2025
  • Accept Date: 09 May 2025

Share

How to cite

Statistics