The impact of open access on the medical literature: a review of current literature

  • Nana Turk Medicinska fakulteta Centralna medicinska knjižnica Vrazov trg 2 1000 Ljubljana
Keywords: open access, citation impact, citation advantage, citation count, article download, article usage, article level metrics, altmetrics, social media attention

Abstract

Background: the aim of the article is to conduct an overview of the impact of OA on the medical articles based on 3-part categorization.

Methods: Data were identified by a search strategy with eight combinations of keywords (open access, citation impact, citation advantage, citation count, article download, article usage, social media attention, altmetrics) and searched in three different databases.

Results: the analysis was conducted on 107 studies dealing with citations, downloads and social impact. Sixty-seven of them simply employed the counting citations to OA and non-OA articles; nineteen articles compared the downloads and citations counts; and twenty-one articles investigated the social impact of OA articles. Twenty-five articles investigated the citations, download counts, and social impact of medical articles.

Conclusions: The studies investigating the citation impact mostly showed citation advantages. Those that employed citation and download counts of medical articles using randomized controlled trials showed that OA articles were downloaded significantly more frequently, but found no evidence of a citation advantage for open access articles. The citation advantage from open access might be caused by other factors. Results of the studies comparing the social media attention and citations/downloads of the medical articles are often diametrically opposed.

Downloads

Download data is not yet available.

References

What is OA? [cited 2016 29.3.]. Available from: http://guides.zsr.wfu.edu/c.php?g=34486&p=220933.

Solomon DJ. Digital Distribution of Academic Journals and its Impact on Scholarly Communication: Looking Back After 20 Years. The Journal of Academic Librarianship. 2013;39(1):23-8.

Becher T, Trowler P. Academic tribes and territories: Intellectual enquiry and the culture of disciplines: McGraw-Hill Education (UK); 2001.

Donato H. Traditional and alternative metrics: The full story of impact. Revista Portuguesa de Cardiologia. 2014;20(01):1-2.

PMC - NCBI Bethesda: US National Library of Medicine. [cited 2016 15.07.]. Available from: https://www.ncbi.nlm.nih.gov/pmc/.

Europe PMC Hinxton: European Bioinformatics Institute [cited 2016 25.07.].Available from: https://europepmc.org/.

BioMed Central: The Open Access Publisher London: BioMed Central [cited 2016 07.05.]. Available from: https://www.biomedcentral.com/.

Chan L, Cuplinskas D, Eisen M, Friend F, Genova Y, Guédon J-C, et al. Budapest open access initiative. 2002 [cited 2016 25.07.]. Available from: http://www.budapestopenaccessinitiative.org/read.

Brown JK, Byers T, Doyle C, Courneya KS, Demark-Wahnefried W, Kushi LH, et al. Nutrition and physical activity during and after cancer treatment: An American Cancer Society Guide for informed choices. Ca-A Cancer Journal for Clinicians. 2003;53(5):268-91.

Berlin declaration on open access to knowledge in the sciences and humanities [cited 2016 07.05.]. Available rom: http://www.fu-berlin.de/sites/open_access/Veranstaltungen/oa_berlin/poster/Berlin-Declaration_Simone-Rieger_MPIWG.pdf .

Directory of Open Access Journals [cited 2016 13.07.2016]. Available from: https://doaj.org/.

PLOS Public Library of Science [cited 2016 13.07.]. Available from: https://www.plos.org/.

Roemer RB BR. Keeping Up With... Altmetrics Chicago: Association of Colleg & Research Library; 2010 [22.3.2016]. Available from: http://www.ala.org/acrl/publications/keeping_up_with/altmetrics.

Altmetric Blog [Internet]2015. [cited 2016 20.3.]. Available from: https://www.altmetric.com/blog/.

Bidyarthi D. The journey from librametry to altmetrics: a look back. Golden Jubilee Celebration of Department of Library and Information Science, Jadavpur University; Kolkata: Jadavpur University; 2014.

Björk B-C, Solomon D. Open access versus subscription journals: a comparison of scientific impact. BMC Medicine. 2012;10(1):1-10.

Swan A. The Open Access citation advantage: Studies and results to date. 2010 [cited 2016 14.07.]. Available from: http://eprints.soton.ac.uk/268516/.

Lawrence S. Free online availability substantially increases a paper's impact. Nature. 2001;411(6837):521-.

Norris M, Oppenheim C, Rowland F. The citation advantage of open‐access articles. Journal of the American Society for Information Science and Technology. 2008;59(12):1963-72.

Hibrid open access journals [cited 2016 13.08.]. Available from: https://en.wikipedia.org/wiki/Hybrid_open_access_journal.

Haustein S, Larivière V, Thelwall M, Amyot D, Peters I. Tweets vs. Mendeley readers: How do these two social media metrics differ? IT-Information Technology. 2014;56(5):207-15.

Donovan JM, Watson CA. Citation advantage of open access legal scholarship. Law Libr J. 2011;103:553.

The Open Access Citation Advantage Service [cited 2016 17.06]. Available from: http://sparceurope.org/oaca/.

Wagner B. Open access citation advantage: An annotated bibliography. Issues in Science and Technology Librarianship. 2010(60):2.

Hitchcock S. The effect of open access and downloads ('hits') on citation impact: a bibliography of studies. 2004 [cited 2016 17.06]. Available from: http://opcit.eprints.org/oacitation-biblio.html.

Sotudeh H, Horri A. The citation performance of open access journals: A disciplinary investigation of citation distribution models. Journal of the American Society for Information Science and Technology. 2007;58(13):2145-56.

Zhang Y. The effect of open access on citation impact: a comparison study based on web citation analysis. Libri. 2006;56(3):145-56.

Cheng W, Ren S. Evolution of open access publishing in Chinese scientific journals. Learned Publishing. 2008;21(2):140-52.

Evans JA, Reimer J. Open access and global participation in science. Science. 2009;323(5917):1025-.

M N. The citation advantage of open access articles. PhD thesis. Leicestershire: Loughborough University; 2009 [cited 2016 18.06]. Available from: http://hdl.handle.net/2134/4089.

Gentil-Beccot A, Mele S, Brooks T. Citing and reading behaviours in high-energy physics: How a community stopped worrying about journals and learned to love repositories. arXiv preprint arXiv: 09065418. 2009.

Zawacki-Richter O, Anderson T, Tuncay N. The growing impact of open access distance education journals: A bibliometric analysis. International Journal of E-Learning & Distance Education. 2010;24(3).

Xia J, Nakanishi K. Self-selection and the citation advantage of open access articles. Online Information Review. 2012;36(1):40-51.

McCabe M, Snyder CM. Identifying the effect of open access on citations using a panel of science journals. Economic Inquiry. 2014;52(4):1284-300.

Frisch NK, Nathan R, Ahmed YK, Shidham VB. Authors attain comparable or slightly higher rates of citation publishing in an open access journal (CytoJournal) compared to traditional cytopathology journals-A five year (2007-2011) experience. CytoJournal. 2014;11(1):10.

McCabe MJ, Snyder CM. Does online availability increase citations? Theory and evidence from a panel of economics and business journals. Review of Economics and Statistics. 2015;97(1):144-65.

Sahu DK, Gogtay NJ, Bavdekar SB. Effect of open access on citation rates for a small biomedical journal. 5th International Congress on Peer Review and Biomedical Publication; 16‐18 September 2005; Chicago, USA2005 [cited 2016 18.06]. Available from: https://www.researchgate.net/publication/36446808_Effect_of_open_access_on_citation_rates_for_a_small_biomedical_journal.

Kurtz MJ, Henneken EA. Open Access does not increase citations for research articles from The Astrophysical Journal. arXiv preprint arXiv:07090896. 2007.

Soong SC. Measuring citation advantages of open accessibility. D-Lib Magazine. 2009;15 [cited 2016 18.06]. Available from: http://www.dlib.org/dlib/november09/soong/11soong.html.

Wu LL, Huang MH, Chen CY. Citation patterns of the pre‐web and web‐prevalent environments: The moderating effects of domain knowledge. Journal of the American Society for Information Science and Technology. 2012;63(11):2182-94.

Kim HH. The effect of free access on the diffusion of scholarly ideas. 2012 [cited 2016 18.06]. Available from: http://www.tiger.gatech.edu/REER%202012%20Papers/Kim_Hellen.pdf.

Shin E-J. Do Impact Factors change with a change of medium? A comparison of Impact Factors when publication is by paper and through parallel publishing. Journal of Information Science. 2003;29(6):527-33.

McVeigh ME. Open access journals: in the ISI citation databases: analysis of impact factors and citation patterns. 2005 [cited 2016 18.06]. Available from: http://ip-science.thomsonreuters.com/m/pdfs/openaccesscitations2.pdf.

Lin S-K. Non-open access and its adverse impact on molecules. Molecules. 2007;12(7):1436-7.

Lin S-K. Full open access journals have increased impact factors. Molecules. 2009;14(6):2254-5.

Mahesh G. Open access and impact factors. Current Science. 2012;103(6).

Gorraiz J, Gumpenberger C, Schloegl C, Wieland M, editors. On the temporal stability of Garfield’s impact factor and its suitability to identify hot papers2012 [cited 2016 19.09]. Availabe from: 2012.sticonference.org/Proceedings/vol1/Gorraiz_Temporal_319.pdf.

Laakso M, Björk BC. Delayed open access: An overlooked high‐impact category of openly available scientific literature. Journal of the American Society for Information Science and Technology. 2013;64(7):1323-9.

Gumpenberger C, Ovalle-Perandones M-A, Gorraiz J. On the impact of Gold Open Access journals. Scientometrics. 2013;96(1):221-38.

Sabharwal S, Patel N, Johal K. Open access publishing: a study of current practices in orthopaedic research. International orthopaedics. 2014;38(6):1297-302.

Koler-Povh T, Južnič P, Turk G. Impact of Open Access on citation of scholarly publications in the field of civil engineering a. Scientometrics, 98(2): 1033–1045.

Donovan JM, Watson CA, Osborne C. The open access advantage for American law reviews. SSRN 2506913. 2014.

Wohlrabe K, Birkmeier D. Do open access articles in economics have a citation advantage? No. 56842.: University Library of Munich, Germany; 2014.

Xia J, Myers RL, Wilhoite SK. Multiple open access availability and citation impact. Journal of Information Science. 2010:0165551510389358.

Eysenbach G. Citation advantage of open access articles. PLoS Biol. 2006;4(5):e157.

Atchison A, Bull J. Will open access get me cited? An analysis of the efficacy of open access publishing in political science. PS: Political Science & Politics. 2015;48(01):129-37.

Koler-Povh T, Turk G, Južnič P. Does the Open Access business model have a significant impact on the citation of publications? Case study in the field of civil engineering. Proceedings of the Fifth Belgrade International Open Access Conference; 2012 May 18-19; Belgrad, Serbia[cited 2016 25.07.]. Available from: http://boac.ceon.rs/index.php/BOAC/12/paper/view/68/8.

Xia J. Positioning Open Access Journals in a LIS Journal Ranking. College & Research Libraries. 2012;73(2):134-45.

Gaule P, Maystre N. Getting cited: does open access help? Research Policy. 2011;40(10):1332-8.

Gaulé P, Maystre N. Getting cited: Does open access help? College of Management of Technology. 2008 [cited 2016 19.09]. Available from: http://infoscience.epfl.ch/record/129058/files/.

Ingwersen P, Elleby AB, editors. Do open access working papers attract more citations compared to printed journal articles from the same research unit?2011 [cited 2016 19.09]. Available from: https://pure.fak.dk/ws/files/2081056/ISSI2011_RiP_Open_Access_WP_final.pdf.

Tonta Y, Ünal Y, Al U. The research impact of open access journal articles. 2007 [cited 2016 19.09]. Available from: yunus.hacettepe.edu.tr/~tonta/yayinlar/tonta-unal-al-elpub2007.pdf.

Antelman K. Do open-access articles have a greater research impact? College & research libraries. 2004;65(5):372-82.

Sotudeh H, Ghasempour Z, Yaghtin M. The citation advantage of author-pays model: the case of Springer and Elsevier OA journals. Scientometrics. 2015;104(2):581-608.

Archambault É, Amyot D, Deschamps P, Nicol A, Provencher F, Rebout L, et al. Proportion of open access papers published in peer-reviewed journals at the European and world levels—1996–2013. 2014.

Hajjem C, Harnad S, Gingras Y. Ten-year cross-disciplinary comparison of the growth of open access and how it increases research citation impact. arXiv preprint cs/0606079. 2006.

Xue-li L, Hong-ling F, Mei-ying W. Correlation between download and citation and download-citation deviation phenomenon for some papers in Chinese medical journals. Serials Review. 2011;37(3):157-61.

Gargouri Y, Hajjem C, Larivière V, Gingras Y, Carr L, Brody T, et al. Self-selected or mandated, open access increases citation impact for higher quality research. PloS one. 2010;5(10):e13636.

Schwarz GJ, Kennicutt Jr RC. Demographic and citation trends in astrophysical journal papers and preprints. arXiv preprint astro-ph/0411275. 2004.

Kurtz MJ, Eichhorn G, Accomazzi A, Grant C, Demleitner M, Henneken E, et al. The effect of use and access on citations. Information Processing & Management. 2005;41(6):1395-402.

Aman V. The potential of preprints to accelerate scholarly communication-A bibliometric analysis based on selected journals. arXiv preprint arXiv:13064856. 2013.

Metcalfe TS. The rise and citation impact of astro-ph in major journals. arXiv preprint astro-ph/0503519. 2005.

Henneken EA, Kurtz MJ, Eichhorn G, Accomazzi A, Grant C, Thompson D, et al. Effect of e-printing on citation rates in astronomy and physics. arXiv preprint cs/0604061. 2006.

Metcalfe TS. The citation impact of digital preprint archives for solar physics papers. Solar Physics. 2006;239(1-2):549-53.

Frandsen TF. The integration of open access journals in the scholarly communication system: Three science fields. Information Processing & Management. 2009;45(1):131-41.

Mueller-Langer F, Watt R. The Hybrid Open Access Citation Advantage: How Many More Cites is a $3,000 Fee Buying You? Max Planck Institute for Innovation & Competition Research Paper. 2014(14-02).

Gargouri YHS. Logistic regression of potential explanatory variables on citation counts. Preprint 11/04/2009. 2009.

Ottaviani J. The post-embargo open access citation advantage: it exists (probably), its modest (usually), and the rich get richer (of course). PLoS One. 2016;11(8):e0159614.

Kullman L, editor The Effect of Open Access on Citation Rates of Self-archived Articles at Chalmers. 2014. Available from: http://docs.lib.purdue.edu/iatul/2014/bibliometrics/2/.

Snijder R. The profits of free books: an experiment to measure the impact of open access publishing. Learned Publishing. 2010;23(4):293-301.

Moed HF. The effect of “open access” on citation impact: An analysis of ArXiv's condensed matter section. Journal of the American Society for Information Science and Technology. 2006;58(13):2047-54.

Davis PM. Author‐choice open‐access publishing in the biological and medical literature: A citation analysis. Journal of the American Society for Information Science and Technology. 2009;60(1):3-8.

Lansingh VC, Carter MJ. Does open access in ophthalmology affect how articles are subsequently cited in research? Ophthalmology. 2009;116(8):1425-31.

Riera M, Aibar E. ¿ Favorece la publicación en abierto el impacto de los artículos científicos? Un estudio empírico en el ámbito de la medicina intensiva. Medicina intensiva. 2013;37(4):232-40.

De Groote SL, Shultz M, Smalheiser NR. Examining the Impact of the National Institutes of Health Public Access Policy on the Citation Rates of Journal Articles. PloS one. 2015;10(10):e0139951.

Davis PM, Lewenstein BV, Simon DH, Booth JG, Connolly MJ. Open access publishing, article downloads, and citations: randomised controlled trial. BMJ (Clinical research ed). 2008;337:a568.

Davis P. Access, readership, citations: A randomized controlled trial of scientific journal publishing. Ithaca: Cornell University Graduate School; 2010.

Davis PM. Open access, readership, citations: a randomized controlled trial of scientific journal publishing. The FASEB Journal. 2011;25(7):2129-34.

Haque Au, Ginsparg P. Positional effects on citation and readership in arXiv. Journal of the American Society for Information Science and Technology. 2009;60(11):2203-18.

Chu H, Krichel T. Downloads vs. citations: relationships, contributing factors and beyond. e-Lis: 11085. 2007.

Watson AB. Comparing citations and downloads for individual articles at the Journal of Vision. Journal of Vision. 2009;9(4):i-i.

O'Leary DE. The relationship between citations and number of downloads in Decision Support Systems. Decision Support Systems. 2008;45(4):972-80.

Ha L, Jiang W, Bi C, Zhang R, Zhang T, Wen X. How online usage of subscription‐based journalism and mass communication research journal articles predicts citations. Learned Publishing. 2016;29(3):183-92.

Davis P, Fromerth M. Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? Scientometrics. 2007;71(2):203-15.

Davis PM. Does open access lead to increased readership and citations? A randomized controlled trial of articles published in APS journals. The Physiologist. 2010;53(6).

Davis PM. Public accessibility of biomedical articles from PubMed Central reduces journal readership—retrospective cohort analysis. The FASEB Journal. 2013:fj-13.

Davis PM. The effect of public deposit of scientific articles on readership. The Physiologist. 2012;55(5):161-3.

Nieder C, Dalhaug A, Aandahl G. Correlation between article download and citation figures for highly accessed articles from five open access oncology journals. SpringerPlus. 2013;2(1):1-5.

Schloegl C, Gorraiz J. Comparison of citation and usage indicators: the case of oncology journals. Scientometrics. 2010;82(3):567-80.

Schloegl C, Gorraiz J. Global usage versus global citation metrics: The case of pharmacology journals. Journal of the American Society for Information Science and Technology. 2011;62(1):161-70.

Anderson K, Sack J, Krauss L, O'Keefe L. Publishing online-only peer-reviewed biomedical literature: Three years of citation, author perception, and usage experience. Journal of Electronic Publishing. 2001;6(3).

Nicholas D, Huntington P, Jamali HR. The impact of open access publishing (and other access initiatives) on use and users of digital scholarly journals. Learned publishing. 2007;20(1):11-5.

Eysenbach G. Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. Journal of medical Internet research. 2011;13(4):e123.

Priem J, Piwowar HA, Hemminger BM. Altmetrics in the wild: Using social media to explore scholarly impact. arXiv preprint arXiv:12034745. 2012.

Shuai X, Pepe A, Bollen J. How the scientific community reacts to newly submitted preprints: Article downloads, twitter mentions, and citations. PloS one. 2012;7(11):e47523.

Mathelus S, Pittman G, Yablonski-Crepeau J. Promotion of research articles to the lay press: a summary of a three-year project. Learned Publishing. 2012;25(3):207-12.

Wang X, Liu C, Mao W, Fang Z. The open access advantage considering citation, article usage and social media attention. scientometrics. 2015;103(2):555-64.

Mohammadi E, Thelwall M, Haustein S, Larivière V. Who reads research articles? An altmetrics analysis of Mendeley user categories. Journal of the Association for Information Science and Technology. 2015;66(9):1832-46.

Peters I, Kraker P, Lex E, Gumpenberger C, Gorraiz J. Research data explored: an extended analysis of citations and altmetrics. Scientometrics. 2016;107(2):723-44.

Alhoori H, Ray Choudhury S, Kanan T, Fox E, Furuta R, Giles CL. On the Relationship between Open Access and Altmetrics. iConference 2015 Proceedings. 2015.

Costas R, Zahedi Z, Wouters P. Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. Journal of the Association for Information Science and Technology. 2015;66(10):2003-19.

Zahedi Z, Costas R, Wouters P. How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications. Scientometrics. 2014;101(2):1491-513.

Bar-Ilan J, Haustein S, Peters I, Priem J, Shema H, Terliesner J. Beyond citations: Scholars' visibility on the social Web. arXiv preprint arXiv:12055611. 2012.

Xuemei L, Thelwall M. F1000, Mendeley and traditional bibliometric indicators. Proceedings of the 17th international conference on science and technology indicators. 2012;2:451-551.

Liu J, Adie E. Five challenges in altmetrics: A toolmaker's perspective. Bulletin of the American Society for Information Science and Technology. 2013;39(4):31-4.

Haustein S, Peters I, Sugimoto CR, Thelwall M, Larivière V. Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature. Journal of the Association for Information Science and Technology. 2014;65(4):656-69.

Thelwall M, Haustein S, Larivière V, Sugimoto CR. Do altmetrics work? Twitter and ten other social web services. PloS one. 2013;8(5):e64841.

Barbic D, Tubman M, Lam H, Barbic S. An analysis of altmetrics in Emergency Medicine. Academic Emergency Medicine. 2016;23(3):251-68..

Allen HG, Stanton TR, Di Pietro F, Moseley GL. Social media release increases dissemination of original articles in the clinical pain sciences. PloS one. 2013;8(7):e68914.

Tonia T, Van Oyen H, Berger A, Schindler C, Künzli N. If I tweet will you cite? The effect of social media exposure of articles on downloads and citations. International journal of public health. 2016:1-8.

Fox CS, Bonaca MA, Ryan JJ, Massaro JM, Barry K, Loscalzo J. A randomized trial of social media from Circulation. Circulation. 2015;131(1):28-33.

George DR, Rovniak LS, Kraschnewski JL. Dangers and opportunities for social media in medicine. Clinical obstetrics and gynecology. 2013;56(3).

Published
2017-01-15
How to Cite
1.
Turk N. The impact of open access on the medical literature: a review of current literature. TEST ZdravVestn [Internet]. 15Jan.2017 [cited 25Apr.2024];85(11-12):640-63. Available from: http://vestnik-dev.szd.si/index.php/ZdravVest/article/view/2463
Section
Professional Article